ClaudeBot (second worst crawler) and GPTBot are the only ones that identify them...

		braden_e on May 22, 2024 \| parent \| context \| favorite \| on: How we blocked TikTok's Bytespider bot and cut our... ClaudeBot (second worst crawler) and GPTBot are the only ones that identify themselves in an obvious way. The rest I am blocking by network. I assume AI when the crawler is very aggressively downloading images - it must be costing them an absolute fortune!

Thanks for these!