Post

Cloudflare's post announcing this new AI bot-blocking option reports that the highest-volume bot it's seen is Bytespider, owned by TikTok's parent firm ByteDance, which it recorded crawling 40.4% of Cloudflare-protected sites. OpenAI's GPTBot came in second, at 35.46%.

Cloudflare launched a one-click option to block known AI bots, crawlers, and scrapers. blog.cloudflare.com/declaring-yo...

Declare your AIndependence: block AI bots, scrapers and crawlers with a single clickblog.cloudflare.com To help preserve a safe Internet for content creators, we’ve just launched a brand new “easy button” to block all AI bots. It’s available for all customers, including those on our free tier.