Declare your AIndependence: block AI bots, scrapers and crawlers with a single click

Cloudflare announces a one-click “AI Scrapers and Crawlers” block for all customers and shares network-wide insights showing heavy activity from AI bots such as Bytespider, Amazonbot, ClaudeBot, and GPTBot, many of which are frequently blocked or ignore robots.txt. The post highlights that evasive crawlers often spoof user agents, yet Cloudflare’s global ML models assign low bot scores that enable automatic blocking via existing WAF rules. It also presents adoption metrics, top disallowed bots, and offers mechanisms for customers to report misbehaving AI crawlers, with a commitment to continually update fingerprints and detection models.