logo

Redirects for AI Training enforces canonical content

ID: 636eb103-2718-54e0-96e0-fad3b1be8415

STIX ID: report--636eb103-2718-54e0-96e0-fad3b1be8415

Feed Name: Cloudflare Blog

Date Published: 2026-04-17

Date Updated: 2026-04-27

Author: Cam Whiteside

...
...

Cloudflare announces “Redirects for AI Training,” a feature that enforces <link rel="canonical"> semantics by returning HTTP 301 redirects to verified AI training crawlers so deprecated documentation isn’t ingested; the post also describes Radar’s AI Insights status-code analysis for crawler traffic and provides configuration guidance in the dashboard. The feature applies only to verified AI crawler categories and is intended to improve what crawlers receive without affecting human users or unverified bots.

Your team is not currently subscribed to this feed. You must subscribe to it in order to see this post.