AI Matters
Why it matters
Cloudflare introduces granular controls to block specific AI bots
The Decoder Cloudflare replaces its blanket AI bot block with granular controls for search, training, and agent crawlers
Cloudflare released new controls allowing customers to manage search, training, and agent bots separately, with training bots blocked by default on ad-supported pages.
Why it matters
Website owners can now choose to block AI training crawlers while still allowing search engines to index their content.
Latest brief · Jul 22, 2026