Cloudflare launches Disallow AI Training for crawlers

Cloudflare@CloudflareSep 15, 2026

Today, Cloudflare is announcing a new Disallow AI Training setting that lets you easily stay indexed for search while refusing to let that same crawler train on your content. https://t.co/TF5K2Ret1D

Views168.9k
Comments19
Reposts77
Likes579
Launched Sep 15, 2026View post

More from Cloudflare

1

Today we're launching a developer preview of WebMCP on Cloudflare. With one switch, any site becomes usable by browser AI agents — no new APIs, no origin changes — while the human stays in control and creators keep their traffic. https://t.co/8SlWN1icTJ #AgentsWeek

Aug 6, 2026
Views834.3k
Comments82
Reposts378
View post
2
3
4

Search is how we find nearly everything on the web — creators, merchants, answers. AI is rewriting the rules, leaving creators caught between staying discoverable in an agentic era and getting paid for their work. Today we're launching two initiatives to help.

Jul 1, 2026
Views23.5k
Comments6
Reposts13
View post

See all Cloudflare launches →