News

Cloudflare is using Workers AI to generate this content ahead of time. The pages are stored in R2 storage for fast retrieval, and care is taken to prevent cross-site scripting vulnerabilities.
Cloudflare suggested its AI partners benefit from "long-term collaboration" with creators whose updated content will help AI products stay relevant. They also can stop wasting money scraping poor ...
Cloudflare, a cloud infrastructure provider that serves 20% of the web, announced Tuesday the launch of a new marketplace that reimagines the relationship between website owners and AI companies ...
Roughly 16% of global internet traffic goes directly through Cloudflare's CDN, the firm estimated in a 2023 report. "AI crawlers have been scraping content without limits. Our goal is to put the ...
Starting Tuesday, every new web domain that signs up to Cloudflare will be asked if they want to allow or block AI crawlers. At least 16% of the world's internet traffic gets routed through ...
07-14-2025 TECH The era of free AI scraping may be coming to an end Cloudflare takes a stand on AI crawlers, which could enable publishers to finally make peace with the bots scooping up their ...
Cloudflare, one of the world’s largest internet infrastructure providers, has begun blocking AI web crawlers by default unless they receive direct permission from site owners. This new policy changes ...
Cloudflare Expands Effort to Block Website Scraping from AI Crawlers Published: July 1, 2025 at 6:40 a.m. ET Share Resize ...
On Tuesday, the internet infrastructure company Cloudflare announced that it will block AI bots from scraping data from its sites without opt-in permission. Cloudflare hosts about 20 percent of the ...
Internet infrastructure company Cloudflare said this week it’s launching a system to block bots from scraping clients’ sites or at least allow them to charge AI companies for access.