Cloudflare's New Policy: AI Companies Must Pay for Publishers' Content
Cloudflare announced a major policy shift — starting September 15, default settings will block "mixed-use" crawlers. The company also launched a Monetization Gateway using the open x402 protocol for stablecoin payments.
What Changed on July 1, 2026?
Under Cloudflare's new policy, starting September 15, 2026, the company's default settings will block "mixed-use" crawlers — bots that simultaneously perform search, agent, and AI training functions — from any page that hosts advertisements. Cloudflare CEO Matthew Prince noted that "the majority of traffic on the Internet is now non-human."
Monetization Gateway: A New Model
Cloudflare launched the Monetization Gateway, allowing customers to charge for any asset protected by Cloudflare: web pages, APIs, datasets, and even MCP tools. Payments settle in stablecoins (USDC and Open USD) via the open x402 protocol, with a coalition of 25+ industry leaders.
Ceramic.ai and You.com Pilots
Cloudflare is piloting with Ceramic.ai and You.com on a "Pay Per Use" model where publishers are compensated when their content creates value in AI search results or premium content access.
Why This Matters
Cloudflare's data shows over 50% of AI crawl traffic re-fetches unchanged pages. This marks a fundamental shift from the 30-year "content for advertising" model to a "content for value" approach — the first major infrastructure company to create a fair economic exchange framework between AI companies and content creators.