Bold claim: the internet’s economics are being rewritten by AI, and Cloudflare is at the center of the debate. Since July 1, Cloudflare reports they've blocked 416 billion AI bot requests for its customers, as large language models harvest vast swaths of the web. This follows the company’s Content Independence Day initiative, which prompts content creators to block AI crawlers by default unless AI firms pay for access. Since July 2024, Cloudflare has given customers tools to block AI bots from scraping their content, and the latest figure shows 416 billion blocks since July 1, 2025.
Matthew Prince, Cloudflare’s cofounder and CEO, framed the issue as a turning point in how the internet earns its living. He told WIRED that content creation traditionally drives traffic, which is monetized through products, subscriptions, or ads. Yet AI represents a platform shift that could dramatically alter that business model. He’s devoting significant time to understanding what the internet might become when content creation and access are reshaped by AI—and how Cloudflare can influence that evolution in favor of a fairer, more open ecosystem.
Cloudflare’s mission centers on speed and security for online content. But with AI surging and a handful of dominant players gathering power, Prince emphasizes using Cloudflare’s position to prevent excessive concentration and preserve a market where businesses and creators of all sizes can not only survive but thrive.
A key concern Prince raises is Google’s approach to its combined search and AI crawlers. Because Google blends its search and AI indexing, blocking its AI scraper could also suppress a site’s visibility in Google Search. This creates a dilemma for publishers who don’t want their work used to train AI models but still rely on Google for audience discovery.
Prince notes that Google enjoys privileged visibility on the web, citing Cloudflare’s observations that Google can see roughly 3.2 times more pages than OpenAI, 4.6 times more than Microsoft, and about 4.8 times more than Anthropic or Meta. In his view, this dominant access creates an imbalance that can hinder competition and fair access to information.
Publishers who have started blocking AI crawlers report encouraging results. The argument is that human, original, contextual thinking—whether from local news outlets or casual Reddit discussions—remains valuable to AI developers seeking to expand models. That value could translate into licensing arrangements or paid-content models that offer a sustainable path for creators over the long term.
Regulation, Prince suggests, may eventually be necessary. Until then, Cloudflare intends to keep pressing for an AI market that is pluralistic and competitive, rather than centralized and consolidated. He frames this as both a return to core open-internet principles and sound business strategy: more diverse content means more potential customers for Cloudflare and greater protection for the broader online ecosystem.
In a closing metaphor, Prince describes the industry as a rotating power dynamic: today’s hero can become tomorrow’s villain. He points to Google as the primary obstacle to progress and urges a shift where search and AI crawlers are treated separately, ensuring fair play for all participants. His hope is that, through policy, strategy, and market pressure, the internet can move toward a future where content creators retain agency, access remains open, and competition drives better outcomes for everyone.
