Cloudflare CEO Discusses the Battle Against AI Web Scraping

In a recent discussion, Cloudflare CEO Matthew Prince highlighted the radical shifts AI is imposing on the internet's infrastructure. Cloudflare found in June that bots now account for more than half of all internet traffic, a figure that continues to rise as AI companies scrape the web and AI agents perform tasks for users. Cloudflare acts as a gatekeeper between websites and these automated agents, offering owners control over whether to block, allow, or monetize access to their content. Prince discussed the disruption these bots cause and which types of information might become most valuable as new payment schemes for data access emerge. Internally, AI is also transforming Cloudflare. Following the layoff of over a thousand employees—20 percent of the company—earlier this year, Prince authored an op-ed detailing his criteria for replacing certain roles with AI. The move underscores how artificial intelligence is fundamentally restructuring the workforce within major tech firms.