According to Cloudflare's Radar – a free, publicly accessible internet observability platform – bots now account for 57.5% of global web requests, compared with 42.5% generated by humans. As reported by Business Standard, Cloudflare co-founder and CEO Matthew Prince announced on June 3, 2026, that this marks the first time in internet history that bots have overtaken human traffic – a milestone he had expected to arrive in 2027. The shift signals a structural change in how the web is being used, with increasingly active participation from automated systems in information discovery and consumption. Recent data shows the imbalance has been even more pronounced, with bots accounting for up to 58% of traffic over the past few days, and 63.4% of Internet traffic generated by bots in France over the last 7 days.
According to Fastly's data, bots broadly fall into three increasingly important categories based on their functions. AI crawlers systematically scan websites and collect information for indexing or training large language models, while AI fetchers retrieve information in response to specific user requests when AI assistants need current data such as prices or availability. AI agents are emerging systems capable of performing multi-step tasks on behalf of users, including comparing flights, checking product prices, summarising information across websites, or completing basic online actions. Together, these categories are creating a rapidly growing layer of automated activity across the internet, with AI agents now performing a wide range of tasks including consultations of product pages, full browsing sessions, collection and indexing of web content, and personal assistant functions for ordering food, shopping, and handling customer service interactions.
The growth in bot traffic is closely linked to the rise of AI assistants that increasingly interact with the web. According to Fastly's data, AI-related bot requests on its network rose around 30% between January and May 2026, roughly 6.5 times faster than human traffic over the same period. The company also reported that Claude-related traffic increased more than 555% compared with its January baseline. This represents a significant shift from traditional search engine functionality to AI-powered systems that function as answer engines, gathering information in the background and returning consolidated responses. Cloudflare's metrics are based on the number of HTTP requests made, not on engagement time, meaning a human session will typically last longer than a bot session that may consult several sources simultaneously without lingering.
Bots operate differently from humans in terms of infrastructure demands and usage patterns. According to Fastly, fewer than 9% of human requests require direct access to origin servers, while more than 51% of bot-related requests require direct origin access to obtain fresh, real-time information. This means bot traffic is not just growing in volume but also increasing infrastructure demand for businesses. The rise of AI-powered systems is reshaping the relationship between publishers and platforms, with many describing a 'zero-click internet' where content is consumed without users visiting original sources. The location of SaaS scraping tools can significantly affect analysis for some countries, depending on where the servers are located.
The impact extends beyond publishing to ecommerce, where bots are increasingly involved in product discovery and comparison. According to Cloudflare, many AI-powered bots already perform tasks such as reading product pages, checking prices, and comparing options. OpenAI has expanded shopping capabilities within ChatGPT, while Google is investing in agentic commerce where AI systems actively assist users in evaluating products. This shift means retailers may need to optimise not only for human shoppers but also for AI systems influencing product recommendations, fundamentally changing how shopping begins and how businesses compete for visibility in the evolving internet landscape.
