← All insights
The AI-First Web

More Bots Than Humans. The Web We Built Is No Longer For Us.

53% of web traffic is now automated. Humans are the minority. Cloudflare processes 81M+ requests per second and confirms: bots won. The question is whether your infrastructure was built for the winners.

· 6 min read
Share on X LinkedIn

The Crossover Happened

53% of all web requests
Automated traffic
Source: Cloudflare Radar 2025 Year in Review. Measured across 81M+ HTTP requests/second, 330+ cities globally. AI bots: 4.2%. Non-AI bots: 44%. Combined: ~48-53%.
47%
Human traffic
Source: Cloudflare Radar 2025 Year in Review. Humans are now the minority of web traffic.
4.2% of HTML requests
AI bot traffic growth
Source: Cloudflare Radar. AI crawlers alone — GPTBot, ClaudeBot, Google-Extended — now generate more traffic than many countries.

We called it. The WebPulse thesis — 'the web was built for humans, that era is ending' — is no longer a thesis. It's a measurement. Cloudflare, which processes more web traffic than almost anyone on Earth, confirms: automated traffic now exceeds human traffic. The crossover happened.

What This Means for Framework Choice

If more than half of your traffic is machines, your framework choice is no longer about human experience alone. It's about machine parseability, structured data output, API-first architecture, and response time under automated load. WordPress produces 2,000+ lines of HTML before the first content element. Astro produces clean semantic HTML in 50 lines. When bots are the majority visitor, which output do you think gets processed more efficiently?

Our AI-Readiness scores suddenly look less like a nice-to-have and more like a survival metric. WordPress: 35/100. Astro: 92/100. FastAPI: 95/100. The frameworks scoring highest are the ones built for the traffic that now dominates the web.

The Geographic Dimension

40%
US share of global bot traffic
Source: Cloudflare Radar. The US originates more bot traffic than the next 9 countries combined.
71% of all bot traffic
Top 10 countries
Source: Cloudflare Radar.

Bot traffic concentrates geographically — and it concentrates where cloud infrastructure lives. AWS and Google Cloud together originate about 24% of all bot traffic. The countries with the most modern framework adoption (.ai, .dev, .io) are also the countries generating the most bot traffic. The builders and the consumers are the same population.

The 74% Problem

Our scan found 74.3% of the detectable web runs WordPress. Cloudflare's top-5K scan found 47%. The gap — 74% vs 47% — is the long tail. The broad web is even more legacy than the elite web. And the broad web is where most of the 53% bot traffic lands. Bots crawl the entire web, not just the top 5,000 sites. They're hitting 7.4 million WordPress sites that were built for human browsers that are no longer the primary visitors.

This isn't a future prediction. This is today's traffic measurement from the largest web infrastructure provider on Earth.

Share this insight
More insights