According to real-time data collected by Cloudflare Radar on June 4, 34.1% of global HTTP traffic comes from bots, while 65.9% comes from real people; Cloudflare statistics indicate that the growth rate of automated traffic is about 8 times that of human traffic. AI crawlers account for about 22% of all bot traffic, making them the second-largest category after search engine crawlers.
AI Crawler Market Share Breakdown: Meta-ExternalAgent Surpasses GPTBot
(Source: Cloudflare Radar)
Cloudflare data shows the share of major AI crawlers:
Meta-ExternalAgent: about 16.3%, has overtaken GPTBot for the #1 spot
ClaudeBot: about 11.6%
Applebot: surged 140% month-over-month, jumping from about 2.97% to 7.15%; Cloudflare characterizes this as a sign that Apple Intelligence is increasing the intensity of data scraping
GPTBot: has been surpassed by Meta-ExternalAgent (the exact share fluctuates)
Cloudflare explains that numbers may vary across different reports; the above data should be viewed as directional trends rather than precise rankings.
Login Attempts and Overall Traffic Structure
Cloudflare data shows that 94% of website login attempts come from bots. Mobile devices account for 55.4% of global traffic, while desktops account for 44.6%. Cloudflare explains that the 34.1% bot traffic does not equal malicious traffic; it includes a variety of types such as search engine spiders, network monitoring tools, API integration services, and AI crawlers. Among AI crawlers, training crawlers (i.e., those that scrape data for long-term model training) make up over 51.5%, while the rest are real-time crawlers (used for answering user queries in real time).
FAQ
What types are included in Cloudflare’s 34.1% bot traffic?
Based on Cloudflare Radar data, the 34.1% bot traffic includes multiple types such as search engine crawlers, AI training crawlers, network monitoring tools, API integration services, and malicious attack programs. AI crawlers account for about 22% of bot traffic, making them the second-largest category.
What does Applebot’s 140% growth in a single month mean?
Cloudflare data shows that Applebot increased from about 2.97% to 7.15% within a single month, for a growth of 140%. Cloudflare characterizes this as a sign that Apple Intelligence is stepping up web page data scraping.
Is Cloudflare CEO Matthew Prince’s 2027 prediction confirmed fact?
No. Matthew Prince’s public personal prediction that “bot traffic will surpass human traffic in 2027” is explicitly described in Cloudflare’s original text as “a prediction, not a fact.” The currently confirmed data are the 34.1% share of bot traffic and that the growth rate of automated traffic is about 8 times that of human traffic.
