More Than Half of Web Traffic Comes from AI Bots
Following AI agents, traffic from AI bots has also started to arrive on the web, and the volume of this bot traffic (any non-human traffic to a website or an app) is increasing day by day. Automated traffic will overtake human traffic in network measurements.
AI crawlers and agents are increasingly moving from simple content scraping to login pages, forms, carts, and payment flows.
According to Cloudflare data, in a comparison of bot versus human traffic over the last 12 months;
- 68.1% of HTTP requests originated from human traffic,
- while 31.9% came from bots.
Bot Traffic
The volume of bot traffic is increasing day by day.
Bot vs Human Traffic for HTTP Requests
Bot vs Human Traffic for HMTL Content
Bot vs Human Traffic for XML Content
Bot vs Human Traffic for JSON Content
Bot vs Human Traffic for Plain Text Content
Geographical Distribution of Bot Traffic
What AI Bot Traffic Includes?
| Type | Purpose |
|---|---|
| AI training crawlers | Collect content for model training and data pipelines |
| AI search crawlers | Index pages so AI systems can retrieve or cite them |
| AI agents | Act on behalf of users, such as comparing products or filling out tasks |
| Malicious AI-enabled bots | Scrape data, create accounts, test credentials, abuse APIs, or buy scarce products |
For online businesses, the risk is more serious because AI agents are beginning to interact with transactional parts of websites. Automated traffic can:
- Increase hosting and bandwidth costs.
- Scrape original articles, product data, prices, or databases.
- Distort analytics and SEO reports.
- Overload APIs and search systems.
- Attempt credential stuffing or account takeover.
- Automate scalping and inventory abuse.
- Create fake accounts or submit fraudulent forms.
Note: The important distinction is that not all AI bot traffic is harmful. Search and user-requested agents may help visibility or provide useful services, but uncontrolled training crawlers and malicious automation can impose costs without returning value.
Source
Related Topics
