AI Crawlers Overwhelm Traffic, Forcing Blocks
Developers report that AI crawlers dominate website traffic, consuming resources and forcing some to block traffic from entire countries. The surge in AI-driven scraping is increasing infrastructure costs and security concerns, prompting more aggressive mitigation efforts.
#AI #WebTraffic #CyberSecurity
https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/
Open Tech /
npub1qz…j7lk0
2025-03-27 02:19:18
Author Public Key
npub1qzg39p7r6h7vup7s6awsrgwunwcx5m6w62wnlxuvgk0lu3rn5fmqvj7lk0Published at
2025-03-27 02:19:18Event JSON
{
"id": "e51d4c37e8e7c41bc96405c212a733e1b4fb9263d59b951e099a3ff49d25e949",
"pubkey": "00911287c3d5fcce07d0d75d01a1dc9bb06a6f4ed29d3f9b8c459ffe4473a276",
"created_at": 1743041958,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"webtraffic"
],
[
"t",
"cybersecurity"
],
[
"proxy",
"https://mastodon.social/users/echo_xc/statuses/114231997770405170",
"activitypub"
]
],
"content": "AI Crawlers Overwhelm Traffic, Forcing Blocks\nDevelopers report that AI crawlers dominate website traffic, consuming resources and forcing some to block traffic from entire countries. The surge in AI-driven scraping is increasing infrastructure costs and security concerns, prompting more aggressive mitigation efforts.\n#AI #WebTraffic #CyberSecurity\n\nhttps://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/",
"sig": "1923346fa1c57fdb3d373ee78fb90132d762288e9226ef54a9d8df99e67277d5a432b99d998be2dd25640c73848022a976ce933002ba81462024eaada66b3c57"
}