"Since January 2024, we have seen the bandwidth used for downloading multimedia content grow by 50%. This increase is not coming from human readers, but largely from automated programs that scrape the Wikimedia Commons image catalog of openly licensed images to feed images to AI models."
How crawlers impact the operations of the Wikimedia projects – Diff
https://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/
#AI #Wikimedia #LLM
Miguel Máiquez /
npub10d…gltae
2025-04-05 21:08:01
Author Public Key
npub10dz70h5fgtz3mrhny5lmn07cvudql823tmswm4ehauamlhxty4tqfgltaeSeen on
wss://relay.mostr.pubPublished at
2025-04-05 21:08:01Event JSON
{
"id": "143bb32ade5042064a896ab83474df6ee45c9f228eeb6d833ce777209933078d",
"pubkey": "7b45e7de8942c51d8ef3253fb9bfd8671a0f9d515ee0edd737ef3bbfdccb2556",
"created_at": 1743887281,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"wikimedia"
],
[
"t",
"llm"
],
[
"proxy",
"https://mastodon.social/users/miguelmaiquez/statuses/114287396850386271",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.mostr.pub"
]
],
"content": "\"Since January 2024, we have seen the bandwidth used for downloading multimedia content grow by 50%. This increase is not coming from human readers, but largely from automated programs that scrape the Wikimedia Commons image catalog of openly licensed images to feed images to AI models.\"\n\nHow crawlers impact the operations of the Wikimedia projects – Diff\n\nhttps://diff.wikimedia.org/2025/04/01/how-crawlers-impact-the-operations-of-the-wikimedia-projects/\n\n#AI #Wikimedia #LLM",
"sig": "0443b83101667e492042ce89af8a8487bdbb157b78a9ce0b5eb9dc6222024d778e2682d48d746fb9e38c3ae73a32618449e1bfe9237a5b2a8c84ed1c57089a0d"
}