nixCraft 🐧 on Nostr: Reddit blocked all search engines including bing, DDG, and others, but because of the ...
Reddit blocked all search engines including bing, DDG, and others, but because of the deal with Google, it is still making money and is the top destination for many Google searches. Here is robots.txt. They are blocking it because AI bots are scrapping and profiting from user-generated content. If you do this you will be dropped from Google immediately but now they have a deal with Google
Published at
2024-07-26 10:55:59Event JSON
{
"id": "8312654c0e5a41567ccee5fa51267fda83c4b02e465e43aff0aa3a9755fe972a",
"pubkey": "cc3790930722bfa73e28f9a2aa0832706884305cb80687e20927c7960db99185",
"created_at": 1721991359,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/users/nixCraft/statuses/112852425765027385",
"activitypub"
]
],
"content": "Reddit blocked all search engines including bing, DDG, and others, but because of the deal with Google, it is still making money and is the top destination for many Google searches. Here is robots.txt. They are blocking it because AI bots are scrapping and profiting from user-generated content. If you do this you will be dropped from Google immediately but now they have a deal with Google\n\nhttps://files.mastodon.social/media_attachments/files/112/852/420/556/247/839/original/31f388e247753ebd.png",
"sig": "d4eef48a4445539f0d9e75fa529e7771846b04067e253b25db943e151b872ebe17491307d7f578bc55eaabae69466fbd69a9ab19d5c1edcf4ce9679f5b0607da"
}
