npub1r9jrhg4d249sn7z7pyunpsa9zcdr7rjtg90x3w3e78a7jrp7wadsvw4h54 (npub1r9j…4h54) see https://social.platypush.tech/@blacklight/110852894403019575
I'm actually fine with a full machine-readable web where open information can be used by whoever for whatever within the boundaries of law.
After all, this was exactly the dream of the semantic web that we had 10-15 years ago.
As a big scraping advocate, I don't want to end up in the position where I like scraping when it's me doing it while I condemn it when it's Google.
But things need to be symmetric in order to work.
I also expect from Google and friends the same level of coherence and intellectual honesty that I try to impose on myself.
Google shouldn't advocate for their right to scrape the web and then harass the developers of youtube-dl.
They should allow me to legally scrape YouTube videos, so I can use music and speech snippets to train my own models.
They should provide an RSS interface for their search results, so I can integrate them into other products or do my analysis on them. If those results were generated by scraping openly available information, then those results themselves should be openly available too.
They should also provide an RSS interface for their news results, for the same principle - it's scraped and digested content, so they can't lock it up.
They should also provide access to their data via open protocols (e.g. pure IMAP for Gmail, WebDAV for calendar and contacts, XMPP for whatever messaging system they're pushing now...), so they can really prove their commitment to a web where knowledge can easily be exchanged between machines without barriers.
Until they do it, I defend my right to call them out as hypocrites.
My problem is not with them scraping the web. My problem is with them not allowing me to legally do the same with their products.
Fabio Manganiello /
npub1v7…ukv0u
2023-08-09 11:34:51
in reply to nevent1q…5mzj
Author Public Key
npub1v78mmuz20p6qd6nve30axhqu74avwn4f6z4grhug7755rat7wh3syukv0uPublished at
2023-08-09 11:34:51Event JSON
{
"id": "0978308581303a8e4433377452aa2dcbc26eb5a910b70019b895d61fe7ce21a6",
"pubkey": "678fbdf04a787406ea6ccc5fd35c1cf57ac74ea9d0aa81df88f7a941f57e75e3",
"created_at": 1691580891,
"kind": 1,
"tags": [
[
"p",
"19643ba2ad554b09f85e093930c3a5161a3f0e4b415e68ba39f1fbe90c3e775b",
"wss://relay.mostr.pub"
],
[
"p",
"669b3efb34b9c91239ef41a4e484d060857f8d68ddf324bed02b60ec4b8fb1f8",
"wss://relay.mostr.pub"
],
[
"e",
"68913e55ec3e23d7f9a429a0ba725a73a971029688170867869865e6e59afb53",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://social.platypush.tech/users/blacklight/statuses/110859445274027842",
"activitypub"
]
],
"content": "nostr:npub1r9jrhg4d249sn7z7pyunpsa9zcdr7rjtg90x3w3e78a7jrp7wadsvw4h54 see https://social.platypush.tech/@blacklight/110852894403019575\n\nI'm actually fine with a full machine-readable web where open information can be used by whoever for whatever within the boundaries of law.\n\nAfter all, this was exactly the dream of the semantic web that we had 10-15 years ago.\n\nAs a big scraping advocate, I don't want to end up in the position where I like scraping when it's me doing it while I condemn it when it's Google.\n\nBut things need to be symmetric in order to work.\n\nI also expect from Google and friends the same level of coherence and intellectual honesty that I try to impose on myself.\n\nGoogle shouldn't advocate for their right to scrape the web and then harass the developers of youtube-dl.\n\nThey should allow me to legally scrape YouTube videos, so I can use music and speech snippets to train my own models.\n\nThey should provide an RSS interface for their search results, so I can integrate them into other products or do my analysis on them. If those results were generated by scraping openly available information, then those results themselves should be openly available too.\n\nThey should also provide an RSS interface for their news results, for the same principle - it's scraped and digested content, so they can't lock it up.\n\nThey should also provide access to their data via open protocols (e.g. pure IMAP for Gmail, WebDAV for calendar and contacts, XMPP for whatever messaging system they're pushing now...), so they can really prove their commitment to a web where knowledge can easily be exchanged between machines without barriers.\n\nUntil they do it, I defend my right to call them out as hypocrites.\n\nMy problem is not with them scraping the web. My problem is with them not allowing me to legally do the same with their products.",
"sig": "e5ad6c66aa9cef89d7258f6722d6bc4ac2789f988585e6732ab4f4ca20ac3dcfee92cca490b02de7f53272a4c0561ccb47bcf396cbf2f16206359f60ce14b854"
}