MummaBear 🇬🇧 🏴 (Dame) on Nostr: It's easy to stop spiders crawling and indexing websites. How do you prevent LLM's ...
It's easy to stop spiders crawling and indexing websites.
How do you prevent LLM's from crawling your content?
#ai
#search
Published at
2024-01-06 09:47:20Event JSON
{
"id": "24160587890d82dd34400a244923eada72bc1471622a703221e5460ae8cad554",
"pubkey": "060e03b149a0c119388f23ba6edc3406d31b1dfce57fdd5f76a6f00765632162",
"created_at": 1704534440,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"search"
],
[
"proxy",
"https://noagendasocial.com/users/Mummabear/statuses/111708369113955115",
"activitypub"
]
],
"content": "It's easy to stop spiders crawling and indexing websites.\n\nHow do you prevent LLM's from crawling your content? \n#ai\n#search",
"sig": "0be221d5c7fadb5a2ff8a04ebbd66563c891425a4c0112d8e360b50ed7585d16cfb383a971aaa93d750c8c8938d06dc31c6f05986c37a3c81abcec8f69e1cbe1"
}
