apurvns on Nostr: "untraining" a Large Language Model on specific content. The New York Times doesn't ...
"untraining" a Large Language Model on specific content.
The New York Times doesn't want its content in #ChatGPT. #OpenAI would have to retrain its models from scratch. Removing any content from their models would cost them millions of dollars. Paper from #Microsoft Research that tries to fix this. They don't actually delete knowledge from the model. They overwrite it.
Published at
2024-01-27 18:49:06Event JSON
{
"id": "2c915eae87175676ff8ca871f46fcd3080969ea94a580f0a4fd85399b768018f",
"pubkey": "9b4f6c8ce310ed60da80bc2bd058c6fb42a22d68d84952ffbab61769dd565cb3",
"created_at": 1706381346,
"kind": 1,
"tags": [
[
"imeta",
"url https://image.nostr.build/b2bcc67447d308f1b153df2d0b39dde7ce869dda14d16ad92159c605cfafdefe.jpg",
"blurhash e9RysgRj~qof?b~qofM{j[M{?bofRjayRjM{fQofayt7ofWBRjayj[",
"dim 1460x1182"
],
[
"t",
"chatgpt"
],
[
"t",
"openai"
],
[
"t",
"microsoft"
],
[
"r",
"https://image.nostr.build/b2bcc67447d308f1b153df2d0b39dde7ce869dda14d16ad92159c605cfafdefe.jpg"
]
],
"content": "\"untraining\" a Large Language Model on specific content.\n\nThe New York Times doesn't want its content in #ChatGPT. #OpenAI would have to retrain its models from scratch. Removing any content from their models would cost them millions of dollars. Paper from #Microsoft Research that tries to fix this. They don't actually delete knowledge from the model. They overwrite it. https://image.nostr.build/b2bcc67447d308f1b153df2d0b39dde7ce869dda14d16ad92159c605cfafdefe.jpg ",
"sig": "24716d789dadfb5af357c427ecf2ea9755cb75e7e02427e247499f8e191e7ff2327ded69ce4c15bc3f713141c28a3a182409c3f35a1deb6a506692db00147e19"
}
