Nature article on "model collapse" in genAI applications.
AI/LLM tools feed on human-made data and use these to give human-like answers to new questions. Knowledge becomes distorted, and such distortions become part of the information pool for the next round of data scraping. This loop permanently pollutes the resulting knowledge representation.
Unpolluted sources of genuine human knowledge become ever more valuable but are ever harder to find.
#genAI #LLM #AI
https://www.nature.com/articles/s41586-024-07566-y
the roamer /
npub1e8…0aee5
2024-08-26 16:28:38
Author Public Key
npub1e8wut6m44sf0jhsfvk232rx7dcct6nnvqrervlc8hr7rnh8rnw2qq0aee5Seen on
wss://relay.mostr.pubPublished at
2024-08-26 16:28:38Event JSON
{
"id": "017fc367e77a2650a0bcc593532b97cda8fc866c0c47f3c449d7d7b2a99de1f1",
"pubkey": "c9ddc5eb75ac12f95e096595150cde6e30bd4e6c00f2367f07b8fc39dce39b94",
"created_at": 1724689718,
"kind": 1,
"tags": [
[
"t",
"genai"
],
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"proxy",
"https://mastodonapp.uk/users/the_roamer/statuses/113029265414717293",
"activitypub"
]
],
"content": "Nature article on \"model collapse\" in genAI applications.\n\nAI/LLM tools feed on human-made data and use these to give human-like answers to new questions. Knowledge becomes distorted, and such distortions become part of the information pool for the next round of data scraping. This loop permanently pollutes the resulting knowledge representation. \n\nUnpolluted sources of genuine human knowledge become ever more valuable but are ever harder to find. \n\n#genAI #LLM #AI \n\nhttps://www.nature.com/articles/s41586-024-07566-y",
"sig": "47c0ccec6a38270ffc35ef41f46c5ab23b2e7d9a2e3379616776d763ac7fdba93cb889b1792c1f84fc0a30bca5f69f199ae528335bc3cfcd9114af2ec0c1a046"
}