The problem is that LLMs are an untrustworthy-data-generator, not just data retreval. In the past *humans* wrote things, and most of the time those humans actually checked things before writing them. It was their job. The search just brought source material to you.
LLMs will generate 1000 made up ones at the drop of a hat.
It's the *saturation* that's the danger. Especially when they feed on thier own output. It becomes ever less trustworthy.
Callionica (npub1emh…q9c5) Scott Jehl (npub133e…rqrd)
Matt Wilcox /
npub143…9ca2f
2024-06-20 16:20:03
in reply to nevent1q…v4gu
Author Public Key
npub143cel990w4aws2t66w9f8xxlr35gunyxj6t4fvt05t8rxlwedslqh9ca2fPublished at
2024-06-20 16:20:03Event JSON
{
"id": "aa1a5dddeebce02188ee2431edb1c67753b9930cd1bf040d39592a8a514e585b",
"pubkey": "ac719f94af757ae8297ad38a9398df1c688e4c86969754b16fa2ce337dd96c3e",
"created_at": 1718900403,
"kind": 1,
"tags": [
[
"p",
"8c72fb5d06a6a4442d62df9f481ff1f791e928589f247cf8932aaf42e0b6cdf2"
],
[
"e",
"260b5992e3ddef867fd9b81d2b17e35057c052a7a305c17a7d4f7b100f0c962d",
"",
"root"
],
[
"p",
"ceee9d7e6705946321b940eb4ec4db738c18362d2ac26d89c9eaaf9269c7fe0b"
],
[
"p",
"9514f8f344dd309396ef36ea9ce44633165c2752c35cb9c52c0144ea8e14a8c0"
],
[
"e",
"74bb0c9e61141caa23f6b3c410cf4afd6204cccd83add272369577400f6eeb78",
"",
"reply"
],
[
"proxy",
"https://mstdn.social/@mattwilcox/112649856860983422",
"web"
],
[
"proxy",
"https://mstdn.social/users/mattwilcox/statuses/112649856860983422",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mstdn.social/users/mattwilcox/statuses/112649856860983422",
"pink.momostr"
]
],
"content": "The problem is that LLMs are an untrustworthy-data-generator, not just data retreval. In the past *humans* wrote things, and most of the time those humans actually checked things before writing them. It was their job. The search just brought source material to you.\n\nLLMs will generate 1000 made up ones at the drop of a hat.\n\nIt's the *saturation* that's the danger. Especially when they feed on thier own output. It becomes ever less trustworthy.\n\nnostr:npub1emhf6ln8qk2xxgdegr45a3xmwwxpsd3d9tpxmzwfa2hey6w8lc9sqlq9c5 nostr:npub133e0khgx56jygttzm705s8l377g7j2zcnuj8e7yn92h59c9keheqe6rqrd",
"sig": "03c6fab6109a8eb0c740f6bd49bf7e42951341a78def89d246e2080a6422ad1139d24f2d4823b1ac882c52c574b33d06d1119633e24e41ea7a6094b34a2089e1"
}