An important thought that seems to elude the AI galaxy brains like billg who want to replace professionals with LLMs is: how are new phenomena identified and dealt with, given that LLMs are trained only on PRE-EXISTING data?
For example: how would a hypothetical LLM physician have identified a case of COVID19 back in February 2020? (Hint: it'd have diagnosed it as something else—wrongly—every time! Because not in the training data.)
Charlie Stross /
npub1ya…gla7e
2025-03-28 16:28:46
Author Public Key
npub1yacj26q9parem5fqf2s3ym9xkxghkk0w2jc63aglsnl2fmyhshnszgla7eSeen on
wss://relay.mostr.pubPublished at
2025-03-28 16:28:46Event JSON
{
"id": "2d05e74cc3b581a9a23604e1d3c17d09c61b2a3f62ca8d9fa873dc37e2e19cb3",
"pubkey": "27712568050f479dd1204aa1126ca6b1917b59ee54b1a8f51f84fea4ec9785e7",
"created_at": 1743179326,
"kind": 1,
"tags": [
[
"proxy",
"https://wandering.shop/users/cstross/statuses/114241000310769700",
"activitypub"
]
],
"content": "An important thought that seems to elude the AI galaxy brains like billg who want to replace professionals with LLMs is: how are new phenomena identified and dealt with, given that LLMs are trained only on PRE-EXISTING data? \n\nFor example: how would a hypothetical LLM physician have identified a case of COVID19 back in February 2020? (Hint: it'd have diagnosed it as something else—wrongly—every time! Because not in the training data.)",
"sig": "15f48fd7bab1aec2f22eb06e813f95180ecacbd0e25b76a7344b784452c05a21193c8d4c2f27bafee31f1d7b64990bcd25e936704a455a8e724d9744997ff94b"
}