#LLM #explainer fans, an ask:
Following a PD at our company gathering, people have been asking me all sorts of questions about how LLMs work. At this point, they get that it's the Shannon Game at obscene scale, with each word just being an educated guess based on priors.
But several have said to me some version of, "I can believe the computer guessing words at the sentence level. But I can't scale that up to accepting that it's not reasoning."
How best to help them square the circle?
Adam Labay /
npub1a0…mmx90
2025-02-25 03:11:03
Author Public Key
npub1a0gdexuksrz5l2l3n6rg8xeg5rcuqghxcazfzlan6xf0egh778ls0mmx90Seen on
wss://relay.nostr.bandPublished at
2025-02-25 03:11:03Event JSON
{
"id": "ee9ebc354d5315ec62431b02452999a9f72d83a06087365dc65d1b9064f5c1cf",
"pubkey": "ebd0dc9b9680c54fabf19e86839b28a0f1c022e6c744917fb3d192fca2fef1ff",
"created_at": 1740453063,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"explainer"
],
[
"proxy",
"https://fosstodon.org/users/Labay/statuses/114062331996108539",
"activitypub"
]
],
"content": "#LLM #explainer fans, an ask:\nFollowing a PD at our company gathering, people have been asking me all sorts of questions about how LLMs work. At this point, they get that it's the Shannon Game at obscene scale, with each word just being an educated guess based on priors.\nBut several have said to me some version of, \"I can believe the computer guessing words at the sentence level. But I can't scale that up to accepting that it's not reasoning.\"\nHow best to help them square the circle?",
"sig": "e651963c98a9534a35caf803d7b17f9577ec8f4da0ccf64b9d1108ef0f7274abc7a8ef107e8d29cb962cc14e6c9a87ca9fc7cc7e5b732f99cc3038bf6f17a94d"
}