Yes. They don't think. They are probability clouds. Mapping probability of words in a context to next words in the same context. They are probabilistic machines but since their output is very probable, meaning that next word having very high probability to be chosen, they "make sense". Does that make sense?
As weird as this sounds, certain sequencing of words mimic an intelligent response when it is put into action especially if the model has high number of parameters like 70 billion+. I am seeing 7B+ have no judgement capabilities at all. But 70B models can "appear to judge" 7B models or other models.
All this is an experiment and trying to have fun. But it may turn out to be something really great too. I have some ideas.
someone /
npub1nl…hjm9c
2024-04-16 20:29:36
in reply to nevent1q…asyn
Author Public Key
npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9cPublished at
2024-04-16 20:29:36Event JSON
{
"id": "a4767ed4406083164f228b6cb68d5d3d8434bcd5d34a897e8cbb24fec2ed4840",
"pubkey": "9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"created_at": 1713299376,
"kind": 1,
"tags": [
[
"e",
"078f5f9f33ae60daacd8bce4b0319f2305c93f2d80bd7139efde724cc9d47af6",
"wss://me.purplerelay.com",
"root"
],
[
"e",
"2b43d1743e1204abe4668ade2f004310bb286d5ef3e1bff3f608d403f94e0bc1",
"wss://me.purplerelay.com",
"reply"
],
[
"p",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"",
"mention"
],
[
"p",
"aa902c06496dd51e22521ed77aa9f8b1edcaab329b439990e369411f6b490e71"
]
],
"content": "Yes. They don't think. They are probability clouds. Mapping probability of words in a context to next words in the same context. They are probabilistic machines but since their output is very probable, meaning that next word having very high probability to be chosen, they \"make sense\". Does that make sense?\n\nAs weird as this sounds, certain sequencing of words mimic an intelligent response when it is put into action especially if the model has high number of parameters like 70 billion+. I am seeing 7B+ have no judgement capabilities at all. But 70B models can \"appear to judge\" 7B models or other models.\n\nAll this is an experiment and trying to have fun. But it may turn out to be something really great too. I have some ideas.",
"sig": "27e651df1696717e4bccc412525b7b715ff0a8902bd7d90c573d73c4371cd6d94428fcc81f9bcf3369f51d9a6fa2aadb9ee3b9005a149323124724b15aca1612"
}