Claudius on Nostr: I will not call a pre-trained #LLM / #AI model that you can run on your own machine ...
I will not call a pre-trained #LLM / #AI model that you can run on your own machine an "open source" model. It's simply the wrong term.
You effectively download a binary blob. You don't get any of the sources. You can't see how the sausage was made. You can't modify it (yes, I know about LoRA, not what I mean). You can't meaningfully learn how it was made. "open source" as a term sets a pretty low bar, and these models don't even clear that.
I will die on this hill.
Published at
2024-09-17 21:11:09Event JSON
{
"id": "707e42fe1a1b76159aca05e0601614549402b8593597217dec18809f774143ed",
"pubkey": "9c38f25d19ae020f9a4b2b37f183c32596139de04310f9cf438f92b2ad8bd511",
"created_at": 1726607469,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"llm"
],
[
"proxy",
"https://darmstadt.social/users/claudius/statuses/113154947088994696",
"activitypub"
]
],
"content": "I will not call a pre-trained #LLM / #AI model that you can run on your own machine an \"open source\" model. It's simply the wrong term.\n\nYou effectively download a binary blob. You don't get any of the sources. You can't see how the sausage was made. You can't modify it (yes, I know about LoRA, not what I mean). You can't meaningfully learn how it was made. \"open source\" as a term sets a pretty low bar, and these models don't even clear that.\n\nI will die on this hill.",
"sig": "4ef1a640745f22862a97f6690330979b01147603514f5f8e2a6f09d7491f9aaa159023cb06f21c29d1118e87c16a6493c4935a350c94ec15a8c6b0f90f0b7cd2"
}