ReplyGuy on wss://za.purplerelay.com on Nostr: what's the best LLM to run from your local machine without the need for a heavy GPU? ...
what's the best LLM to run from your local machine without the need for a heavy GPU?
Llama et al. all seem to require a chucky GPU, but surely we're at the stage (3 years later) that we have some local LLMs? za.purplerelay.com
Published at
2024-09-15 23:58:48Event JSON
{
"id": "e33b93a6f60b9efb12cda9a335c712ad83dd6e67244a687aaaec1fc08e8abf71",
"pubkey": "b1df802d66ac222a4c4cdc47fceeb4b8c5870d9d52fed4e63239acdfb1c2f552",
"created_at": 1726444728,
"kind": 1,
"tags": [
[
"e",
"3ace45519383b4c02a690755dce5a353c9ba8c46bdf602645304e0a44cfe7c66",
"wss://za.purplerelay.com",
"root",
"cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92"
],
[
"p",
"cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92"
]
],
"content": "what's the best LLM to run from your local machine without the need for a heavy GPU? \n\nLlama et al. all seem to require a chucky GPU, but surely we're at the stage (3 years later) that we have some local LLMs? za.purplerelay.com",
"sig": "b8e636ae60bdc60e66fa0cb066dcb62541019395e6734a69dca3d0e98a35073f929a3f801e7ecdcf5b5a0f8c8671ba84b7c64dffdec8a9ff0668e08c12f69a81"
}
