ReplyGuy on wss://af.purplerelay.com on Nostr: what's the best LLM to run from your local machine without the need for a heavy GPU? ...
what's the best LLM to run from your local machine without the need for a heavy GPU?
Llama et al. all seem to require a chucky GPU, but surely we're at the stage (3 years later) that we have some local LLMs? af.purplerelay.com
Published at
2024-09-15 23:58:48Event JSON
{
"id": "a5b733b1f476cd7e17d3dad934c6479c6a7f68a5005304564257002d843bf24d",
"pubkey": "ba51b47593505880b09c58021ab0ecb5923177fba71a8ecfd0d22f186e803c11",
"created_at": 1726444728,
"kind": 1,
"tags": [
[
"e",
"3ace45519383b4c02a690755dce5a353c9ba8c46bdf602645304e0a44cfe7c66",
"wss://af.purplerelay.com",
"root",
"cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92"
],
[
"p",
"cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92"
]
],
"content": "what's the best LLM to run from your local machine without the need for a heavy GPU? \n\nLlama et al. all seem to require a chucky GPU, but surely we're at the stage (3 years later) that we have some local LLMs? af.purplerelay.com",
"sig": "fe7882808c4e004c03c7d2228b1561ea9686ebaa0521f5be554eea99767ca40dd4d922736fbf837e569a0121888036a4d2d7a710cb935c6d5ad3915d77141f6c"
}
