S!ayer on Nostr: This has been informative. Thanks all for the suggestions. Time to deep dive. ...
This has been informative. Thanks all for the suggestions. Time to deep dive.
what's the best LLM to run from your local machine without the need for a heavy GPU?
Llama et al. all seem to require a chucky GPU, but surely we're at the stage (3 years later) that we have some local LLMs?
Published at
2024-09-16 12:09:11Event JSON
{
"id": "d2dcf801f8f0ade56f065145ea372aa2695ad6a9ff67459fb4b223eedaaf9b3f",
"pubkey": "cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92",
"created_at": 1726488551,
"kind": 1,
"tags": [
[
"e",
"3ace45519383b4c02a690755dce5a353c9ba8c46bdf602645304e0a44cfe7c66",
"wss://offchain.pub/",
"mention"
],
[
"p",
"cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92",
"wss://relay.damus.io/",
"mention"
]
],
"content": "This has been informative. Thanks all for the suggestions. Time to deep dive.\nnostr:nevent1qvzqqqqqqypzpn0vcvwxm9qxaxnadvqxwsf25esan5cusq6u8lt9cp3sr5w2cwujqyfhwumn8ghj7mmxve3ksctfdch8qatz9uq3wamnwvaz7tmjv4kxz7fwdehhxarj9e3xzmny9uqzqwkwg4ge8qa5cq4xjp64mnj6x57fh2xyd00kqfj9xp8q53x0ulrxcm9vkn",
"sig": "8653592594f3f737d066f16106be2fea3aa6d36474706545179162e6d58b736c1f00c7e7122592aeef9b715fd8244e669fe1c16214aa9091a86f319e50f5bc63"
}
