TKay and the 40 thieves on Nostr: I want to run a local LLM. I have a good-ish computer with a new GPU. What do you ...
I want to run a local LLM.
I have a good-ish computer with a new GPU.
What do you suggest is my best option here?
#asknostr
Published at
2025-06-13 01:34:05Event JSON
{
"id": "69c7d50e060be687684f5edbe8f5e44b8453c645efcb98f5608558faf6fcf4fa",
"pubkey": "9cb3545c36940d9a2ef86d50d5c7a8fab90310cc898c4344bcfc4c822ff47bca",
"created_at": 1749778445,
"kind": 1,
"tags": [
[
"t",
"asknostr"
]
],
"content": "I want to run a local LLM.\nI have a good-ish computer with a new GPU. \n\nWhat do you suggest is my best option here? \n\n#asknostr",
"sig": "5219e6552df0c3b3f5c19803d9d7772b32276b401782c2943dcd704f6db95fe3140466392fcb75b6be82dc79487d29839ff212bf9e98ea988e2186373a5d12d5"
}
