ragle on Nostr: Can a #SteamDeck be used to run a local #LLM, in a clear misuse of the tech? Yes. ...

Can a #SteamDeck be used to run a local #LLM, in a clear misuse of the tech? Yes. Yes, it can. Actually not bad, if I was in a bind and had only this little computer to use. As models get more distilled and efficient, more and more tiny or older devices could find a second life as mini-servers.