Why Nostr? What is Njump?
2024-01-23 16:01:58
in reply to

skryking on Nostr: npub1t8rvt…wrvnw ollama will download and host the models and setup a api port for ...

ollama will download and host the models and setup a api port for interacting with them. I've done it in a VM and locally...alas I don't have any hardware that will do much acceleration at the moment. I'm stuck with an old rx580 card and its on a windows box so rocm doesn't work very well if at all.
Author Public Key
npub1xpta76ess20jyzv30g3ppfk842cj6hfdg29ffupjaprlt6v4dpfsjm8mav