plusultra on Nostr: PyTorch, but thats only required if you want to fine-tune models. You don't need to ...

PyTorch, but thats only required if you want to fine-tune models.

You don't need to have any programming skills. Just how to copy and paste commands from guides into a terminal.

Read and follow the docs on Ollama and OpenWebUI GitHub repos, and you'll have your own personal, and private, AI models, with a chatGPT-like interface.

There's endless cool, customised (post trained) models on HuggingFace to choose from. I personally like the uncensored ones and the coding optimized ones.

You will, however, need a GPU with a decent amount of VRAM. the newer Apple M chips can also run pretty decent models. Even 7B parameter models are impressively good.