adam.nowotny on Nostr: Just published Simplify setting up your private distributed infrastructure using ...

Just published https://github.com/QC-Labs/orange-lab
Simplify setting up your private distributed infrastructure using Tailscale (nprofile…fmf8), Pulumi, K3s and Longhorn.
The cluster works even on a single laptop node but it's a great way to use spare CPU cycles and storage on other Linux machines you have available.

Once initial setup is done, you can run Ollama, Open-WebUI and stable diffusion image generation with:

pulumi config set orangelab:nvidia-gpu-operator true
pulumi config set orangelab:ollama true
pulumi config set orangelab:open-webui true
pulumi config set orangelab:automatic1111 true
pulumi up

This will create endpoints that anyone on your Tailnet can access, all wired up and ready to go.