AI-Homelab up and running.
Using Proxmox on the Zimaboard with Ubuntu-Server, Ollama, Open WebUI and LiteLLM.
To be honest, the server is not powerful enough to run relevant models on its bare metal but the API connections to OpenAI, Claude etc. are working flawlessly.
#Linux #AI #Homelab
»ƑŗǡǹǩƁĮǡċǩ⁷⁸« /
npub1gn…5yngp
2025-03-23 15:29:23
Author Public Key
npub1gnedyy6uwsr6a5z9rux997as60wzz9xmpnm5n5k0pcscm0s6ccss25yngpSeen on
wss://relay.nostr.bandPublished at
2025-03-23 15:29:23Event JSON
{
"id": "ff8f231e446853b6d408e1df4994295a79c1bf1305dca574588b52e58b5cc13c",
"pubkey": "44f2d2135c7407aed0451f0c52fbb0d3dc2114db0cf749d2cf0e218dbe1ac621",
"created_at": 1742743763,
"kind": 1,
"tags": [
[
"t",
"linux"
],
[
"t",
"ai"
],
[
"t",
"homelab"
],
[
"proxy",
"https://social.tchncs.de/users/FrankBlack78/statuses/114212455260127223",
"activitypub"
]
],
"content": "AI-Homelab up and running. \n\nUsing Proxmox on the Zimaboard with Ubuntu-Server, Ollama, Open WebUI and LiteLLM.\n\nTo be honest, the server is not powerful enough to run relevant models on its bare metal but the API connections to OpenAI, Claude etc. are working flawlessly.\n\n#Linux #AI #Homelab",
"sig": "f2d02aa0c67d2d98e767a689472df76692c6864a3097891353d8f6b5f88164598d25b9769bb4e63886c330908a814dfe23c815790900413a8f4c1427d38219e8"
}