How it started:
I setup #ollama on a $250 old mini pc, downloaded a few models, installed openweb-ui, gave a few friends access to it.
How it's going:
The PC is running 100% like 14 hours a day with friends and family of friends using it. Some have cancelled their paid accounts to use this instead.
I maxed out the ram at 64 GB to keep more models in ram based in usage patterns.
I'm now hosting ollama as a service. People pitched in to pay for the ram and power without me asking.
Responses aren't instant because no usable GPU (AMD 680M) but no one seems to care.
#Privacy > speed.
deimos
npub184…9ye7p
2025-01-31 08:02:13
Author Public Key
npub184yglnjrksaxc09k94tajhveaz3hzzhtqxzeyc4ckrkmmg4tttzsj9ye7pPublished at
2025-01-31 08:02:13Event JSON
{
"id": "44a55e3ce5ff1f89557bc0212b4c859ee6759424d72245e4a924fd6c78dba7f5",
"pubkey": "3d488fce43b43a6c3cb62d57d95d99e8a3710aeb01859262b8b0edbda2ab5ac5",
"created_at": 1738310533,
"kind": 1,
"tags": [
[
"t",
"ollama"
],
[
"t",
"Privacy"
],
[
"t",
"privacy"
]
],
"content": "How it started: \n\n I setup #ollama on a $250 old mini pc, downloaded a few models, installed openweb-ui, gave a few friends access to it. \n\nHow it's going:\n\nThe PC is running 100% like 14 hours a day with friends and family of friends using it. Some have cancelled their paid accounts to use this instead. \n\nI maxed out the ram at 64 GB to keep more models in ram based in usage patterns. \n\nI'm now hosting ollama as a service. People pitched in to pay for the ram and power without me asking. \n\nResponses aren't instant because no usable GPU (AMD 680M) but no one seems to care.\n\n#Privacy \u003e speed. ",
"sig": "14b51af233700943b9dfe9223369f5a329c92b515f5348ed44cffdefdf86c41051e7fe7f333183074d9e0a4570190f7f2f801215f74a51b0aafacf2c02a9ef23"
}