Introducing LlamaGPT — a self-hosted, offline and private AI chatbot, powered by Llama 2, with absolutely no data leaving your device. 🔐
Yes, an entire LLM. ✨
Your Umbrel Home, Raspberry Pi (8GB) Umbrel, or custom umbrelOS server can run it with just 5GB of RAM!
Word generation benchmarks:
Umbrel Home: ~3 words/sec
Raspberry Pi (8GB RAM): ~1 word/sec
→ Watch the demo: https://youtu.be/iu3_1a8SzeA
→ Install on umbrelOS: https://apps.umbrel.com/app/llama-gpt
→ GitHub: https://github.com/getumbrel/llama-gpt
umbrel / Umbrel ☂️
npub1ag…lmhct
2023-08-16 14:43:11
Author Public Key
npub1aghreq2dpz3h3799hrawev5gf5zc2kt4ch9ykhp9utt0jd3gdu2qtlmhctPublished at
2023-08-16 14:43:11Event JSON
{
"id": "c3c8604e7b9073eac9f6e161bf4ec8b963297f6d901ac5fe4223d44a1c3d2d3a",
"pubkey": "ea2e3c814d08a378f8a5b8faecb2884d05855975c5ca4b5c25e2d6f936286f14",
"created_at": 1692196991,
"kind": 1,
"tags": [],
"content": "Introducing LlamaGPT — a self-hosted, offline and private AI chatbot, powered by Llama 2, with absolutely no data leaving your device. 🔐\n\nYes, an entire LLM. ✨\n\nYour Umbrel Home, Raspberry Pi (8GB) Umbrel, or custom umbrelOS server can run it with just 5GB of RAM!\n\nWord generation benchmarks:\n\nUmbrel Home: ~3 words/sec\nRaspberry Pi (8GB RAM): ~1 word/sec\n\n→ Watch the demo: https://youtu.be/iu3_1a8SzeA \n\n→ Install on umbrelOS: https://apps.umbrel.com/app/llama-gpt\n\n→ GitHub: https://github.com/getumbrel/llama-gpt",
"sig": "a0d531ffea68a2c951a556e316e6b99ba80c451082a1bbe5c66207488649cdbaf08ff8d856bd6d679cfdd7e67f6aa43dee26149a883a1404fa68178b61067de5"
}