Different LLM models recommend different amounts. The ~4GB models want the OS to have ~8GB RAM. The largest models (~40GB) recommend 32GB RAM.
I ordered 64GB which should be arriving today. I figure that should be enough for now. It’s also the max my 2018 era desktop can handle.
jimbocoin / jimbocoin 🃏
npub1v9…x9q3h
2024-06-26 14:10:05
in reply to nevent1q…43xc
Author Public Key
npub1v9qy0ry6uyh36z65pe790qrxfye84ydsgzc877armmwr2l9tpkjsdx9q3hPublished at
2024-06-26 14:10:05Event JSON
{
"id": "ab90d2986b143fe3873c018383995ced40ca214155d8480c50b02b94e6a79858",
"pubkey": "6140478c9ae12f1d0b540e7c57806649327a91b040b07f7ba3dedc357cab0da5",
"created_at": 1719411005,
"kind": 1,
"tags": [
[
"e",
"776cbbbbd791dbe6d57a04a6c607074d4775e7c985f9a2aa8a6846b8fb700bec",
"",
"root"
],
[
"e",
"5a0d7986b021913010780d1f8a203b64460c47df39175db7c59da3283fcfd81e",
"",
"reply"
],
[
"p",
"2b2c779db75f6363fbad7567dec2726d36aba05893b714001e0563cabef84f56"
]
],
"content": "Different LLM models recommend different amounts. The ~4GB models want the OS to have ~8GB RAM. The largest models (~40GB) recommend 32GB RAM.\n\nI ordered 64GB which should be arriving today. I figure that should be enough for now. It’s also the max my 2018 era desktop can handle.",
"sig": "9b6ecceae0b60e5a948a7907fa7716eb9b09939233d50bbbf446869a83017c72b7f48f937be204f87cb5751a869e0206f7760f2257e61cbc7de015f73fb1dc7f"
}