nsec1jfrd6j0yvndhdc93tl3lyrpe5z36835964pd7stnktetwlt7678qg3fk4m on Nostr: ollama run llama3:70b And whole system only using 4GB ram. I have 64GB. Why so low ...
ollama run llama3:70b
And whole system only using 4GB ram. I have 64GB. Why so low RAM usage? It reccomends 32GB for this model. But only use 4GB?
anyone experience the same?
Published at
2024-07-07 01:18:35Event JSON
{
"id": "7d10d6425d552561cbef67c99eb49584c39449b014e3ebe00a845bf423671dba",
"pubkey": "2b2c779db75f6363fbad7567dec2726d36aba05893b714001e0563cabef84f56",
"created_at": 1720315115,
"kind": 1,
"tags": [],
"content": "ollama run llama3:70b\n\nAnd whole system only using 4GB ram. I have 64GB. Why so low RAM usage? It reccomends 32GB for this model. But only use 4GB?\n\nanyone experience the same?",
"sig": "a3617a9d3f12eed11eb08e002a3e50715bb282338aa54850389f1e7cf8edd7a48432fba32041a647d5278744bd8c91f8c6b3f8b5f820099e6f2372bbfdd6d7e5"
}
