kpr797 on Nostr: How much video RAM is needed to run a version of the models that are actually smart ...
How much video RAM is needed to run a version of the models that are actually smart though? I tried the Deepseek model that fits within 8 GB of video RAM, and it was basically unusable.
Published at
2025-04-30 09:10:37Event JSON
{
"id": "66ec6494a99bc7780de6476b9184f43926750cbd3a1a51467182dbfe283cd415",
"pubkey": "ec003d5ee5101019f1bb8c586e9654adba913efc16f02051c39758694f70becd",
"created_at": 1746004237,
"kind": 1,
"tags": [
[
"e",
"c72906b22ab684c7c1e01a359fdc5ab0a3b613bb0cfc24da3db06f8742c90395",
"",
"root"
],
[
"e",
"01ab63c08cc97bd4f7c35a583ae9426ddb91dcab329b2ea27709a822a79f81a7"
],
[
"e",
"ba351f3fca12e66657f08bc3715828c70cc056c982f10581643599c3bdc59b81",
"",
"reply"
],
[
"p",
"82341f882b6eabcd2ba7f1ef90aad961cf074af15b9ef44a09f9d2a8fbfbe6a2"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "How much video RAM is needed to run a version of the models that are actually smart though? I tried the Deepseek model that fits within 8 GB of video RAM, and it was basically unusable. ",
"sig": "4191499bdab545826638a322e1f45ad7847a1a09da210786d5f130984a31d36782af44f48664d36162013a6d84cb240b6abdd6fa60fd04d75365c7a20b9fb5c2"
}