Just don't expect miracles if the model you choose doesn't fit in vram. I thought I was building for the future with my current rig, but then local AI became a thing and it is obsolete even while the market still has no replacement.
Even the best "consumer" cards are only 32GB. We demand 200GB!!
On the CPU side you can get to 192GB but it is slow. If you want fast you are limited to 64GB.
Need to make a fortune in some multi-level marketing scheme so I can get a Treadripper pro or an Epyc.
Daniel Wigton
npub1w4…q30zp
2025-05-24 17:33:29
in reply to nevent1q…s2fh
Author Public Key
npub1w4jkwspqn9svwnlrw0nfg0u2yx4cj6yfmp53ya4xp7r24k7gly4qaq30zpPublished at
2025-05-24 17:33:29Event JSON
{
"id": "745bb08bd0b6f420651c267815f4120997e4ca44b07c235a83b5ef6fe979e204",
"pubkey": "75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a",
"created_at": 1748108009,
"kind": 1,
"tags": [
[
"e",
"d090889dfc19e313ca6d93f90197e1095105ea76fa4c8235e7cb8597f9953694",
"",
"root"
],
[
"e",
"4e66d29cd02d9b6710d0a2ff90e07b1db6d30ff8d74a9430fc434dd0667f3e87"
],
[
"e",
"4d5486e4af30c335d833267173b128d663a4dc961131571d148f0c3cc0c06478",
"",
"reply"
],
[
"p",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"p",
"75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a"
]
],
"content": "Just don't expect miracles if the model you choose doesn't fit in vram. I thought I was building for the future with my current rig, but then local AI became a thing and it is obsolete even while the market still has no replacement.\n\nEven the best \"consumer\" cards are only 32GB. We demand 200GB!!\n\nOn the CPU side you can get to 192GB but it is slow. If you want fast you are limited to 64GB.\n\nNeed to make a fortune in some multi-level marketing scheme so I can get a Treadripper pro or an Epyc.",
"sig": "dcffc48f17aeef0eaa4a91fe8ec8a19b15b915743c5e528c33267fe6ab5c21b068482ff1022c601976665a46616167398d1d77d4520aab750de1fc9803e284cf"
}