$3000 and can run 200B models? Not bad compared to $30000 for an H100. If all you care about is running the latest, biggest LLMs locally then it's the cheapest option by far. Otherwise you're looking at a Mac Studio.
If it runs on plain old Linux (with the gay Nvidia drivers of course) then that's even better than Digits, which uses DGX OS.
If only there was a truly neutral, uncensored LLM released to the wild. The possibilities would be endless.
vic /
npub1cl…safsd
2025-03-20 18:46:46
in reply to nevent1q…e5dh
Author Public Key
npub1clamz5n660wpqgsudxf5hs08unqcm4trvmwlsahtpshpxa63x72q2safsdPublished at
2025-03-20 18:46:46Event JSON
{
"id": "8b3ebd97815f664140531f291455a9a70dbc3ad006f1e5308b03e97a2684912b",
"pubkey": "c7fbb1527ad3dc10221c69934bc1e7e4c18dd56366ddf876eb0c2e1377513794",
"created_at": 1742496406,
"kind": 1,
"tags": [
[
"p",
"61459a9f63732a38155ded17c82b6bc5e0761ec9994c945e56eb7e9ebe0ee2fe",
"wss://relay.mostr.pub"
],
[
"e",
"9db5359a7321ff2f257600d32493facc3137aeec87681b8af58cc37785d9e758",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://shitpost.cloud/objects/16bee443-f3a9-427a-b10a-64173b569655",
"activitypub"
]
],
"content": "$3000 and can run 200B models? Not bad compared to $30000 for an H100. If all you care about is running the latest, biggest LLMs locally then it's the cheapest option by far. Otherwise you're looking at a Mac Studio.\n\nIf it runs on plain old Linux (with the gay Nvidia drivers of course) then that's even better than Digits, which uses DGX OS.\n\nIf only there was a truly neutral, uncensored LLM released to the wild. The possibilities would be endless.",
"sig": "36d6b4d0aaad582a1ce3d1e5c7a1b59dd89198f2993d1b35c7ea471e2ec45ae8c8666f239211ca4c2a382c81ab7727f2dd9bc807ee5cb0e4b896014dac39edd6"
}