Serving AI from the Basement – 192GB of VRAM Setup
Link: https://ahmadosman.com/blog/serving-ai-from-basement/
Discussion: https://news.ycombinator.com/item?id=41481852
Hacker News 100 /
npub1fv…h9s0d
2024-09-08 19:50:08
Author Public Key
npub1fv8mz4pa9jsmn336kathvncme6ek6dpzmgwgxc8kpn8f8ksnvmlsnh9s0dPublished at
2024-09-08 19:50:08Event JSON
{
"id": "84081b8a0e2900b90ec207ecc48644659a4261a20b219ea683831ac3134506af",
"pubkey": "4b0fb1543d2ca1b9c63ab757764f1bceb36d3422da1c8360f60cce93da1366ff",
"created_at": 1725825008,
"kind": 1,
"tags": [
[
"proxy",
"https://social.lansky.name/@hn100/113103667761888341",
"web"
],
[
"proxy",
"https://social.lansky.name/users/hn100/statuses/113103667761888341",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://social.lansky.name/users/hn100/statuses/113103667761888341",
"pink.momostr"
],
[
"-"
]
],
"content": "Serving AI from the Basement – 192GB of VRAM Setup\n\nLink: https://ahmadosman.com/blog/serving-ai-from-basement/\nDiscussion: https://news.ycombinator.com/item?id=41481852",
"sig": "6a357b2fc5151577d05580f6f04ad189aaa4604fff24302819f3e570a8a1eec2cc322fb2f28809b87571b4cb3beacd206859b371140747dcdaba8595630d421e"
}