Peter Krupa on Nostr: especially as GPUs become a standard part of a cloud stack, it will be pretty easy to ...
especially as GPUs become a standard part of a cloud stack, it will be pretty easy to add an in-house LLM service. I’m less bullish on RAG (“chat with your documents!!”) it seems very difficult to make it actually useful.
Published at
2024-11-22 08:26:40Event JSON
{
"id": "a626ff64ba8579b7862359983f2fde3ac41ad1c60ad6ff554ecadf0b4d722d7f",
"pubkey": "358b313c445eccc8485ec27702158b45fa6b768ba7a1bcb99c829ebdc979f27f",
"created_at": 1732264000,
"kind": 1,
"tags": [
[
"e",
"2b8f307b4a95861f7ff50a444a4032ca16c4cb988effe3f832a27b1cd6be088e",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://thepit.social/users/peter/statuses/113525653505634117",
"activitypub"
]
],
"content": "especially as GPUs become a standard part of a cloud stack, it will be pretty easy to add an in-house LLM service. I’m less bullish on RAG (“chat with your documents!!”) it seems very difficult to make it actually useful.",
"sig": "947822f6a75fca563f61dcd826e8106b372f7fef88b4d44f616fcda5a12db267d610cfce5ea7d98dfd5e35ac0aedfe81536bc5705b03f2ae2571bec314e1a96a"
}
