What's RAG actually?
It's just strapping a fancy full text search (or vector search or whatever you have handy) in front of your chatbot or whatever and, get this… PASTING THE SEARCH RESULT AS PLAINTEXT INTO THE PROMPT.
The moment I understood that I realized how absolutely hilariously bad (from an engineering standpoint) that whole GPT mess is.
rash /
npub19h…ey4pt
2023-12-21 16:46:48
in reply to nevent1q…m6ds
Author Public Key
npub19hdp8fz3ncm0lefk4y5r3s4eh5sfk4alnp5wc58vfxlgd0ykd3xqxey4ptSeen on
wss://relay.noswhere.comPublished at
2023-12-21 16:46:48Event JSON
{
"id": "b1bd4e8e677eb08ed22f5154244f9fdb0c47aeecc256e8a1a387cc16f4be5e8e",
"pubkey": "2dda13a4519e36ffe536a92838c2b9bd209b57bf9868ec50ec49be86bc966c4c",
"created_at": 1703177208,
"kind": 1,
"tags": [
[
"e",
"58420d49df5f7b5ad7bcf6bd79269f36a4f9a77040cde5c2a6346c492a52884a",
"wss://relay.mostr.pub",
"reply"
],
[
"content-warning",
"GPT/LLM rant"
],
[
"proxy",
"https://chaos.social/users/rash/statuses/111619421519277006",
"activitypub"
]
],
"content": "What's RAG actually?\nIt's just strapping a fancy full text search (or vector search or whatever you have handy) in front of your chatbot or whatever and, get this… PASTING THE SEARCH RESULT AS PLAINTEXT INTO THE PROMPT.\n\nThe moment I understood that I realized how absolutely hilariously bad (from an engineering standpoint) that whole GPT mess is.",
"sig": "c8edc91edf93952e7be44d546d92bce7f548203abc2314d3f6c861800764e561ba1f4514316f25e1112d02d4eeb3a4110402f3b7a13de991fb94360962b22df9"
}