brian on Nostr: A tutorial from @OpenAI on how to build a question-answering system on your custom ...
A tutorial from @OpenAI on how to build a question-answering system on your custom website
Preprocess:
1. Website -> text (Scraping)
2. Text -> chunks -> embed
Inference:
1. Question -> embed
2. Get topK similar chunks
3. Answer generation using 1 & 2
https://platform.openai.com/docs/tutorials/web-qa-embeddingsPublished at
2023-02-05 16:03:06Event JSON
{
"id": "222747f454e824a034cfd9e2c95f8cb47cd236d0bcf0440dbae17c7477d2e9b6",
"pubkey": "a4cfed1c3f67fb5076ac94237164caf2484123433330f07d3cd6385d894e1346",
"created_at": 1675612986,
"kind": 1,
"tags": [],
"content": "A tutorial from @OpenAI on how to build a question-answering system on your custom website\n\nPreprocess:\n1. Website -\u003e text (Scraping)\n2. Text -\u003e chunks -\u003e embed\n\nInference:\n1. Question -\u003e embed\n2. Get topK similar chunks \n3. Answer generation using 1 \u0026 2\n\nhttps://platform.openai.com/docs/tutorials/web-qa-embeddings",
"sig": "4393f6cdc2ac556b96e869b52ddfe9fe0ef8f390cfdc3869ad983c69a19a6fb0ddaf58ddc97c64915506b612c9f5f58e68f77e6808bce898557343cd02bdd530"
}