Max Hillebrand on Nostr: Running Vicuna chat bot on my Qubes laptop with only a CPU. It works!! But incredibly ...
Running Vicuna chat bot on my Qubes laptop with only a CPU.
It works!!
But incredibly slow, about one minute per token.
https://vicuna.lmsys.org/Published at
2023-04-05 07:32:54Event JSON
{
"id": "f2c4db741da687ffde478584390f1f7ada57a7aa1e0242dd3a959af4f5d4492d",
"pubkey": "b7ed68b062de6b4a12e51fd5285c1e1e0ed0e5128cda93ab11b4150b55ed32fc",
"created_at": 1680679974,
"kind": 1,
"tags": [
[
"r",
"https://vicuna.lmsys.org/"
]
],
"content": "Running Vicuna chat bot on my Qubes laptop with only a CPU.\n\nIt works!! \nBut incredibly slow, about one minute per token. \n\nhttps://vicuna.lmsys.org/",
"sig": "867f5651cb4ce5cfdfc278673d8f3d664c5932a9efdc2f5a632ef98999cf148cb8c0d9622de825aa9d9af7182416556d8406ed65599501f7d3531ceebb771c49"
}
