jb55 on Nostr: another cool thing is if you're using ollama locally on your macbook on a plane, and ...
another cool thing is if you're using ollama locally on your macbook on a plane, and you have no wifi connection, this will still work.
Everything in notedeck is offline first. The question gets sent to the local model, the model then responds with a tool query ({query:cats, limit:3}),
notedeck parses this query, understands it, queries the local notedeck database, formats a response and send it back to the local ai.
the local ai then takes those formatted notes and replies with a summary.
this all happens back and forth locally on your computer.
how neat is that!?
still working on the response rendering, but was able to get dave working with my wireguard ollama instance (on a plane!)
private, local, nostr ai assistant.
Published at
2025-03-27 20:12:21Event JSON
{
"id": "f62223110355876595ff20d97a0ccb4ee705db01b4886dd8541457fcf5183d4e",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1743106341,
"kind": 1,
"tags": [
[
"q",
"1c7a38f06e9815efb70039c503b2548a66aae5a379058cac85b585b0137348cf"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "another cool thing is if you're using ollama locally on your macbook on a plane, and you have no wifi connection, this will still work.\n\nEverything in notedeck is offline first. The question gets sent to the local model, the model then responds with a tool query ({query:cats, limit:3}),\n\nnotedeck parses this query, understands it, queries the local notedeck database, formats a response and send it back to the local ai.\n\nthe local ai then takes those formatted notes and replies with a summary.\n\nthis all happens back and forth locally on your computer.\n\nhow neat is that!?\nnostr:note1r3ar3urwnq27ldcq88zs8vj53fn24edr0yzcety9kkzmqymnfr8s4ptchs",
"sig": "1ca5e90462aeaabe3018173b202fb4e314c22b2f122cdea662c1a02a7c605e389edf0d861f53d9aee6777c2c9000ce1eb7ae02a19d50fd0e32b277593469dc5d"
}