juraj on Nostr: I have a new micro-project. It allows to use venice.ai lifetime Pro account with ...
I have a new micro-project.
It allows to use venice.ai lifetime Pro account with local apps that communicate over the ollama API (open-webui, or continue.dev your VS Code IDE / JetBrains IDE).
Check out the demo video, it's quite nice.
I can also provide a pro account if you don't want to fiddle with MOR tokens.
I started doing this because llama-3.1-405b is really a great model (I think better than ChatGPT for many coding tasks), but I can't run it locally on my laptop.
With this, I have everything set up to make it work locally, with the best open-source model available today.
https://pay.cypherpunk.today/apps/26zEBNn6FGAkzvVVuDMz3SXrKJLU/crowdfund 
Published at
2024-08-17 20:05:49Event JSON
{
"id": "b06bb096588086e78c7aa2ed98c86fdd6717452c61888c1cf6a09d0e3db245d7",
"pubkey": "dab6c6065c439b9bafb0b0f1ff5a0c68273bce5c1959a4158ad6a70851f507b6",
"created_at": 1723925149,
"kind": 1,
"tags": [],
"content": "I have a new micro-project.\nIt allows to use venice.ai lifetime Pro account with local apps that communicate over the ollama API (open-webui, or continue.dev your VS Code IDE / JetBrains IDE).\n\nCheck out the demo video, it's quite nice.\n\nI can also provide a pro account if you don't want to fiddle with MOR tokens.\n\nI started doing this because llama-3.1-405b is really a great model (I think better than ChatGPT for many coding tasks), but I can't run it locally on my laptop. \n\nWith this, I have everything set up to make it work locally, with the best open-source model available today.\n\nhttps://pay.cypherpunk.today/apps/26zEBNn6FGAkzvVVuDMz3SXrKJLU/crowdfund\n\nhttps://hackyourself.io/assets/img/ollama-venice.jpeg",
"sig": "54ac7118caccd53d2f0c82b0deb295dc61c4272b2f040a593d42891d8aeb44d4f9e2714d9cfe77d4a18478a4cc07c6c892fe3ce17a3ba207f77089978e1ff9b6"
}
