juraj on Nostr: This is cool. I have OpenWebUI running with local ollama on my Mac with local models, ...
This is cool. I have OpenWebUI running with local ollama on my Mac with local models, tunneled through holesail to my nginx.
I also run my Venice ollama-like proxy (link below) to access the LLaMA-3.1-405B model which does not run on my laptop.
And I access it as a PWA from my GrapheneOS phone.
What you see on the video then is: - I do the first inference on Venice's LLaMA-405B using my project: https://pay.cypherpunk.today/apps/26zEBNn6FGAkzvVVuDMz3SXrKJLU/crowdfund You can also get lifetime Venice Pro account there. - Then I decide to switch to private local inference with Gemma2-27B, which runs on my local Mac - Then I turn it into picture using the MidJourney prompt generator:
- (resulting image is not generated through Open WebUI, only through Venice's FLUX model with the Pro account) - Then I ask what the eso-level of this conversation is with my Eso Level Estimator 8000:
{
"id":"4a96a5f2fc7cf2721294c33df62e13248116097b5e07d4319111adb7de7c7389",
"pubkey":"dab6c6065c439b9bafb0b0f1ff5a0c68273bce5c1959a4158ad6a70851f507b6",
"created_at":1724231643,
"kind":1,
"tags": [],
"content":"This is cool. I have OpenWebUI running with local ollama on my Mac with local models, tunneled through holesail to my nginx.\n\nI also run my Venice ollama-like proxy (link below) to access the LLaMA-3.1-405B model which does not run on my laptop.\n\nAnd I access it as a PWA from my GrapheneOS phone.\n\nWhat you see on the video then is:\n- I do the first inference on Venice's LLaMA-405B using my project: https://pay.cypherpunk.today/apps/26zEBNn6FGAkzvVVuDMz3SXrKJLU/crowdfund \nYou can also get lifetime Venice Pro account there.\n- Then I decide to switch to private local inference with Gemma2-27B, which runs on my local Mac\n- Then I turn it into picture using the MidJourney prompt generator:\n\nhttps://openwebui.com/m/hub/midjourney-prompt-generator:latest/\n\n- (resulting image is not generated through Open WebUI, only through Venice's FLUX model with the Pro account)\n- Then I ask what the eso-level of this conversation is with my Eso Level Estimator 8000:\n\nhttps://openwebui.com/m/moonlestial/eso-level-estimator-8000\n\nThe future is now.\n\nhttps://m.primal.net/KGXS.mp4 \n\nhttps://m.primal.net/KGXT.png ",
"sig":"850eeec0f9c12ff0a8b4ab981b965e1c2b6c8b733eca46762df5671ff1e9f26fc1c79f3d242e19e5d4411bf8bbd0513c7e6d56d13d92e3e033f19c3070d283c3"
}
