You can run ollama today.
https://ollama.com/
They have not done anything special for running the models. The models themselves are open source. The value of the service is that they run the models on their infrastructure. If you want to run it themselves, there's plenty of better solutions like ollama and many frontends such as open webui.
Juraj
npub1m2…lr8p9
2024-11-25 12:23:29
in reply to nevent1q…jwwx
Author Public Key
npub1m2mvvpjugwdehtaskrcl7ksvdqnnhnjur9v6g9v266nss504q7mqvlr8p9Published at
2024-11-25 12:23:29Event JSON
{
"id": "14824a4b0f879bba3bc6f16be268f0105e91495f2378fc075330480d95a1ca10",
"pubkey": "dab6c6065c439b9bafb0b0f1ff5a0c68273bce5c1959a4158ad6a70851f507b6",
"created_at": 1732537409,
"kind": 1,
"tags": [
[
"e",
"71437dff6b23b7edd2d10a6cba642a7da14f9a24375a516fafd20c259f7d8d36",
"",
"root"
],
[
"e",
"264c6c9fe0157da4fe2bae419c1efe7afd926cc7ea001ee7decb87b11fb2d921"
],
[
"e",
"10eff648e31955016531665689b744cf32ec8747dddee797970be64709ee941f",
"",
"reply"
],
[
"p",
"dab6c6065c439b9bafb0b0f1ff5a0c68273bce5c1959a4158ad6a70851f507b6"
],
[
"p",
"e0f2147718da2820aba4f7d1324fb238a1764c7050a50cb5902655b4503fbb90"
],
[
"r",
"https://ollama.com/"
]
],
"content": "You can run ollama today. \n\nhttps://ollama.com/\n\nThey have not done anything special for running the models. The models themselves are open source. The value of the service is that they run the models on their infrastructure. If you want to run it themselves, there's plenty of better solutions like ollama and many frontends such as open webui.",
"sig": "c4d7d6f15bec9dd8e33fd1e1939ecd4d1f07ba7f864263a2a284060cb55844511a6bfc58f06b4c8686295669affa463d5d23828768ea71871625f9c05db5edc4"
}