iefan 🕊️ on Nostr: At the moment, it functions with llama.c via any terminal. Once it's quantized, you ...
At the moment, it functions with llama.c via any terminal. Once it's quantized, you should be able to use it with mlc as well.
I will also integrate it into Aithena. This will allow you to run it locally in your browser on any device without sacrificing performance.
Published at
2024-10-31 12:21:17Event JSON
{
"id": "50de690f24aedbd2b982902230a1fd0b203b639ea3f3be8789f143c5493f42d6",
"pubkey": "c6f7077f1699d50cf92a9652bfebffac05fc6842b9ee391089d959b8ad5d48fd",
"created_at": 1730377277,
"kind": 1,
"tags": [
[
"e",
"6160e31c7c72d2cee1ac7d59d2f7f6ad7081668cf950007efdecf0471b401b28",
"",
"root"
],
[
"e",
"32203fe810bdd84d68e8dd116ee4e885c9f6e8d9b411bb7239b936db86875cf3",
"",
"reply"
],
[
"p",
"c6f7077f1699d50cf92a9652bfebffac05fc6842b9ee391089d959b8ad5d48fd"
],
[
"p",
"1bc70a0148b3f316da33fe3c89f23e3e71ac4ff998027ec712b905cd24f6a411"
]
],
"content": "At the moment, it functions with llama.c via any terminal. Once it's quantized, you should be able to use it with mlc as well. \n\nI will also integrate it into Aithena. This will allow you to run it locally in your browser on any device without sacrificing performance.",
"sig": "74955fbce18e3d2b1a2490ad7d05ee69a78a8a260123524661c971249210c33daea738dff137413a70ddd36d2c0715e74d0b97573e3eab4f27f4a9a9dd542565"
}
