Blake Houghton 🍁 on Nostr: Download gguf quantizations of the models (q4 minimum) and use software like MLCchat ...
Download gguf quantizations of the models (q4 minimum) and use software like MLCchat or Layla.ai. I'm not sure what software is available on iPhone, personally.
Published at
2024-09-25 18:47:55Event JSON
{
"id": "e5b519e769db47e3009292c7e0db8523638a70758b1103d55ab82b22af8d225e",
"pubkey": "0d1dd56ae3204328e45f78b1a64ac8f06d227129f775493ebe84cf28250d1ec6",
"created_at": 1727290075,
"kind": 1,
"tags": [
[
"e",
"67da5517c99963995f59e162153432653bbdf49a950cebe156c3fa14a3966e76",
"",
"root"
],
[
"e",
"6e45b0fe9a0713537054faa5504cc5fb123e0dc37ecd60cd968277e63b9aa34e",
"",
"reply"
],
[
"p",
"c6f7077f1699d50cf92a9652bfebffac05fc6842b9ee391089d959b8ad5d48fd"
],
[
"p",
"418a17eb8c7a403fb15334264f85fb7a35d33e1cfc7d6bed610931d1b64b2b3a"
],
[
"r",
"Layla.ai."
]
],
"content": "Download gguf quantizations of the models (q4 minimum) and use software like MLCchat or Layla.ai. I'm not sure what software is available on iPhone, personally.",
"sig": "3a44e55a3668dbce46b6ab55ae914c353fbb1bb491561f838dbc4ff5f3da8942c7c79ff61270b73b4e4bfeb388b96a8b91ba5df1f4dfce4410946e1ce01f202b"
}
