Very new to exploring this. I’ve used ChatGPT and that’s about it. So far using ollama through docker has been great for running locally. Mostly testing small open models >=8b parameters.
Will see how these small models do on my M1… I imagine they will give me enough of a boost that I won’t choose to pay for something.
What’s your experience been like?
armstrys /
npub1eq…4er58
2024-10-05 01:33:54
in reply to nevent1q…wq3g
Author Public Key
npub1eq94yj8maree90pm53gfr76wdc44su3cwcqmly848xfrv6es6usqg4er58Published at
2024-10-05 01:33:54Event JSON
{
"id": "6f3da8b8c1ef42dfe816cbc01573d38e9df08067b2ca0132c451f6d2ac1e5552",
"pubkey": "c80b5248fbe8f392bc3ba45091fb4e6e2b5872387601bf90f53992366b30d720",
"created_at": 1728092034,
"kind": 1,
"tags": [
[
"e",
"06a394668799cc6713680e98115eb9163bb5f141e9a4434121b1bd00bac877e1",
"",
"root"
],
[
"e",
"b3913326303d6515f8be69d1fdde81410e55e032c6f0a41986462da7245035c1",
"",
"reply"
],
[
"p",
"7bdef7bdebb8721f77927d0e77c66059360fa62371fdf15f3add93923a613229"
],
[
"p",
"1bda7e1f7396bda2d1ef99033da8fd2dc362810790df9be62f591038bb97c4d9"
]
],
"content": "Very new to exploring this. I’ve used ChatGPT and that’s about it. So far using ollama through docker has been great for running locally. Mostly testing small open models \u003e=8b parameters. \n\nWill see how these small models do on my M1… I imagine they will give me enough of a boost that I won’t choose to pay for something. \n\nWhat’s your experience been like?",
"sig": "ffa9bf14a9f631b6d406535407d481a08150c5cfe1b211c5ffc237ed528b143f6a29a6d26b5b3c99157ca8bfa0664ab154cc1cbbcc90a8b8eaa2d04ae716e4fa"
}