Just had a quick look into this and it seems possible to do this for free. Ie to run open-source models on the Mac like LLama 2, Mistral, or Phi-2 locally using Ollama.
No internet, no API keys, no limits and Apple Silicon runs them well.
jamw /
npub10v…m4qs4
2025-04-29 21:38:16
in reply to nevent1q…5w0z
Author Public Key
npub10vu5jqhw4kurwzf37xgr6qzkj4z7ssgnld4qjc6xv3mrhc3jqzwqnm4qs4Published at
2025-04-29 21:38:16Event JSON
{
"id": "49d95ddb85e14ad49830586a46d305f918c8f094416f8bdd2a8d98e85e5722ed",
"pubkey": "7b394902eeadb8370931f1903d00569545e84113fb6a09634664763be232009c",
"created_at": 1745962696,
"kind": 1,
"tags": [
[
"e",
"c72906b22ab684c7c1e01a359fdc5ab0a3b613bb0cfc24da3db06f8742c90395",
"ws://192.168.18.7:7777",
"root"
],
[
"e",
"9d3f1758181de72c1b3375e9832f4cbfa69ce0f68cf3e9d0f6ea359ed96df8c1",
"ws://192.168.18.7:7777",
"reply"
],
[
"p",
"82341f882b6eabcd2ba7f1ef90aad961cf074af15b9ef44a09f9d2a8fbfbe6a2",
"",
"mention"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"",
"mention"
]
],
"content": "Just had a quick look into this and it seems possible to do this for free. Ie to run open-source models on the Mac like LLama 2, Mistral, or Phi-2 locally using Ollama.\n\nNo internet, no API keys, no limits and Apple Silicon runs them well.",
"sig": "49863308cbae48bf5eef761a54e2748ef7f21f5a43b888f2d599faee858c417a35641522f2d7ea630c26c5afb99c5e822284da81338a6a9b4773431e13709318"
}