"I think the snappily titled "gemma3:27b-it-qat" may be my new favorite local model - needs 22GB of RAM on my Mac (I'm running it via Ollama, Open WebUI and Tailscale so I can access it from my phone too) and so far it seems extremely capable"
https://fxtwitter.com/simonw/status/1913728553126175140
https://simonwillison.net/2025/Apr/19/gemma-3-qat-models/
calle 👁️⚡👁️
npub12r…485vg
2025-04-21 13:05:38
Author Public Key
npub12rv5lskctqxxs2c8rf2zlzc7xx3qpvzs3w4etgemauy9thegr43sf485vgPublished at
2025-04-21 13:05:38Event JSON
{
"id": "077a4c590ce715bff79497066b5795df34ffb502c20404ad0299d4bdc7470e8a",
"pubkey": "50d94fc2d8580c682b071a542f8b1e31a200b0508bab95a33bef0855df281d63",
"created_at": 1745240738,
"kind": 1,
"tags": [
[
"r",
"https://fxtwitter.com/simonw/status/1913728553126175140"
],
[
"r",
"https://simonwillison.net/2025/Apr/19/gemma-3-qat-models/"
]
],
"content": "\"I think the snappily titled \"gemma3:27b-it-qat\" may be my new favorite local model - needs 22GB of RAM on my Mac (I'm running it via Ollama, Open WebUI and Tailscale so I can access it from my phone too) and so far it seems extremely capable\"\n\nhttps://fxtwitter.com/simonw/status/1913728553126175140\n\nhttps://simonwillison.net/2025/Apr/19/gemma-3-qat-models/",
"sig": "be86ebbc34a949d39ea138bd62ae2d472ca27890880ef8ded775b8437f634f543399b372a7de40c11781fcee98f7f4d5ec8d7cd90682964e5d3d59852066c167"
}