Skipper on Nostr: I'm getting 2 tokens per second on Gemma 3 4B running on a Pixel 9 Pro. It's slow but ...
I'm getting 2 tokens per second on Gemma 3 4B running on a Pixel 9 Pro. It's slow but usable for basic questions, not ideal for coding or something very productive.
Published at
2025-05-22 23:19:55Event JSON
{
"id": "fb09623443b01d44f2e6a615854f2c9d0993e7cb05d3b1db3de36db0d5c4b189",
"pubkey": "50c6ce2e69cf0baf79b52488b20418c4a6f9ca7bd0ac654b4624d5c025cf57db",
"created_at": 1747955995,
"kind": 1,
"tags": [
[
"e",
"4e93261f3c3bb84524b65198a64d3c5c0ed4e1cb613ad753eaa73732418d456f",
"",
"root"
],
[
"e",
"8bcd25595246e0dfea34e72ea5a39b9793c86480bd6ee087448537dd2a8756d3",
"",
"reply"
],
[
"p",
"268b948b5aab4bab0e5430ee49e3cff11776cf183df93b32159f9670ed541495"
],
[
"p",
"50c6ce2e69cf0baf79b52488b20418c4a6f9ca7bd0ac654b4624d5c025cf57db"
]
],
"content": "I'm getting 2 tokens per second on Gemma 3 4B running on a Pixel 9 Pro. It's slow but usable for basic questions, not ideal for coding or something very productive.",
"sig": "a9732bf01b609fca1bc7bb2bbad66b95cadc4701842008b682e231582a95de1337e1a5337259080fa207152ce297c94071dc5e233787770bacdad67323454169"
}
