jb55 on Nostr: Is it supposed to be so slow? I am getting like 1 token a second on my m1 on 8 ...
Is it supposed to be so slow? I am getting like 1 token a second on my m1 on 8 threads. Seems to work a bit faster in my ryzen on 16 threads, maybe not as optimized on apple silicon yet? His demo seemed much faster than mine though :/
Published at
2023-04-16 14:43:26Event JSON
{
"id": "a9dc632ef984c7364e355d4b1de21629414127d22e1a6b5bc52d7cb4ce484ab9",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1681656206,
"kind": 1,
"tags": [
[
"e",
"3de94ee418667f1567a79eb4c76ff788e39a4caf1947d5ec75fcda15d8920b0b"
],
[
"e",
"c8476ee31f7c4c37433125796277790a6654f60920324040f84fdddd6bf8f202"
],
[
"p",
"d7f0e3917c466f1e2233e9624fbd6d4bd1392dbcfcaf3574f457569d496cb731"
],
[
"p",
"d7f0e3917c466f1e2233e9624fbd6d4bd1392dbcfcaf3574f457569d496cb731"
]
],
"content": "Is it supposed to be so slow? I am getting like 1 token a second on my m1 on 8 threads. Seems to work a bit faster in my ryzen on 16 threads, maybe not as optimized on apple silicon yet? His demo seemed much faster than mine though :/ ",
"sig": "59e49fec74ba265e0467dadb24b600e292861fca96c1444cef8cba1f6a21c3b2e2dccdb6b3337c06de34f6ef3aabf28de3e49a2eecf38209cf6f11a05f65ba82"
}
