You need a newer phone with good specs to run models efficiently.
I'm using an "old" Pixel 7 Pro and it can run full 4B and quantized 8B and 12B models. It's not very fast but works for my use cases.
I'm going to publish an article soon with some use cases and model setups.
EXADIO
npub1ex…ufvsv
2025-05-14 17:20:30
in reply to nevent1q…7ah9
Author Public Key
npub1exadl64dhhkvcm3zdvak60l30vfjeuajjz2u7ytkyzewucg0scdqlufvsvPublished at
2025-05-14 17:20:30Event JSON
{
"id": "1234adac22e14acb09b301d55e6b4703a1c1f86c8f176602769e2c38edf0b6dc",
"pubkey": "c9badfeaadbdeccc6e226b3b6d3ff17b132cf3b29095cf117620b2ee610f861a",
"created_at": 1747243230,
"kind": 1,
"tags": [
[
"e",
"787f1685afd83c1609ff0f3e60b2f10e7f7a1613f8c0d3d0ff44b59e73e66b06"
],
[
"e",
"92b29df6318c43f2a83166abba60c9faab2f4faa792665d6c0cfc94eb026dc16",
"",
"reply"
],
[
"p",
"c9badfeaadbdeccc6e226b3b6d3ff17b132cf3b29095cf117620b2ee610f861a"
],
[
"p",
"5d385aa4e5068e236bec562836d0f16ef002de43c50832c623cc4cda0223fbf4"
],
[
"p",
"50c6ce2e69cf0baf79b52488b20418c4a6f9ca7bd0ac654b4624d5c025cf57db"
],
[
"a",
"30023:c9badfeaadbdeccc6e226b3b6d3ff17b132cf3b29095cf117620b2ee610f861a:my-android-tips",
"",
"root"
]
],
"content": "You need a newer phone with good specs to run models efficiently.\n\nI'm using an \"old\" Pixel 7 Pro and it can run full 4B and quantized 8B and 12B models. It's not very fast but works for my use cases. \n\nI'm going to publish an article soon with some use cases and model setups.",
"sig": "142157fd5edf6a00be28fd4d9e59451cf79dd7d772af626f2d8042f1b8a5164f0de06605896ca14f8a6251ff99e7c422054d0dcef39577714a5c9c0b30b07791"
}