Why Nostr? What is Njump?
2025-05-22 23:17:06

EXADIO on Nostr: # Best Local LLMs For Android 👇 I have been testing the latest models on my ...

# Best Local LLMs For Android 👇

I have been testing the latest models on my **Google Pixel 7 Pro with GrapheneOS** and the [PocketPal](https://github.com/a-ghorbani/pocketpal-ai) app. Here are my recommendations.

---

## Qwen 3 4B

- 🔗️ [`unsloth/Qwen3-4B-GGUF`](https://huggingface.co/unsloth/Qwen3-4B-GGUF)
- 🏭️ Made by Alibaba Cloud
- 📆️ Released in April 2025
- 💡️ First all-rounder model with a switch for thinking and non-thinking mode
- 🧪️ Use it for:
- Math
- Logic
- Coding
- Translations
- Content creation
- Summarizations
- Conversions to structured data
- ℹ️ To turn on thinking mode, append `/think` to your prompt
- `How many 'r's are in 'strawberries'? /think`
- ℹ️ To turn off thinking mode, append `/no_think` to your prompt
- `Who are you? /no_think`
- ℹ️ For math questions, append `Please reason step by step, and put your final answer within \boxed{}.` to your prompt
- `At a restaurant, each adult meal costs $5 and kids eat free. If a group of 15 people came in and 8 were kids, how much would it cost for the group to eat? Please reason step by step, and put your final answer within \boxed{}.`
- ℹ️ Recommended settings for thinking mode
- Temperature: `0.6`
- Top P: `0.95`
- Top K: `20`
- Min P: `0`
- ℹ️ Recommended settings for non-thinking mode
- Temperature: `0.7`
- Top P: `0.8`
- Top K: `20`
- MinP: `0`

---

## Gemma 3 4B

- 🔗️ [`MaziyarPanahi/gemma-3-4b-it-GGUF`](https://huggingface.co/MaziyarPanahi/gemma-3-4b-it-GGUF)
- 🏭️ Made by Google
- 📆️ Released in March 2025
- 💡️ Powerful vision language model with support for many languages
- 🧪️ Use it for:
- Translations
- Content creation
- Summarizations
- Conversions to structured data
- Code creation
- Language learning

## DeepSeek R1 Distill Llama 8B

- 🔗️ [`lmstudio-community/DeepSeek-R1-Distill-Llama-8B-GGUF`](https://huggingface.co/lmstudio-community/DeepSeek-R1-Distill-Llama-8B-GGUF)
- 🏭️ Made by DeepSeek
- 📆️ Released in January 2025
- 💡️ Great reasoning model
- 🧪️ Use it for:
- Math
- Logic
- Coding
- ℹ️ Avoid adding a system prompt and use user prompt only
- ℹ️ Recommended temperature setting is `0.6`
- ℹ️ For math questions, append `Please reason step by step, and put your final answer within \boxed{}.` to your prompt
- `At a restaurant, each adult meal costs $5 and kids eat free. If a group of 15 people came in and 8 were kids, how much would it cost for the group to eat? Please reason step by step, and put your final answer within \boxed{}.`

---

## EXAONE Deep 7.8B

- 🔗️ [`LGAI-EXAONE/EXAONE-Deep-7.8B-GGUF`](https://huggingface.co/LGAI-EXAONE/EXAONE-Deep-7.8B-GGUF)
- 🏭️ Made by LG
- 📆️ Released in March 2025
- 💡️ Underrated reasoning model from Korea
- 🧪️ Use it for:
- Math
- Logic
- Coding
- ℹ️ Use only English or Korean prompts
- ℹ️ Avoid adding a system prompt and use user prompt only
- ℹ️ Recommended settings
- Temperature: `0.6`
- Top P: `0.95`

#android #ai #llm #privacy
Author Public Key
npub1exadl64dhhkvcm3zdvak60l30vfjeuajjz2u7ytkyzewucg0scdqlufvsv