Here I’m running Phi-3.5-Mini on an iPhone using LLM Farm getting 9.62 t/s.
Links:
https://huggingface.co/microsoft/Phi-3.5-mini-instruct
https://apps.apple.com/app/llm-farm/id6461209867
YawningGoat on Nostr: Still amazed how I can run an LLM with no internet connection on my phone 🤯 Here ...
Still amazed how I can run an LLM with no internet connection on my phone 🤯
Here I’m running Phi-3.5-Mini on an iPhone using LLM Farm getting 9.62 t/s.
Links:
https://huggingface.co/microsoft/Phi-3.5-mini-instruct
https://apps.apple.com/app/llm-farm/id6461209867
Here I’m running Phi-3.5-Mini on an iPhone using LLM Farm getting 9.62 t/s.
Links:
https://huggingface.co/microsoft/Phi-3.5-mini-instruct
https://apps.apple.com/app/llm-farm/id6461209867