Video yükleniyor...
Video Yüklenemedi
⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone
188,708 görüntüleme • 1 yıl önce •via X (Twitter)
12 Yorum

Private LLM vs Ollama on a Laptop

The UIX Network is Live! Business & Social Networking 2.0. All the tools you need to get your $ right. By Us For Us. -It's for the people. #getoncode pls rt

guys! that's awesome! I love it! but you really need to improve the UI of the text box! it's painfully simple 😜

Thanks for your feedback! UX is definitely one of our top priorities – we have some nice improvements planned in our upcoming releases. Stay tuned! 😊

DeepSeek R1 running locally on iPhone is mind blowing. Can't wait to try this.

Join our Discord to get TestFlight access. 😀

Is this using mlx and @UnslothAI version?

@UnslothAI We don’t use MLX or GGUF because RTN quants don’t meet our standards. We quantize models with Omniquant and GPTQ ourselves and use mlc-llm as the inference engine.

Do you think that it will work on M1 Pro?

Of course. A 70B model needs at least 48GB of RAM, but an 8B model will work on any Apple Silicon Mac

My toes can text faster, but local iPhone support is still a W.

Mac app or DeepSeek R1 Distill Qwen 1.5B - both faster than toe-typing 😀
