正在加载视频...

视频加载失败

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone

188,708 次观看 • 1 年前 •via X (Twitter)

12 条评论

Private LLM 的头像
Private LLM1 年前

Private LLM vs Ollama on a Laptop

UserInterface 的头像
UserInterface7 年前

The UIX Network is Live! Business & Social Networking 2.0. All the tools you need to get your $ right. By Us For Us. -It's for the people. #getoncode pls rt

Luis Yáñez 的头像
Luis Yáñez1 年前

guys! that's awesome! I love it! but you really need to improve the UI of the text box! it's painfully simple 😜

Private LLM 的头像
Private LLM1 年前

Thanks for your feedback! UX is definitely one of our top priorities – we have some nice improvements planned in our upcoming releases. Stay tuned! 😊

Poonam Soni 的头像
Poonam Soni1 年前

DeepSeek R1 running locally on iPhone is mind blowing. Can't wait to try this.

Private LLM 的头像
Private LLM1 年前

Join our Discord to get TestFlight access. 😀

dc 的头像
dc1 年前

Is this using mlx and @UnslothAI version?

Private LLM 的头像
Private LLM1 年前

@UnslothAI We don’t use MLX or GGUF because RTN quants don’t meet our standards. We quantize models with Omniquant and GPTQ ourselves and use mlc-llm as the inference engine.

open my old account Elon 的头像
open my old account Elon1 年前

Do you think that it will work on M1 Pro?

Private LLM 的头像
Private LLM1 年前

Of course. A 70B model needs at least 48GB of RAM, but an 8B model will work on any Apple Silicon Mac

Conwic 的头像
Conwic1 年前

My toes can text faster, but local iPhone support is still a W.

Private LLM 的头像
Private LLM1 年前

Mac app or DeepSeek R1 Distill Qwen 1.5B - both faster than toe-typing 😀

相关视频