Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone

188,708 Aufrufe • vor 1 Jahr •via X (Twitter)

12 Kommentare

Profilbild von Private LLM
Private LLMvor 1 Jahr

Private LLM vs Ollama on a Laptop

Profilbild von UserInterface
UserInterfacevor 7 Jahren

The UIX Network is Live! Business & Social Networking 2.0. All the tools you need to get your $ right. By Us For Us. -It's for the people. #getoncode pls rt

Profilbild von Luis Yáñez
Luis Yáñezvor 1 Jahr

guys! that's awesome! I love it! but you really need to improve the UI of the text box! it's painfully simple 😜

Profilbild von Private LLM
Private LLMvor 1 Jahr

Thanks for your feedback! UX is definitely one of our top priorities – we have some nice improvements planned in our upcoming releases. Stay tuned! 😊

Profilbild von Poonam Soni
Poonam Sonivor 1 Jahr

DeepSeek R1 running locally on iPhone is mind blowing. Can't wait to try this.

Profilbild von Private LLM
Private LLMvor 1 Jahr

Join our Discord to get TestFlight access. 😀

Profilbild von dc
dcvor 1 Jahr

Is this using mlx and @UnslothAI version?

Profilbild von Private LLM
Private LLMvor 1 Jahr

@UnslothAI We don’t use MLX or GGUF because RTN quants don’t meet our standards. We quantize models with Omniquant and GPTQ ourselves and use mlc-llm as the inference engine.

Profilbild von open my old account Elon
open my old account Elonvor 1 Jahr

Do you think that it will work on M1 Pro?

Profilbild von Private LLM
Private LLMvor 1 Jahr

Of course. A 70B model needs at least 48GB of RAM, but an 8B model will work on any Apple Silicon Mac

Profilbild von Conwic
Conwicvor 1 Jahr

My toes can text faster, but local iPhone support is still a W.

Profilbild von Private LLM
Private LLMvor 1 Jahr

Mac app or DeepSeek R1 Distill Qwen 1.5B - both faster than toe-typing 😀

Ähnliche Videos