
Private LLM
@private_llm • 3,904 subscribers
Local AI for Private, Uncensored Chat on iPhone, iPad, and Mac. No Cloud, No Tracking, No Logins. https://t.co/UkAaZLVIa1
Videos

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone
Private LLM188,708 görüntüleme • 1 yıl önce

Can an iPhone hold its own against a Mac? 💻📱 Ollama is running DeepSeek R1 Distill Llama 8B on a 16GB M2 MacBook Air, while the iPhone 15 Pro (8GB A17 Pro) runs the same model. Same model. Same sampling temperature. Same system prompt. While the iPhone is a bit slower, the 3-bit OmniQuant model reasons just as well as the 4-bit RTN model on the Mac. 🤯
Private LLM26,544 görüntüleme • 1 yıl önce
Daha fazla içerik yok.