MLX Swift LLM example works with: - Mistral /... Llama - Phi-2 - Qwen 1.5 - Starcoder 2 Quick-start: Qwen 1.5 0.5B runs pretty fast in 16-bit on my iPhone 14, no quantization needed:show more

DeepSeek R1 distilled to Qwen 1.5B easily runs on... my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:show more

I wanted to try Maple-Preview by DeepGrove on iPhone... so I simply ported the model to MLX Swift using Bionic Maple runs at ~80tk/s on iPhone 17 Pro with my quick port, it’s a 20B-A1B model at 2-bit The model is close to Qwen3.5 35-A2B in many benchs and runs easily on iPhoneshow more

Qwen 3.5 0.8B, Gated DeltaNet attention is running on... Apple Neural Engine ~56 t/s in LUT6 quantization with some room for optimization left. It is CoreML, Swift and IOSurface on M4Pro. It will slow down as we increase context, but not by much. I think Private API opens the way to integrate ANE with GPU/MLX and possibly some MoE.show more

First look at Qwen 3.8-Flash-Next on 2 DGX Sparks... with SGLang RadixArk’s NVFP4 in OMPshow more

DeepSeek-R1-0528-Qwen3-8B running on iPhone 16 with MLX

HydroFX 1.5 is seriously fast. With up to 2×... faster simulation speeds, iterating on fluid shots feels much more responsive. This underwater simulation was created in HydroFX 1.5 and rendered in Blender Cycles. #HydroFX #Blender #VFX #FluidSimulationshow more

Managed to get Ling Mini 16B (1.4B active) running... on my iPhone Air. It runs very fast with MLX. It's a DWQ of Ling Mini quantized to 3 bits-per-weight. A 16B model running on an Air at this speed is pretty awesome:show more

Inference on UOMI is now free. Start building with... frontier open-source models at no cost: • MiniMax M2.7 • Qwen 3.6 27B • Qwen 3.6 35B A3B • Google Gemma 4 26B A4B • Google Gemma 4 31B Powered by the UOMI Inference Network. Start inferencing:show more

DeepSeek R1 Qwen 7B 4bit M2 Ultra vs M4... Max on Apple MLX 🤫 Let them think... (video 4x in center part) M2 Ultra: 114.9 tokens per sec M4 Max (14"): 88.3 tokens per secshow more

Qwen Image 3 and Qwen Image 3 Pro from... Qwen are now on Venice. Available anonymously.show more

MLX news: MOSS-TTS-Local Transformer 1.5 available on mlx-audio now!... Thanks to Prince Canuma and Lucas Newman Audio on! 🔉show more

Zuckerberg watching you use Qwen instead of LLaMA >... via /r/rlocallamashow more

Here Qwen 3 0.6B again on Italian wines 82.5%!... The best commercial LLM I tested in the past was scoring 75.6% (Sonnet 3.5)show more

BOOM 🚨: Tencent’s Hunyuan Turbo S just landed in... the Top 8 globally on Chatbot Arena and is now #2 in China, just behind DeepSeek. Even Google ex-CEO Eric Schmidt says China had no foundation models two years ago — now it has three: DeepSeek, Qwen, Hunyuan — on par with OpenAI’s O.1. At #GoogleIO, all three scored high on the global leaderboard like #DeepSeek, #Qwen, #Hunyuan Tencent Hy isn’t just racing — it’s rewriting the leaderboard. #HunyuanTurboS #TencentAI #LLM #AIRevolutionshow more