Using Generable with MLX Swift! 🤩

Apple wasn’t kidding, the iPhone 17 Pro is really... built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possibleshow more

Google's Gemma 4 26B A4B running on MacBook Pro... M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX frameworkshow more

Helium 2B running locally on an iPhone 16 Pro... at 28 tok/s, faster than you can read, all thanks to mlx-swift with q4 quantization!show more

Qwen2.5-VL now on MLX 🚀 You can now run... inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾show more

Llama 3.2 1B in 4-bit runs at ~60 toks/sec... with MLX Swift on my iPhone 15 pro. It's quite good and easily runs on-device:show more

GLM-4.7 Flash by Z.ai running on M3 Ultra using... MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!show more

DeepSeek R1 distilled to Qwen 1.5B easily runs on... my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:show more

MLX Swift LLM example works with: - Mistral /... Llama - Phi-2 - Qwen 1.5 - Starcoder 2 Quick-start: Qwen 1.5 0.5B runs pretty fast in 16-bit on my iPhone 14, no quantization needed:show more

Today I'm launching a very early release of MLX... Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.show more

chat app with the new mlx foundation models

Running Kimi K2.5 on my desk. Runs at 24... tok/sec with 2 x 512GB M3 Ultra Mac Studios connected with Thunderbolt 5 (RDMA) using EXO Labs / MLX backend. Yes, it can run clawdbot.show more

DeepSeek-R1-0528-Qwen3-8B running on iPhone 16 with MLX

I was exploring MLX Swift and created a workout... assistant to train for my runs! 🏃🏽‍♂️ It uses my workout data from HealthKit for personalization and Qwen 2.5 3B for local inference!show more

Taylor Swift is us watching Simone Biles! 🤩 #USAGTrials24

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀... Get started: > pip install -U mlx-audio Model Card 👇🏾show more

GLF Motion Design w/ MLX