Sam 3 by Facebook now on MLX 🚀 Here... is a realtime object tracking running on M3 Max 96GB.show more

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You... can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾show more

Core AI: Realtime video image detection, tracking, and segmentation... with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.show more

GLM-4.7 Flash by Z.ai running on M3 Ultra using... MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!show more

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥

introducing: fruit xylophone a computer vision music experiment built... with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)show more

GLM 5.2 has just been released 🔥 Here it's... already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.show more

MLX MiniMax 2.5 running LOCALLY on a single M3... Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GBshow more

Google's Gemma 4 26B A4B running on MacBook Pro... M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX frameworkshow more

Cool video (sped-up) running Mixtral 8x22B on a M3... Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)show more

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉... You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽show more

Demo of 1-bit Bonsai 8B from PrismML running on-device... on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AIshow more

I love the ToolCall-15 so much, that I'm working... on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!show more

Owen Caissie today: 3/4 - 2 doubles, a single,... and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!show more

Playing with Qwen3-TTS is and MLX-Audio locally on Mac... Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.show more

Apple wasn’t kidding, the iPhone 17 Pro is really... built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possibleshow more

First steps for a specialized DeepSeek v4 Flash inference... engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.show more

Running the full GLM 4.7 (8-bit) on 2 x... 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallelshow more