Introducing MLX-Swift-TS An SDK for running time series foundation... models fully on-device on Apple Silicon. When I joined Datadog, Inc. , I was introduced to Toto, our time series foundation model, and got excited about zero-shot forecasting across different domains. While building a health copilot app, I realized there wasn’t a simple way to run models like these locally on device. So I built one. MLX-Swift-TS exposes a common TimeSeriesForecaster interface for loading and running multiple time series architectures directly in Swift using MLX. No server required. The attached video shows on-device forecasting running inside a native Swift app. Huge thanks to Awni Hannun and the MLX team for building MLX and its Swift API, Prince Canuma for inspiration on MLX SDK patterns, and Ameet Talwalkar and the Datadog team for Toto.show more

Today I'm launching a very early release of MLX... Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.show more

MLX news: MOSS-TTS-Local Transformer 1.5 available on mlx-audio now!... Thanks to Prince Canuma and Lucas Newman Audio on! 🔉show more

Google's Gemma 4 26B A4B running on MacBook Pro... M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX frameworkshow more

Pure MLX of UMAP, t-SNE, PaCMAP, TriMap, DREAMS, and... CNE for Apple Silicon. Beyond the algorithms, I also built a circle-splatting renderer in MLX - scatter-add alpha blending on Metal, piped to H264 hardware encoding. So 70K points, 784 dimensions, from raw data to rendered video < 5s on M3 Ultra. pip install mlx-vis Paper: Code:show more

Demo of 1-bit Bonsai 8B from PrismML running on-device... on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AIshow more

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥

DeepSeek R1 distilled to Qwen 1.5B easily runs on... my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:show more

Google’s Gemma 4 E2B running on-device on iPhone 17... Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Siliconshow more

Playing with Qwen3-TTS is and MLX-Audio locally on Mac... Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.show more

chat app with the new mlx foundation models

Qwen 3.5 0.8B, Gated DeltaNet attention is running on... Apple Neural Engine ~56 t/s in LUT6 quantization with some room for optimization left. It is CoreML, Swift and IOSurface on M4Pro. It will slow down as we increase context, but not by much. I think Private API opens the way to integrate ANE with GPU/MLX and possibly some MoE.show more

Arabic. Japanese. Turkish. Redacting clinical discharge summaries in real-time.... 30+ new open-source PII models shipped today on Hugging Face. 30+ MLX variants as native Swift packages for macOS and iOS. OpenMed PII family: 1M+ downloads in 20 days. Apache 2.0.show more

I wanted to try Maple-Preview by DeepGrove on iPhone... so I simply ported the model to MLX Swift using Bionic Maple runs at ~80tk/s on iPhone 17 Pro with my quick port, it’s a 20B-A1B model at 2-bit The model is close to Qwen3.5 35-A2B in many benchs and runs easily on iPhoneshow more

DeepSeek-Prover (4-bit 7B) running at 114 toks/sec in MLX... LM on an M2 Ultra Thanks to for the port!show more