chat app with the new mlx foundation models

Introducing MLX-Swift-TS An SDK for running time series foundation... models fully on-device on Apple Silicon. When I joined Datadog, Inc. , I was introduced to Toto, our time series foundation model, and got excited about zero-shot forecasting across different domains. While building a health copilot app, I realized there wasn’t a simple way to run models like these locally on device. So I built one. MLX-Swift-TS exposes a common TimeSeriesForecaster interface for loading and running multiple time series architectures directly in Swift using MLX. No server required. The attached video shows on-device forecasting running inside a native Swift app. Huge thanks to Awni Hannun and the MLX team for building MLX and its Swift API, Prince Canuma for inspiration on MLX SDK patterns, and Ameet Talwalkar and the Datadog team for Toto.show more

Apple wasn’t kidding, the iPhone 17 Pro is really... built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possibleshow more

Another demo of Apple 20B on-device foundation model that... comes with iOS 27 The new models support image understanding (on all iPhone with the new OS) Very good at OCRshow more

LM Studio 0.3.10 is here with 🔮 Speculative Decoding!... This provides inferencing speedups, in some cases 2x or more, with no degradation in quality. - Works for both GGUF/llama.cpp and MLX models! - Easily experiment with different draft models - Visualize accepted draft token % rate - Works in Chat UI and APIshow more

Batching for vision models is now available in Beta... with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.show more

🔥 DFlash x MLX is happening! Shoutout to Arya... Manjaramkar for the early work on this. We're building on the momentum. Native MLX support, more models (Qwen3.5), up to 4x faster. Lossless! 👉show more

Quick demo of LFM 2.5 VL 1.6B model by... Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fastshow more

I made a little weather app with a frog... that changes its outfit and mood according to the weather. I illustrated it myself and used Apple’s Foundation Models to give it some character.show more

Today, we're launching Incognito Chat with Meta AI on... WhatsApp and the Meta AI app, a new way to have completely private conversations with AI.show more

Today I'm launching a very early release of MLX... Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.show more

THIS AI IS WILD chatgpt, claude and gemini and... 3 more models in one app, you can chat with them at the same time, one shared brain that knows you. no more switching models. no more losing context. try here:show more

GLM 5.2 has just been released 🔥 Here it's... already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.show more

Automating the Search for Artificial Life with Foundation Models... Presents ASAL, the first use of vision-language models in Artificial Life, discovering diverse, novel simulations across substrates proj: abs:show more

Qwen 3.6 models are now 2.5x times faster on... Atomic Chat with new MTP speedups. > MTP drafts several tokens ahead and verifies them in one pass. The speedup depends on the memory moved per pass. Users can run Qwen 3.6 models locally via the open-source Atomic Chat to test them!show more

Pulsar is partnering with 0G Labs (Home of Infinite... AI) to run financial AI models via 0G Private Computer. AI models that interact within the app run on decentralized compute, with proof attached to the response. Starting with the assistant. Ending with the app that works for you.show more