Adrien Grondin's banner

Adrien Grondin

@adrgrondin • 7,798 subscribers

Apple Platforms @lmstudio building @LocallyAIApp, Prev. iOS Developer at @Match @MeeticGroup

Shorts

Google’s Gemma 4 E2B running on-device on iPhone 17 Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Silicon

Google’s Gemma 4 E2B running on-device on iPhone 17 Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Silicon

1,042,852 Aufrufe

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

349,410 Aufrufe

Here’s Apple’s foundation model running on iPhone 17 Pro It’s just so fast Apple was not joking, the A19 Pro chip is really good for running LLMs on-device

Here’s Apple’s foundation model running on iPhone 17 Pro It’s just so fast Apple was not joking, the A19 Pro chip is really good for running LLMs on-device

1,565,317 Aufrufe

Side by side comparison of Apple’s on-device foundation model iPhone 16 Pro vs 17 Pro ~55 tk/s for the 16 Pro and ~85 tk/s for the 17 Pro

Side by side comparison of Apple’s on-device foundation model iPhone 16 Pro vs 17 Pro ~55 tk/s for the 16 Pro and ~85 tk/s for the 17 Pro

881,917 Aufrufe

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

159,705 Aufrufe

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

493,370 Aufrufe

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

32,556 Aufrufe

Another demo of the iPhone 17 Pro’s on-device LLM performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quants

Another demo of the iPhone 17 Pro’s on-device LLM performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quants

46,205 Aufrufe

$Really impressed by quality of Marvis-AI made by Prince Canuma & Lucas Newman, it's only 250M and uses less than 500MB in 4-bit 🤯 You only need 2 lines of code to run on macOS: pip install -U mlx-audio python -m mlx_audio.tts.generate --model Marvis-AI/marvis-tts-250m-v0.1 --stream \ --text "Hello there!" No reason not to give it a try!$

Really impressed by quality of Marvis-AI made by Prince Canuma & Lucas Newman, it's only 250M and uses less than 500MB in 4-bit 🤯 You only need 2 lines of code to run on macOS: pip install -U mlx-audio python -m mlx_audio.tts.generate --model Marvis-AI/marvis-tts-250m-v0.1 --stream \ --text "Hello there!" No reason not to give it a try!

11,780 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

The new Qwen 3.5 by Qwen running on-device on iPhone 17 Pro. Qwen 3.5 beats models 4 times its size, has strong visual understanding, and can toggle reasoning on or off. The 2B 6-bit model here is running with MLX optimized for Apple Silicon.

The new Qwen 3.5 by Qwen running on-device on iPhone 17 Pro. Qwen 3.5 beats models 4 times its size, has strong visual understanding, and can toggle reasoning on or off. The 2B 6-bit model here is running with MLX optimized for Apple Silicon.

3,551,535 Aufrufe • vor 3 Monaten

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

72,719 Aufrufe • vor 15 Tagen

The new Qwen 3.5 4B runs incredibly well on M5. The model is close to GPT-4o in benchmarks. Running fully on-device with MLX.

The new Qwen 3.5 4B runs incredibly well on M5. The model is close to GPT-4o in benchmarks. Running fully on-device with MLX.

230,124 Aufrufe • vor 2 Monaten

Early WIP port of Gemma 4 multi-token prediction (MTP) on MLX Swift With MTP, Gemma 31B is 30-40% faster on M5 Max and with zero quality degradation A significant speedup by just adding a 900MB MTP drafter model

Early WIP port of Gemma 4 multi-token prediction (MTP) on MLX Swift With MTP, Gemma 31B is 30-40% faster on M5 Max and with zero quality degradation A significant speedup by just adding a 900MB MTP drafter model

35,585 Aufrufe • vor 26 Tagen

I’ve been using the new MacBook Pro M5 since launch and it’s a beast, especially compared to my old M1! It’s good for running the smaller AI models locally but also everything you do is just so fast. Here’s Gemma 3 QAT 12B running with MLX:

I’ve been using the new MacBook Pro M5 since launch and it’s a beast, especially compared to my old M1! It’s good for running the smaller AI models locally but also everything you do is just so fast. Here’s Gemma 3 QAT 12B running with MLX:

101,950 Aufrufe • vor 6 Monaten

The latest Qwen 3 VL by Qwen running on iPhone 17 Pro with MLX Qwen 3 VL brings upgraded visual understanding, recognition, and OCR capabilities without sacrificing text performance like previous models The 4B model here is close to Qwen 2.5 VL 72B in many benchmarks

The latest Qwen 3 VL by Qwen running on iPhone 17 Pro with MLX Qwen 3 VL brings upgraded visual understanding, recognition, and OCR capabilities without sacrificing text performance like previous models The 4B model here is close to Qwen 2.5 VL 72B in many benchmarks

109,700 Aufrufe • vor 7 Monaten

Translating a full-length news article on iPhone 17 Pro with TranslateGemma from Google DeepMind The model works incredibly well on long text Running fully on-device with MLX

Translating a full-length news article on iPhone 17 Pro with TranslateGemma from Google DeepMind The model works incredibly well on long text Running fully on-device with MLX

15,493 Aufrufe • vor 3 Monaten

Keine weiteren Inhalte verfügbar