Adrien Grondin's banner

Adrien Grondin

@adrgrondin • 8,195 subscribers

Apple Platforms @lmstudio building @LocallyAIApp

Shorts

The new PrismML’s Bonsai 27B model running on iPhone 17 Pro Bonsai 27B is the first 27B-class model to run on a phone and it uses less than 5GB of memory Pushing the limits on what can run a phone

The new PrismML’s Bonsai 27B model running on iPhone 17 Pro Bonsai 27B is the first 27B-class model to run on a phone and it uses less than 5GB of memory Pushing the limits on what can run a phone

66,574 просмотров

Google’s Gemma 4 E2B running on-device on iPhone 17 Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Silicon

Google’s Gemma 4 E2B running on-device on iPhone 17 Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Silicon

1,044,033 просмотров

Here’s Apple’s foundation model running on iPhone 17 Pro It’s just so fast Apple was not joking, the A19 Pro chip is really good for running LLMs on-device

Here’s Apple’s foundation model running on iPhone 17 Pro It’s just so fast Apple was not joking, the A19 Pro chip is really good for running LLMs on-device

1,565,670 просмотров

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

350,881 просмотров

New side panel in Locally. Conversations are now easier to access and search. Also more Liquid Glass!

New side panel in Locally. Conversations are now easier to access and search. Also more Liquid Glass!

93,393 просмотров

Side by side comparison of Apple’s on-device foundation model iPhone 16 Pro vs 17 Pro ~55 tk/s for the 16 Pro and ~85 tk/s for the 17 Pro

Side by side comparison of Apple’s on-device foundation model iPhone 16 Pro vs 17 Pro ~55 tk/s for the 16 Pro and ~85 tk/s for the 17 Pro

899,918 просмотров

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

493,469 просмотров

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

160,059 просмотров

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.

12,045 просмотров

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

32,556 просмотров

WIP Thinking UI for Qwen 3 thinking mode, running locally on iPhone. Tried to have something similar to Grok web thinking UI. Made 100% with SwiftUI.

WIP Thinking UI for Qwen 3 thinking mode, running locally on iPhone. Tried to have something similar to Grok web thinking UI. Made 100% with SwiftUI.

64,271 просмотров

Another demo of the iPhone 17 Pro’s on-device LLM performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quants

Another demo of the iPhone 17 Pro’s on-device LLM performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quants

46,205 просмотров

$Really impressed by quality of Marvis-AI made by Prince Canuma & Lucas Newman, it's only 250M and uses less than 500MB in 4-bit 🤯 You only need 2 lines of code to run on macOS: pip install -U mlx-audio python -m mlx_audio.tts.generate --model Marvis-AI/marvis-tts-250m-v0.1 --stream \ --text "Hello there!" No reason not to give it a try!$

Really impressed by quality of Marvis-AI made by Prince Canuma & Lucas Newman, it's only 250M and uses less than 500MB in 4-bit 🤯 You only need 2 lines of code to run on macOS: pip install -U mlx-audio python -m mlx_audio.tts.generate --model Marvis-AI/marvis-tts-250m-v0.1 --stream \ --text "Hello there!" No reason not to give it a try!

11,780 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

The new Qwen 3.5 by Qwen running on-device on iPhone 17 Pro. Qwen 3.5 beats models 4 times its size, has strong visual understanding, and can toggle reasoning on or off. The 2B 6-bit model here is running with MLX optimized for Apple Silicon.

The new Qwen 3.5 by Qwen running on-device on iPhone 17 Pro. Qwen 3.5 beats models 4 times its size, has strong visual understanding, and can toggle reasoning on or off. The 2B 6-bit model here is running with MLX optimized for Apple Silicon.

3,555,049 просмотров • 4 месяцев назад

The new Qwen 3.5 4B runs incredibly well on M5. The model is close to GPT-4o in benchmarks. Running fully on-device with MLX.

The new Qwen 3.5 4B runs incredibly well on M5. The model is close to GPT-4o in benchmarks. Running fully on-device with MLX.

230,466 просмотров • 4 месяцев назад

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

75,549 просмотров • 2 месяцев назад

I’ve been using the new MacBook Pro M5 since launch and it’s a beast, especially compared to my old M1! It’s good for running the smaller AI models locally but also everything you do is just so fast. Here’s Gemma 3 QAT 12B running with MLX:

I’ve been using the new MacBook Pro M5 since launch and it’s a beast, especially compared to my old M1! It’s good for running the smaller AI models locally but also everything you do is just so fast. Here’s Gemma 3 QAT 12B running with MLX:

101,950 просмотров • 7 месяцев назад

The latest Qwen 3 VL by Qwen running on iPhone 17 Pro with MLX Qwen 3 VL brings upgraded visual understanding, recognition, and OCR capabilities without sacrificing text performance like previous models The 4B model here is close to Qwen 2.5 VL 72B in many benchmarks

The latest Qwen 3 VL by Qwen running on iPhone 17 Pro with MLX Qwen 3 VL brings upgraded visual understanding, recognition, and OCR capabilities without sacrificing text performance like previous models The 4B model here is close to Qwen 2.5 VL 72B in many benchmarks

109,700 просмотров • 9 месяцев назад

Early WIP port of Gemma 4 multi-token prediction (MTP) on MLX Swift With MTP, Gemma 31B is 30-40% faster on M5 Max and with zero quality degradation A significant speedup by just adding a 900MB MTP drafter model

Early WIP port of Gemma 4 multi-token prediction (MTP) on MLX Swift With MTP, Gemma 31B is 30-40% faster on M5 Max and with zero quality degradation A significant speedup by just adding a 900MB MTP drafter model

35,875 просмотров • 2 месяцев назад

Translating a full-length news article on iPhone 17 Pro with TranslateGemma from Google DeepMind The model works incredibly well on long text Running fully on-device with MLX

Translating a full-length news article on iPhone 17 Pro with TranslateGemma from Google DeepMind The model works incredibly well on long text Running fully on-device with MLX

15,493 просмотров • 5 месяцев назад

Больше нет контента для загрузки