Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Gemma3n + MLX 🚀 Run DeepMind's first open-source Omni Model on Your Mac! Get started: > pip install -U mlx-vlm

Prince Canuma

6,497 subscribers

31,873 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

11 Comments

Philipp Schmid1 year ago

Awesome video!

Prince Canuma1 year ago

Thank you very much, Philip! ❤️

LazyFit1 year ago

No jumping, No Running. Workouts at home at any time.🕒🏠 BEST 15 min Beginner Home Workout for Weight Loss 🧘‍♀️🔥

Doron Adler1 year ago

Thank you for building and maintaining all this 🙏

Prince Canuma1 year ago

My pleasure ❤️

Shreyas1 year ago

Cool video! May I know which software did you use to record your screen? Looks awesome btw

Prince Canuma1 year ago

Thanks ❤️ I use @screenstudio :)

Himanshu Kumar1 year ago

Is open-sourcing power a blessing or a Pandora's box?

Prince Canuma1 year ago

You are an AI expert so I guess you are the best person to answer 🙌🏽😜

Kiran Adimatyam1 year ago

Amazing @Prince_Canuma Here you go! This is a great step towards edge enabled LLMs

Ashish1 year ago

cool! Does it work only for VLMs?

Related Videos

Qwen3.5-397B-A17B with Vision running on a Single M3 Ultra 🚀 Shout out to the Qwen team because they cooked with this model! Get started today: > uv pip install -U mlx-vlm Model collection 👇🏽 Repo:

Qwen3.5-397B-A17B with Vision running on a Single M3 Ultra 🚀 Shout out to the Qwen team because they cooked with this model! Get started today: > uv pip install -U mlx-vlm Model collection 👇🏽 Repo:

Prince Canuma

11,386 views • 4 months ago

Day 2 of 3 MLX Releases: Introducing Local Computer-Use 🚀🔥 A powerful tool built with MLX that uses Vision Language models and Voice models to control your Mac through visual understanding, planning and reasoning. Features ⚡️Automate your workflow with natural language 😎 Control your computer “hands-free” This project now supports both: 🤖 Level 1 (GUI Agent) 🧠 Level 2 (Autonomous GUI Agent) Get started: > pip install -U mlx-vlm mlx-audio mlx-whisper Please leave us a star and send a PR :)

Day 2 of 3 MLX Releases: Introducing Local Computer-Use 🚀🔥 A powerful tool built with MLX that uses Vision Language models and Voice models to control your Mac through visual understanding, planning and reasoning. Features ⚡️Automate your workflow with natural language 😎 Control your computer “hands-free” This project now supports both: 🤖 Level 1 (GUI Agent) 🧠 Level 2 (Autonomous GUI Agent) Get started: > pip install -U mlx-vlm mlx-audio mlx-whisper Please leave us a star and send a PR :)

Prince Canuma

45,867 views • 1 year ago

I wasn't expecting such an intelligence model on my local machine. Minimax 2.1 on MLX🔥 git clone cd mlx-lm && pip install -e . mlx_lm.server --model mlx-community/MiniMax-M2.1-4bit

I wasn't expecting such an intelligence model on my local machine. Minimax 2.1 on MLX🔥 git clone cd mlx-lm && pip install -e . mlx_lm.server --model mlx-community/MiniMax-M2.1-4bit

mzba

30,377 views • 5 months ago

Introducing Omnidocs - Unified Visual Document processing toolkit ✅ 6+ document processing tasks ✅ 15+ Model supported ✅ Runs on consumer GPU/ Mac ✅ Supports multiple backend - Pytorch, vllm, mlx, open responses API Get started → pip install omnidocs✅

Introducing Omnidocs - Unified Visual Document processing toolkit ✅ 6+ document processing tasks ✅ 15+ Model supported ✅ Runs on consumer GPU/ Mac ✅ Supports multiple backend - Pytorch, vllm, mlx, open responses API Get started → pip install omnidocs✅

Adithya S K

22,174 views • 4 months ago

RF-DETR by Roboflow now on MLX It can do realtime instance segmentation on-device and enable some cool use cases for visual analysis, monitoring and robotics like Reachy Mini. Also augmented VLM and VLA by preprocessing image and video with areas of interest. New release coming soon on mlx-vlm 🚀 For those who can’t wait you can install mlx-vlm from source.

RF-DETR by Roboflow now on MLX It can do realtime instance segmentation on-device and enable some cool use cases for visual analysis, monitoring and robotics like Reachy Mini. Also augmented VLM and VLA by preprocessing image and video with areas of interest. New release coming soon on mlx-vlm 🚀 For those who can’t wait you can install mlx-vlm from source.

Prince Canuma

30,499 views • 2 months ago

New Audio Language Models on MLX 🔥🚀 - Orpheus - Sesame - Suno Bark Shoutout to Lucas Newman, Ivan Fioravanti ᯅ Pastilhas and Chi Kim for their amazing contributions Get started today: > pip install -U mlx-audio Please leave us a star and send us a PR:

New Audio Language Models on MLX 🔥🚀 - Orpheus - Sesame - Suno Bark Shoutout to Lucas Newman, Ivan Fioravanti ᯅ Pastilhas and Chi Kim for their amazing contributions Get started today: > pip install -U mlx-audio Please leave us a star and send us a PR:

Prince Canuma

35,670 views • 1 year ago

Run Qwen-TTS on Your Mac, natively. Blaine Brown has created Qwen3-TTS MLX WebUI Enhanced, a Web UI for running Qwen-TTS using the Mac-native MLX framework, powered by MLX-Audio from Prince Canuma, it runs very smooth! 1-click install on pinokio (Apple Silicon Macs)

Run Qwen-TTS on Your Mac, natively. Blaine Brown has created Qwen3-TTS MLX WebUI Enhanced, a Web UI for running Qwen-TTS using the Mac-native MLX framework, powered by MLX-Audio from Prince Canuma, it runs very smooth! 1-click install on pinokio (Apple Silicon Macs)

cocktail peanut

168,965 views • 4 months ago

🔥 Thrilled to have worked with Google AI Developers on day-0 MLX support for Gemma 3 QAT! QAT optimizes models during training by simulating low-precision operations, delivering similar performance to FP16 and dramatic memory savings when quantised: • Gemma 3 27B: 54GB → 14.1GB (74% reduction) • Gemma 3 12B: 24GB → 6.6GB (72% reduction) • Gemma 3 4B: 8GB → 2.6GB (67% reduction) • Gemma 3 1B: 2GB → 0.5GB (75% reduction) Get started: > pip install mlx-vlm mlx-lm Model collection 👇🏽

🔥 Thrilled to have worked with Google AI Developers on day-0 MLX support for Gemma 3 QAT! QAT optimizes models during training by simulating low-precision operations, delivering similar performance to FP16 and dramatic memory savings when quantised: • Gemma 3 27B: 54GB → 14.1GB (74% reduction) • Gemma 3 12B: 24GB → 6.6GB (72% reduction) • Gemma 3 4B: 8GB → 2.6GB (67% reduction) • Gemma 3 1B: 2GB → 0.5GB (75% reduction) Get started: > pip install mlx-vlm mlx-lm Model collection 👇🏽

Prince Canuma

11,374 views • 1 year ago

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Prince Canuma

123,480 views • 1 year ago

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥

Pedro Cuenca

65,768 views • 2 months ago

This is the best Open Source TTS available on Mac right now. Watch Peter break it down. I combined two Qwen3-TTS projects. One for MLX speed & the other for its beautiful UI (but was slow on Mac). Then added a bunch of features. Qwen3-TTS-MLX-WebUI-Enhanced Install via Pinokio

This is the best Open Source TTS available on Mac right now. Watch Peter break it down. I combined two Qwen3-TTS projects. One for MLX speed & the other for its beautiful UI (but was slow on Mac). Then added a bunch of features. Qwen3-TTS-MLX-WebUI-Enhanced Install via Pinokio

Blaine Brown

167,269 views • 4 months ago

Congratulations to the Cohere team on releasing North Mini Code 1.0 🔥 We provide day-0 support on MLX thanks to our close collaboration with the Cohere team. North Mini Code 1.0 is a 30B param MoE model with 3B active. It runs at ~66 tok/s in BF16, truly impressive speeds before any compression. Here is a quick demo I built using Pi by Mario Zechner & Armin Ronacher ⇌ as my agent hardness. Get started today: 1. Install mlx-vlm from source: > uv pip install git+ 2. Start the server and power your favourite agents (pi, opencode, hermes and etc) > uv run mlx_vlm.server --model CohereLabs/North-Mini-Code-1.0 New release tomorrow

Congratulations to the Cohere team on releasing North Mini Code 1.0 🔥 We provide day-0 support on MLX thanks to our close collaboration with the Cohere team. North Mini Code 1.0 is a 30B param MoE model with 3B active. It runs at ~66 tok/s in BF16, truly impressive speeds before any compression. Here is a quick demo I built using Pi by Mario Zechner & Armin Ronacher ⇌ as my agent hardness. Get started today: 1. Install mlx-vlm from source: > uv pip install git+ 2. Start the server and power your favourite agents (pi, opencode, hermes and etc) > uv run mlx_vlm.server --model CohereLabs/North-Mini-Code-1.0 New release tomorrow

Prince Canuma

35,367 views • 17 days ago

Offline vibe coding with Gemma 4. This open-source Electron app runs entirely on your Mac via Apple's MLX framework. No Wi-Fi required.

Offline vibe coding with Gemma 4. This open-source Electron app runs entirely on your Mac via Apple's MLX framework. No Wi-Fi required.

Google Gemma

387,959 views • 1 month ago

Marvis-TTS-v0.2 is here 🚀 A local first TTS model capable of realtime performance even on older iPhones that Lucas Newman and I built. What’s new: ✨ Blazing fast — 100M (tiny) & 250M parameter models 🌍 Multilingual — English, French, German 🎭 Enhanced voice cloning — More natural & expressive ⚡ Long-form generation — Up to 90 seconds (4x improvement) Get started today: > pip install -U mlx-audio

Marvis-TTS-v0.2 is here 🚀 A local first TTS model capable of realtime performance even on older iPhones that Lucas Newman and I built. What’s new: ✨ Blazing fast — 100M (tiny) & 250M parameter models 🌍 Multilingual — English, French, German 🎭 Enhanced voice cloning — More natural & expressive ⚡ Long-form generation — Up to 90 seconds (4x improvement) Get started today: > pip install -U mlx-audio

Prince Canuma

118,352 views • 7 months ago

The latest MLX has a CUDA back-end! To get started: pip install "mlx[cuda]" With the same codebase you can develop locally, run your model on Apple silicon, or in the cloud on Nvidia GPUs. MLX is designed around Apple silicon - which has a unified memory architecture. It uses the same design with CUDA. So there's no need to move arrays around from CPU memory to GPU memory. Note, this is early days - some operations are missing and performance is still being optimized. But it's already quite fast for Transformer training, text generation, and more! Here's a demo using mlx-lm to generate text with Llama 3 8B (bf16) on an A100:

The latest MLX has a CUDA back-end! To get started: pip install "mlx[cuda]" With the same codebase you can develop locally, run your model on Apple silicon, or in the cloud on Nvidia GPUs. MLX is designed around Apple silicon - which has a unified memory architecture. It uses the same design with CUDA. So there's no need to move arrays around from CPU memory to GPU memory. Note, this is early days - some operations are missing and performance is still being optimized. But it's already quite fast for Transformer training, text generation, and more! Here's a demo using mlx-lm to generate text with Llama 3 8B (bf16) on an A100:

Awni Hannun

42,761 views • 11 months ago

Introducing MLX-Audio Studio 🚀 An open-source UI for audio gen. This new UI will allow you to easily generate and transcribe audio locally using MLX-Audio, Transformers or any other backend you prefer (i.e. OpenAI). We will be adding more tasks soon, stay tuned! Get started on our GH:

Introducing MLX-Audio Studio 🚀 An open-source UI for audio gen. This new UI will allow you to easily generate and transcribe audio locally using MLX-Audio, Transformers or any other backend you prefer (i.e. OpenAI). We will be adding more tasks soon, stay tuned! Get started on our GH:

Prince Canuma

51,071 views • 7 months ago

Sam-Audio by AI at Meta is now on MLX-Audio 🔊 You can now isolate voices or sounds from any audio locally in your Mac. I added this simple UI to the MLX-Audio studio app to help you get started Note: - The release is coming soon for now please install from source. - Vision part was excluded for now. Let me know if you need it. - PR for UI:

Sam-Audio by AI at Meta is now on MLX-Audio 🔊 You can now isolate voices or sounds from any audio locally in your Mac. I added this simple UI to the MLX-Audio studio app to help you get started Note: - The release is coming soon for now please install from source. - Vision part was excluded for now. Let me know if you need it. - PR for UI:

Prince Canuma

19,027 views • 5 months ago

Hermes Agent Nous Research + Gemma 4 26B Google DeepMind, fully working on local Mac 🤯: one prompt → full CLI app + tests + pytest passing tool calls firing back to back — local Claude Code vibes Gemma 4 MoE is fast AND smart, and tool calling just works — powered by Rapid-MLX which natively parses Gemma 4's tool format (no other local backend can do this yet) Two lines to try it: pip install rapid-mlx & rapid-mlx serve gemma-4-26b pip install hermes-agent && hermes @teknaborat @siaborisov #HermesAgent #Gemma4 #LocalLLM

Hermes Agent Nous Research + Gemma 4 26B Google DeepMind, fully working on local Mac 🤯: one prompt → full CLI app + tests + pytest passing tool calls firing back to back — local Claude Code vibes Gemma 4 MoE is fast AND smart, and tool calling just works — powered by Rapid-MLX which natively parses Gemma 4's tool format (no other local backend can do this yet) Two lines to try it: pip install rapid-mlx & rapid-mlx serve gemma-4-26b pip install hermes-agent && hermes @teknaborat @siaborisov #HermesAgent #Gemma4 #LocalLLM

raullen

24,988 views • 2 months ago