Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Prince_Canuma's profile picture

Prince Canuma

21,926 subscribers

180,245 Aufrufe • vor 3 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾
0:10

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾

Prince Canuma

74,448 Aufrufe • vor 2 Jahren

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.
0:18

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.

Amos Gyamfi

15,373 Aufrufe • vor 6 Tagen

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!
0:19

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!

Ivan Fioravanti ᯅ

75,425 Aufrufe • vor 5 Monaten

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾
0:11

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾

Prince Canuma

24,057 Aufrufe • vor 1 Jahr

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾
0:18

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾

Prince Canuma

29,952 Aufrufe • vor 1 Jahr

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥
0:16

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥

Vaibhav (VB) Srivastav

30,370 Aufrufe • vor 1 Jahr

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)
0:15

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)

AA

48,020 Aufrufe • vor 3 Monaten

GLM 5.2 has just been released 🔥 Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.
0:11

GLM 5.2 has just been released 🔥 Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.

Pedro Cuenca

81,984 Aufrufe • vor 13 Tagen

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx
0:18

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx

Prince Canuma

36,558 Aufrufe • vor 1 Jahr

MLX MiniMax 2.5 running LOCALLY on a single M3 Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GB
0:11

MLX MiniMax 2.5 running LOCALLY on a single M3 Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GB

Ivan Fioravanti ᯅ

226,126 Aufrufe • vor 4 Monaten

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework
0:14

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Adrien Grondin

350,467 Aufrufe • vor 2 Monaten

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽
0:18

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Prince Canuma

24,953 Aufrufe • vor 6 Monaten

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)
0:15

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)

Awni Hannun

70,804 Aufrufe • vor 2 Jahren

I love the ToolCall-15 so much, that I'm working on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!
0:17

I love the ToolCall-15 so much, that I'm working on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!

Ivan Fioravanti ᯅ

10,916 Aufrufe • vor 3 Monaten

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI
0:15

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

Adrien Grondin

159,809 Aufrufe • vor 3 Monaten

Owen Caissie today: 3/4 - 2 doubles, a single, and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!
0:19

Owen Caissie today: 3/4 - 2 doubles, a single, and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!

Andrew DeCeglie

17,181 Aufrufe • vor 2 Monaten

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.
0:17

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.

Ivan Fioravanti ᯅ

35,720 Aufrufe • vor 5 Monaten

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible
0:17

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Adrien Grondin

493,442 Aufrufe • vor 8 Monaten

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.
0:12

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

antirez

14,176 Aufrufe • vor 2 Monaten

Announcing MLX native Mac support for Moondream 3. Moondream running on Mac, Linux, Windows (free!): pip install moondream-station Details:
0:12

Announcing MLX native Mac support for Moondream 3. Moondream running on Mac, Linux, Windows (free!): pip install moondream-station Details:

moondream

70,340 Aufrufe • vor 6 Monaten