正在加载视频...

视频加载失败

返回首页

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Prince_Canuma's profile picture

Prince Canuma

22,357 subscribers

180,321 次观看 • 4 个月前 •via X (Twitter)

科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾
0:10

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾

Prince Canuma

74,448 次观看 • 2 年前

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.
0:18

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.

Amos Gyamfi

15,932 次观看 • 1 个月前

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!
0:19

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!

Ivan Fioravanti ᯅ

75,425 次观看 • 6 个月前

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾
0:18

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾

Prince Canuma

29,952 次观看 • 1 年前

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥
0:16

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥

Vaibhav (VB) Srivastav

30,373 次观看 • 1 年前

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)
0:15

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)

AA

48,020 次观看 • 5 个月前

GLM 5.2 has just been released 🔥 Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.
0:11

GLM 5.2 has just been released 🔥 Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.

Pedro Cuenca

83,401 次观看 • 2 个月前

MLX MiniMax 2.5 running LOCALLY on a single M3 Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GB
0:11

MLX MiniMax 2.5 running LOCALLY on a single M3 Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GB

Ivan Fioravanti ᯅ

226,257 次观看 • 6 个月前

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx
0:18

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx

Prince Canuma

36,558 次观看 • 2 年前

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework
0:14

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Adrien Grondin

351,153 次观看 • 4 个月前

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)
0:15

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)

Awni Hannun

70,804 次观看 • 2 年前

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽
0:18

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Prince Canuma

24,953 次观看 • 8 个月前

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI
0:15

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

Adrien Grondin

160,895 次观看 • 4 个月前

I love the ToolCall-15 so much, that I'm working on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!
0:17

I love the ToolCall-15 so much, that I'm working on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!

Ivan Fioravanti ᯅ

10,916 次观看 • 4 个月前

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.
0:17

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.

Ivan Fioravanti ᯅ

35,720 次观看 • 6 个月前

Owen Caissie today: 3/4 - 2 doubles, a single, and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!
0:19

Owen Caissie today: 3/4 - 2 doubles, a single, and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!

Andrew DeCeglie

17,197 次观看 • 4 个月前

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible
0:17

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Adrien Grondin

493,561 次观看 • 10 个月前

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.
0:12

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

antirez

14,220 次观看 • 3 个月前

Running the full GLM 4.7 (8-bit) on 2 x 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallel
0:12

Running the full GLM 4.7 (8-bit) on 2 x 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallel

Alex Cheema

156,668 次观看 • 7 个月前