Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Prince_Canuma's profile picture

Prince Canuma

22,357 subscribers

180,321 görüntüleme • 4 ay önce •via X (Twitter)

Bilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾
0:10

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾

Prince Canuma

74,448 görüntüleme • 2 yıl önce

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.
0:18

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.

Amos Gyamfi

15,704 görüntüleme • 1 ay önce

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!
0:19

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!

Ivan Fioravanti ᯅ

75,425 görüntüleme • 6 ay önce

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾
0:11

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾

Prince Canuma

24,057 görüntüleme • 1 yıl önce

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾
0:18

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾

Prince Canuma

29,952 görüntüleme • 1 yıl önce

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥
0:16

PaliGemma 2 running 100% local, on-device, powered by MLX 🔥

Vaibhav (VB) Srivastav

30,370 görüntüleme • 1 yıl önce

GLM 5.2 has just been released 🔥 Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.
0:11

GLM 5.2 has just been released 🔥 Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to the latest closed models, with weights you can download, quantize, distill, fine-tune, run.

Pedro Cuenca

83,329 görüntüleme • 1 ay önce

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)
0:15

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)

AA

48,020 görüntüleme • 4 ay önce

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx
0:18

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx

Prince Canuma

36,558 görüntüleme • 2 yıl önce

MLX MiniMax 2.5 running LOCALLY on a single M3 Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GB
0:11

MLX MiniMax 2.5 running LOCALLY on a single M3 Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GB

Ivan Fioravanti ᯅ

226,227 görüntüleme • 5 ay önce

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework
0:14

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Adrien Grondin

350,944 görüntüleme • 3 ay önce

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽
0:18

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Prince Canuma

24,953 görüntüleme • 7 ay önce

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)
0:15

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)

Awni Hannun

70,804 görüntüleme • 2 yıl önce

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI
0:15

Demo of 1-bit Bonsai 8B from PrismML running on-device on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AI

Adrien Grondin

160,693 görüntüleme • 4 ay önce

I love the ToolCall-15 so much, that I'm working on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!
0:17

I love the ToolCall-15 so much, that I'm working on it to add some features: - mlx and lm-studio providers - batch calling - config params to test temp, top-p, top-k, min-p - quantization display in UI model name Here running on M5 Max 128GB 🚀 Thanks stevibe you rock!

Ivan Fioravanti ᯅ

10,916 görüntüleme • 4 ay önce

Owen Caissie today: 3/4 - 2 doubles, a single, and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!
0:19

Owen Caissie today: 3/4 - 2 doubles, a single, and 3 RBIs 112.6 MPH Max EV Caissie is now batting .324 on the season and is running with his opportunity!

Andrew DeCeglie

17,197 görüntüleme • 3 ay önce

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.
0:17

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.

Ivan Fioravanti ᯅ

35,720 görüntüleme • 6 ay önce

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible
0:17

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Adrien Grondin

493,469 görüntüleme • 9 ay önce

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.
0:12

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

antirez

14,176 görüntüleme • 3 ay önce

Running the full GLM 4.7 (8-bit) on 2 x 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallel
0:12

Running the full GLM 4.7 (8-bit) on 2 x 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallel

Alex Cheema

156,668 görüntüleme • 7 ay önce