Loading video...

Video Failed to Load

Go Home

DwarfStar with vision support for GLM 5.3 running on a MacBook m5max computer. The vision support is *not* quantized for max precision for now.

antirez's profile picture

antirez

79,989 subscribers

22,187 views • 5 days ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

DeepSeek v4 Flash experimental with vision running (fast) on an m5 max computer and analyzing an image. The implementation for Metal / CUDA / ROCm is finished, just doing the last tests today before releasing it.
1:19

DeepSeek v4 Flash experimental with vision running (fast) on an m5 max computer and analyzing an image. The implementation for Metal / CUDA / ROCm is finished, just doing the last tests today before releasing it.

antirez

59,411 views • 2 days ago

GLM 5.2, Q2_K routed experts (effectively ~2.6 bits) running with SSD streaming on an M5 Max 128GB computer.
1:31

GLM 5.2, Q2_K routed experts (effectively ~2.6 bits) running with SSD streaming on an M5 Max 128GB computer.

antirez

318,863 views • 2 months ago

GLM 5.2 flash Q2 (generated by myself with similar recipe of DS4 Flash of DwarfStar GGUF) running on an M5 Max with 128GB. The Q4 weights also work on tensor parallel inference in two M5 Max systems. Soon on GitHub. Still testing + CUDA + ROCm ...
0:39

GLM 5.2 flash Q2 (generated by myself with similar recipe of DS4 Flash of DwarfStar GGUF) running on an M5 Max with 128GB. The Q4 weights also work on tensor parallel inference in two M5 Max systems. Soon on GitHub. Still testing + CUDA + ROCm ...

antirez

28,103 views • 7 days ago

GLM 5.3 Max vs Fable 5 vs Qwen 3.8 Max vs Grok 4.6 GLM 5.3 is a massive jump over 5.2. Still not beating Fable 5 for me, but it’s way closer now. And vs Grok 4.6? I’d take GLM 5.3 pretty easily on this test.
0:33

GLM 5.3 Max vs Fable 5 vs Qwen 3.8 Max vs Grok 4.6 GLM 5.3 is a massive jump over 5.2. Still not beating Fable 5 for me, but it’s way closer now. And vs Grok 4.6? I’d take GLM 5.3 pretty easily on this test.

OmedTheVibeCoder

16,648 views • 20 days ago

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.
1:24

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.

antirez

171,478 views • 3 months ago

Here’s a first look at Adobe Premiere running natively on Apple Vision Pro. The visionOS app features a full spatial editing interface with floating panels, support for spatial clips, and depth controls for text. Available now on the App Store.
0:33

Here’s a first look at Adobe Premiere running natively on Apple Vision Pro. The visionOS app features a full spatial editing interface with floating panels, support for spatial clips, and depth controls for text. Available now on the App Store.

Justin Ryan

22,492 views • 1 month ago

I chopped the head off a broken screen'd M1 Max MacBook Pro to become a fancy keyboard with a mobile compute powerhouse for Vision Pro
0:47

I chopped the head off a broken screen'd M1 Max MacBook Pro to become a fancy keyboard with a mobile compute powerhouse for Vision Pro

Brad Lynch

3,156,854 views • 2 years ago

Running GLM-4.7-Flash with OpenCode locally on M4 Max MacBook Pro. 4-bit model runs at 82 tok/sec. Prefill will get ~4x faster with M5 Max MacBook Pro (~28 Jan). EXO will also support disaggregating prefill and decode across devices, e.g. DGX Spark.
0:43

Running GLM-4.7-Flash with OpenCode locally on M4 Max MacBook Pro. 4-bit model runs at 82 tok/sec. Prefill will get ~4x faster with M5 Max MacBook Pro (~28 Jan). EXO will also support disaggregating prefill and decode across devices, e.g. DGX Spark.

Alex Cheema

128,404 views • 7 months ago

Crazy prefill speed of DwarfStar running DeepSeek v4 PRO in the DGX Station (private branch for now) using techniques that leverage the peculiar RAM + VRAM mixed setup of the Station. 3000 t/s but even more can be reached.
0:23

Crazy prefill speed of DwarfStar running DeepSeek v4 PRO in the DGX Station (private branch for now) using techniques that leverage the peculiar RAM + VRAM mixed setup of the Station. 3000 t/s but even more can be reached.

antirez

62,001 views • 16 days ago

DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters.
4:15

DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters.

antirez

275,713 views • 3 months ago

Maximum support for the Iranian people — combined with maximum pressure on the regime — is the key to #Iran's future. Iranian Crown Prince Reza Pahlavi shared his vision at FDD's event, "Maximum Support: Operationalizing the Other Iran Policy." For more:
1:14

Maximum support for the Iranian people — combined with maximum pressure on the regime — is the key to #Iran's future. Iranian Crown Prince Reza Pahlavi shared his vision at FDD's event, "Maximum Support: Operationalizing the Other Iran Policy." For more:

FDD

98,686 views • 1 year ago

SNAPCHAT PAID $150,000,000 FOR LOOKSERY - STARTUP IN DEEP LEARNING COMPUTER VISION This 1-hour Stanford lecture on "DL for Computer Vision" will teach you how to build same project from scratch. Bookmark it & watch today. Stanford's full course (19 lectures) on Deep Learning for Computer Vision below ↓
1:02:47

SNAPCHAT PAID $150,000,000 FOR LOOKSERY - STARTUP IN DEEP LEARNING COMPUTER VISION This 1-hour Stanford lecture on "DL for Computer Vision" will teach you how to build same project from scratch. Bookmark it & watch today. Stanford's full course (19 lectures) on Deep Learning for Computer Vision below ↓

Movez

57,869 views • 3 months ago

"We (Democrats) have to provide a vision, and the vision is of a functional democracy. The vision is of a government that is not corrupt. The vision is of a government that is actually focused on solutions for people."
0:25

"We (Democrats) have to provide a vision, and the vision is of a functional democracy. The vision is of a government that is not corrupt. The vision is of a government that is actually focused on solutions for people."

George Conway ⚖️🇺🇸

41,301 views • 3 months ago

GLM-5.3 weights from Z.ai are live, with SGLang powering day-0 serving support! GLM-5.3 inherits every optimization and feature we battle-tested for GLM-5.2 over the past months. On real-world multi-turn agentic workloads, we measured 537.6 tok/s/user on NVFP4 and 413 tok/s/user on FP8, at BS=1 with TP8 on 8x B300. It's fast, efficient, and production-ready today on NVIDIA AI Blackwell and Hopper, and AI at AMD MI300X/325X/355X. We believe this is a big step forward for GLM-Series in agentic tasks, with a path toward mythos-class cyber capability. Can't wait to see what people build with GLM-5.3 and SGLang🚀 Cookbook👇
0:20

GLM-5.3 weights from Z.ai are live, with SGLang powering day-0 serving support! GLM-5.3 inherits every optimization and feature we battle-tested for GLM-5.2 over the past months. On real-world multi-turn agentic workloads, we measured 537.6 tok/s/user on NVFP4 and 413 tok/s/user on FP8, at BS=1 with TP8 on 8x B300. It's fast, efficient, and production-ready today on NVIDIA AI Blackwell and Hopper, and AI at AMD MI300X/325X/355X. We believe this is a big step forward for GLM-Series in agentic tasks, with a path toward mythos-class cyber capability. Can't wait to see what people build with GLM-5.3 and SGLang🚀 Cookbook👇

SGLang

97,743 views • 6 days ago

i made a computer vision system to monitor the situation - live webcam feed and roboflow RF-DETR for object detection - inputs are fed into SmolVLM which describes what it sees in one sentence - dataviz with vanilla js all running locally in real-time on my macbook air m2
0:27

i made a computer vision system to monitor the situation - live webcam feed and roboflow RF-DETR for object detection - inputs are fed into SmolVLM which describes what it sees in one sentence - dataviz with vanilla js all running locally in real-time on my macbook air m2

AA

72,555 views • 6 months ago

'Thanks to Mick Lynch of the RMT for his continued support. On 2nd May, vote for a Mayor with the vision to transform the North East and the experience to make it happen.
0:26

'Thanks to Mick Lynch of the RMT for his continued support. On 2nd May, vote for a Mayor with the vision to transform the North East and the experience to make it happen.

Jamie Driscoll

44,486 views • 2 years ago

Took the good work of the communtiy of DwarfStar and consolidating the Strix Halo support. It looks very good. More QA in the next days and the final merge soon.
1:20

Took the good work of the communtiy of DwarfStar and consolidating the Strix Halo support. It looks very good. More QA in the next days and the final merge soon.

antirez

17,493 views • 2 months ago