Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

DwarfStar with vision support for GLM 5.3 running on a MacBook m5max computer. The vision support is *not* quantized for max precision for now.

antirez's profile picture

antirez

79,989 subscribers

22,187 görüntüleme • 5 gün önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

DeepSeek v4 Flash experimental with vision running (fast) on an m5 max computer and analyzing an image. The implementation for Metal / CUDA / ROCm is finished, just doing the last tests today before releasing it.
1:19

DeepSeek v4 Flash experimental with vision running (fast) on an m5 max computer and analyzing an image. The implementation for Metal / CUDA / ROCm is finished, just doing the last tests today before releasing it.

antirez

59,411 görüntüleme • 2 gün önce

GLM 5.2, Q2_K routed experts (effectively ~2.6 bits) running with SSD streaming on an M5 Max 128GB computer.
1:31

GLM 5.2, Q2_K routed experts (effectively ~2.6 bits) running with SSD streaming on an M5 Max 128GB computer.

antirez

318,863 görüntüleme • 2 ay önce

GLM 5.2 flash Q2 (generated by myself with similar recipe of DS4 Flash of DwarfStar GGUF) running on an M5 Max with 128GB. The Q4 weights also work on tensor parallel inference in two M5 Max systems. Soon on GitHub. Still testing + CUDA + ROCm ...
0:39

GLM 5.2 flash Q2 (generated by myself with similar recipe of DS4 Flash of DwarfStar GGUF) running on an M5 Max with 128GB. The Q4 weights also work on tensor parallel inference in two M5 Max systems. Soon on GitHub. Still testing + CUDA + ROCm ...

antirez

28,103 görüntüleme • 7 gün önce

GLM 5.3 Max vs Fable 5 vs Qwen 3.8 Max vs Grok 4.6 GLM 5.3 is a massive jump over 5.2. Still not beating Fable 5 for me, but it’s way closer now. And vs Grok 4.6? I’d take GLM 5.3 pretty easily on this test.
0:33

GLM 5.3 Max vs Fable 5 vs Qwen 3.8 Max vs Grok 4.6 GLM 5.3 is a massive jump over 5.2. Still not beating Fable 5 for me, but it’s way closer now. And vs Grok 4.6? I’d take GLM 5.3 pretty easily on this test.

OmedTheVibeCoder

16,648 görüntüleme • 20 gün önce

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.
1:24

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.

antirez

171,478 görüntüleme • 3 ay önce

Here’s a first look at Adobe Premiere running natively on Apple Vision Pro. The visionOS app features a full spatial editing interface with floating panels, support for spatial clips, and depth controls for text. Available now on the App Store.
0:33

Here’s a first look at Adobe Premiere running natively on Apple Vision Pro. The visionOS app features a full spatial editing interface with floating panels, support for spatial clips, and depth controls for text. Available now on the App Store.

Justin Ryan

22,492 görüntüleme • 1 ay önce

I chopped the head off a broken screen'd M1 Max MacBook Pro to become a fancy keyboard with a mobile compute powerhouse for Vision Pro
0:47

I chopped the head off a broken screen'd M1 Max MacBook Pro to become a fancy keyboard with a mobile compute powerhouse for Vision Pro

Brad Lynch

3,156,854 görüntüleme • 2 yıl önce

Running GLM-4.7-Flash with OpenCode locally on M4 Max MacBook Pro. 4-bit model runs at 82 tok/sec. Prefill will get ~4x faster with M5 Max MacBook Pro (~28 Jan). EXO will also support disaggregating prefill and decode across devices, e.g. DGX Spark.
0:43

Running GLM-4.7-Flash with OpenCode locally on M4 Max MacBook Pro. 4-bit model runs at 82 tok/sec. Prefill will get ~4x faster with M5 Max MacBook Pro (~28 Jan). EXO will also support disaggregating prefill and decode across devices, e.g. DGX Spark.

Alex Cheema

128,404 görüntüleme • 7 ay önce

Crazy prefill speed of DwarfStar running DeepSeek v4 PRO in the DGX Station (private branch for now) using techniques that leverage the peculiar RAM + VRAM mixed setup of the Station. 3000 t/s but even more can be reached.
0:23

Crazy prefill speed of DwarfStar running DeepSeek v4 PRO in the DGX Station (private branch for now) using techniques that leverage the peculiar RAM + VRAM mixed setup of the Station. 3000 t/s but even more can be reached.

antirez

62,001 görüntüleme • 16 gün önce

DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters.
4:15

DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters.

antirez

275,713 görüntüleme • 3 ay önce

Maximum support for the Iranian people — combined with maximum pressure on the regime — is the key to #Iran's future. Iranian Crown Prince Reza Pahlavi shared his vision at FDD's event, "Maximum Support: Operationalizing the Other Iran Policy." For more:
1:14

Maximum support for the Iranian people — combined with maximum pressure on the regime — is the key to #Iran's future. Iranian Crown Prince Reza Pahlavi shared his vision at FDD's event, "Maximum Support: Operationalizing the Other Iran Policy." For more:

FDD

98,686 görüntüleme • 1 yıl önce

SNAPCHAT PAID $150,000,000 FOR LOOKSERY - STARTUP IN DEEP LEARNING COMPUTER VISION This 1-hour Stanford lecture on "DL for Computer Vision" will teach you how to build same project from scratch. Bookmark it & watch today. Stanford's full course (19 lectures) on Deep Learning for Computer Vision below ↓
1:02:47

SNAPCHAT PAID $150,000,000 FOR LOOKSERY - STARTUP IN DEEP LEARNING COMPUTER VISION This 1-hour Stanford lecture on "DL for Computer Vision" will teach you how to build same project from scratch. Bookmark it & watch today. Stanford's full course (19 lectures) on Deep Learning for Computer Vision below ↓

Movez

57,869 görüntüleme • 3 ay önce

"We (Democrats) have to provide a vision, and the vision is of a functional democracy. The vision is of a government that is not corrupt. The vision is of a government that is actually focused on solutions for people."
0:25

"We (Democrats) have to provide a vision, and the vision is of a functional democracy. The vision is of a government that is not corrupt. The vision is of a government that is actually focused on solutions for people."

George Conway ⚖️🇺🇸

41,301 görüntüleme • 3 ay önce

GLM-5.3 weights from Z.ai are live, with SGLang powering day-0 serving support! GLM-5.3 inherits every optimization and feature we battle-tested for GLM-5.2 over the past months. On real-world multi-turn agentic workloads, we measured 537.6 tok/s/user on NVFP4 and 413 tok/s/user on FP8, at BS=1 with TP8 on 8x B300. It's fast, efficient, and production-ready today on NVIDIA AI Blackwell and Hopper, and AI at AMD MI300X/325X/355X. We believe this is a big step forward for GLM-Series in agentic tasks, with a path toward mythos-class cyber capability. Can't wait to see what people build with GLM-5.3 and SGLang🚀 Cookbook👇
0:20

GLM-5.3 weights from Z.ai are live, with SGLang powering day-0 serving support! GLM-5.3 inherits every optimization and feature we battle-tested for GLM-5.2 over the past months. On real-world multi-turn agentic workloads, we measured 537.6 tok/s/user on NVFP4 and 413 tok/s/user on FP8, at BS=1 with TP8 on 8x B300. It's fast, efficient, and production-ready today on NVIDIA AI Blackwell and Hopper, and AI at AMD MI300X/325X/355X. We believe this is a big step forward for GLM-Series in agentic tasks, with a path toward mythos-class cyber capability. Can't wait to see what people build with GLM-5.3 and SGLang🚀 Cookbook👇

SGLang

97,743 görüntüleme • 6 gün önce

i made a computer vision system to monitor the situation - live webcam feed and roboflow RF-DETR for object detection - inputs are fed into SmolVLM which describes what it sees in one sentence - dataviz with vanilla js all running locally in real-time on my macbook air m2
0:27

i made a computer vision system to monitor the situation - live webcam feed and roboflow RF-DETR for object detection - inputs are fed into SmolVLM which describes what it sees in one sentence - dataviz with vanilla js all running locally in real-time on my macbook air m2

AA

72,555 görüntüleme • 6 ay önce

'Thanks to Mick Lynch of the RMT for his continued support. On 2nd May, vote for a Mayor with the vision to transform the North East and the experience to make it happen.
0:26

'Thanks to Mick Lynch of the RMT for his continued support. On 2nd May, vote for a Mayor with the vision to transform the North East and the experience to make it happen.

Jamie Driscoll

44,486 görüntüleme • 2 yıl önce

Took the good work of the communtiy of DwarfStar and consolidating the Strix Halo support. It looks very good. More QA in the next days and the final merge soon.
1:20

Took the good work of the communtiy of DwarfStar and consolidating the Strix Halo support. It looks very good. More QA in the next days and the final merge soon.

antirez

17,493 görüntüleme • 2 ay önce