Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

First kinda working implementation of GLM 5.2 in DwarfStar. Will take some time to be good enough, but it is a promising start. 433 GB GGUF file. M3 Ultra 512GB.

antirez's profile picture

antirez

69,411 subscribers

68,870 görüntüleme • 7 gün önce •via X (Twitter)

OyunEğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.
1:24

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.

antirez

169,025 görüntüleme • 1 ay önce

1-bit GLM-5.2 GGUF vs. Claude 4.8 Opus vs. GPT-5.5 We gave 3 models the same prompt and compared one-shot outputs. The 1-bit GLM-5.2 GGUF ran locally on a Mac Studio M3 Ultra with 256GB RAM at ~21.6 tok/s. Which output do you like best? GGUF:
0:21

1-bit GLM-5.2 GGUF vs. Claude 4.8 Opus vs. GPT-5.5 We gave 3 models the same prompt and compared one-shot outputs. The 1-bit GLM-5.2 GGUF ran locally on a Mac Studio M3 Ultra with 256GB RAM at ~21.6 tok/s. Which output do you like best? GGUF:

Unsloth AI

1,517,508 görüntüleme • 6 gün önce

I did it! It works! Using GLM-4.7-4bit with mlx_lm.server and opencode to fix real code locally! 🔥 Here single M3 Ultra 512GB, nex step phase will be 2 using Tensor Parallelism and then apply same changes to exo. Prefill is slow on a single machine, but generation is good.
1:44

I did it! It works! Using GLM-4.7-4bit with mlx_lm.server and opencode to fix real code locally! 🔥 Here single M3 Ultra 512GB, nex step phase will be 2 using Tensor Parallelism and then apply same changes to exo. Prefill is slow on a single machine, but generation is good.

Ivan Fioravanti ᯅ

44,000 görüntüleme • 5 ay önce

MLX GLM 5.2 Distributed on two M3 Ultra 512GB 🔥 One M3 Ultra: 18.8 tokens/sec Two M3 Ultra: 23.4 tokens/sec Context: - PR by Pedro Cuenca is still open and probably there is room for improvement: - basic generation test to measure decoding performance here, I will do a full context benchmarking once PR is more mature - nvfp4 quantization used - Video alternates standard speed and x20, with one Mac first and distributed later. Enjoy! 🙌🏻
0:35

MLX GLM 5.2 Distributed on two M3 Ultra 512GB 🔥 One M3 Ultra: 18.8 tokens/sec Two M3 Ultra: 23.4 tokens/sec Context: - PR by Pedro Cuenca is still open and probably there is room for improvement: - basic generation test to measure decoding performance here, I will do a full context benchmarking once PR is more mature - nvfp4 quantization used - Video alternates standard speed and x20, with one Mac first and distributed later. Enjoy! 🙌🏻

Ivan Fioravanti ᯅ

86,488 görüntüleme • 7 gün önce

M3 Ultra な MacStudio 512GB で Gemma-4-26B-A4B-itのモデルを試してみた。 (GGUF · UD-Q4_K_XL)
0:28

M3 Ultra な MacStudio 512GB で Gemma-4-26B-A4B-itのモデルを試してみた。 (GGUF · UD-Q4_K_XL)

ナル夫

19,129 görüntüleme • 2 ay önce

MiniMax M3 support added to mlx-vlm with MSA implementation! 🚀 Tested on M3 Ultra 512GB running at 24 tps with peak memory ~240GB. Now working on optimizing performance and adding ton of tests 💪 Model is here: PR is here:
0:24

MiniMax M3 support added to mlx-vlm with MSA implementation! 🚀 Tested on M3 Ultra 512GB running at 24 tps with peak memory ~240GB. Now working on optimizing performance and adding ton of tests 💪 Model is here: PR is here:

Ivan Fioravanti ᯅ

24,376 görüntüleme • 16 gün önce

I was skeptical about giving GLM-5.2 the task to build a super mario snes style game in a single HTML file so i ran the test on Opus and also on GLM-5.2 Opus didnt even try to make a game or made something but it wasn't a game GLM-5.2 one shotted a pretty functional game.. WILD
0:45

I was skeptical about giving GLM-5.2 the task to build a super mario snes style game in a single HTML file so i ran the test on Opus and also on GLM-5.2 Opus didnt even try to make a game or made something but it wasn't a game GLM-5.2 one shotted a pretty functional game.. WILD

Hermes Agent Tips

32,805 görüntüleme • 10 gün önce

GLM-5 runs with mlx-lm on a single 512GB M3 Ultra in Q4. It's quite good in my initial testing and pretty fast as well. It generated a highly functional space invaders game using 7.1k tokens at 15.4 tok/s and 419GB memory. Thanks to Gökdeniz Gülmez and Tarjei Mandt for the port.
1:11

GLM-5 runs with mlx-lm on a single 512GB M3 Ultra in Q4. It's quite good in my initial testing and pretty fast as well. It generated a highly functional space invaders game using 7.1k tokens at 15.4 tok/s and 419GB memory. Thanks to Gökdeniz Gülmez and Tarjei Mandt for the port.

Awni Hannun

60,446 görüntüleme • 4 ay önce

MiniMax M3 vs GLM-5.2 vs Kimi K2.7 in Lunar Lander contest! 🔥 Last test of the day before going back to learning & build phase with Local Models, Swift and Apple Core AI 💪 I took the opportunity to test the MiniMax Code app for macOS. Video below speeded up. Followed by Lunar Lander implementation from the various models. My ranking: 🥇 GLM 5.2 🥈 MiniMax M3 🥉 Kimi K2.7 Coding Prompt and final results in this gist:
0:42

MiniMax M3 vs GLM-5.2 vs Kimi K2.7 in Lunar Lander contest! 🔥 Last test of the day before going back to learning & build phase with Local Models, Swift and Apple Core AI 💪 I took the opportunity to test the MiniMax Code app for macOS. Video below speeded up. Followed by Lunar Lander implementation from the various models. My ranking: 🥇 GLM 5.2 🥈 MiniMax M3 🥉 Kimi K2.7 Coding Prompt and final results in this gist:

Ivan Fioravanti ᯅ

21,604 görüntüleme • 14 gün önce

MPJ: "Some of the shots and some of the ways they (the Nuggets) probably could have used me we had enough good players to where we could create a good shot in a different way...it is good to be able to kinda show what I'm capable of"
1:30

MPJ: "Some of the shots and some of the ways they (the Nuggets) probably could have used me we had enough good players to where we could create a good shot in a different way...it is good to be able to kinda show what I'm capable of"

Oh No He Didn't

158,270 görüntüleme • 5 ay önce

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.
0:53

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

Patrick J Kennedy

73,547 görüntüleme • 4 ay önce

GLM-5.2 delivers a substantial leap in app development capabilities, which also represent demanding long-horizon tasks. Results: - GLM-5.1: 21/70 - GLM-5.2: 48/70 - Claude Fable 5: 56/70 That's more than a twofold improvement from GLM-5.1 to GLM-5.2. These come from an internal benchmark of 35 challenging mobile development tasks, each run twice for a total of 70 trials. We measured task completion, defined as core features working without major issues.
0:45

GLM-5.2 delivers a substantial leap in app development capabilities, which also represent demanding long-horizon tasks. Results: - GLM-5.1: 21/70 - GLM-5.2: 48/70 - Claude Fable 5: 56/70 That's more than a twofold improvement from GLM-5.1 to GLM-5.2. These come from an internal benchmark of 35 challenging mobile development tasks, each run twice for a total of 70 trials. We measured task completion, defined as core features working without major issues.

Zixuan Li

294,978 görüntüleme • 10 gün önce

DS4 running on DGX Spark (GB10 / CUDA), private branch for now. 12 tokens/sec, the memory bandwidth is limited in this system, at 270GB/sec. But prefill is ways more alighed to M3 Max at ~200 t/s. I'll release when more mature, but it is almost sure that it will get merged.
1:34

DS4 running on DGX Spark (GB10 / CUDA), private branch for now. 12 tokens/sec, the memory bandwidth is limited in this system, at 270GB/sec. But prefill is ways more alighed to M3 Max at ~200 t/s. I'll release when more mature, but it is almost sure that it will get merged.

antirez

83,448 görüntüleme • 1 ay önce

GLM-5.2 is a bigger deal than you think. > what GLM-5.2 actually scores (0:46) > "it's just a rich person's toy" (4:27) > why GLM-5.2 matters even if you never run it (7:19)
12:25

GLM-5.2 is a bigger deal than you think. > what GLM-5.2 actually scores (0:46) > "it's just a rich person's toy" (4:27) > why GLM-5.2 matters even if you never run it (7:19)

Rob Hallam

19,906 görüntüleme • 7 gün önce

I haven’t tested it that rigorously but so far glm-5.2 is killing it at breaking out of agent sandboxes. This is so fun I had to make a video.
0:35

I haven’t tested it that rigorously but so far glm-5.2 is killing it at breaking out of agent sandboxes. This is so fun I had to make a video.

Zack Korman

20,951 görüntüleme • 12 gün önce

GLM-4.7-8bit (350GB) running at 19 toks/s on two M3 Ultra 512GB using Tensor Parallelism with EXO - MLX, versus 14 toks/s with single node. 🚀 Now context benchmarking & then OpenCode tests 🔥 Note: this is from sources, I had to change things to run it.
0:50

GLM-4.7-8bit (350GB) running at 19 toks/s on two M3 Ultra 512GB using Tensor Parallelism with EXO - MLX, versus 14 toks/s with single node. 🚀 Now context benchmarking & then OpenCode tests 🔥 Note: this is from sources, I had to change things to run it.

Ivan Fioravanti ᯅ

327,687 görüntüleme • 5 ay önce

DeepSeek-R1-0528-5bit on MLX pushing M3 Ultra 512GB to its limits! 501GB used mem visibile on mactop in the video! Context: 4K tokens Prompt: 190.29 t/s Gen: 11.37 t/s Peak Mem: 487.48 GB! THIS IS APPLE MLX!
0:20

DeepSeek-R1-0528-5bit on MLX pushing M3 Ultra 512GB to its limits! 501GB used mem visibile on mactop in the video! Context: 4K tokens Prompt: 190.29 t/s Gen: 11.37 t/s Peak Mem: 487.48 GB! THIS IS APPLE MLX!

Ivan Fioravanti ᯅ

102,949 görüntüleme • 1 yıl önce

we asked GLM 5.2 and Claude Opus 4.8 to find and fix the bugs in two different scripts while Opus 4.8 finished a few seconds faster in both tests, GLM 5.2 burned roughly 17k–38k fewer tokens and absolutely crushed it on cost, coming in 15x to 22x cheaper! Test 1: GLM 5.2 ($0.068) vs. Opus 4.8 ($1.06) Test 2: GLM 5.2 ($0.045) vs. Opus 4.8 ($1.02)
0:23

we asked GLM 5.2 and Claude Opus 4.8 to find and fix the bugs in two different scripts while Opus 4.8 finished a few seconds faster in both tests, GLM 5.2 burned roughly 17k–38k fewer tokens and absolutely crushed it on cost, coming in 15x to 22x cheaper! Test 1: GLM 5.2 ($0.068) vs. Opus 4.8 ($1.06) Test 2: GLM 5.2 ($0.045) vs. Opus 4.8 ($1.02)

GMI Cloud

84,994 görüntüleme • 3 gün önce

Trump’s tariffs will usher in a new world order. This is the start of living working and trading locally I think. It will take years but it’s going to happen. Globalisation is on its way out.
1:59

Trump’s tariffs will usher in a new world order. This is the start of living working and trading locally I think. It will take years but it’s going to happen. Globalisation is on its way out.

Jasmine Birtles

17,523 görüntüleme • 1 yıl önce

Running four high-level OpenCode agents + subagents with mlx_lm.server continuous batching and MiniMax M2.5 (6-bit). Fits easily on a 512GB M3 Ultra. Generation is quite fast. But prefill is still slow compared to cloud servers.
0:26

Running four high-level OpenCode agents + subagents with mlx_lm.server continuous batching and MiniMax M2.5 (6-bit). Fits easily on a 512GB M3 Ultra. Generation is quite fast. But prefill is still slow compared to cloud servers.

Awni Hannun

25,535 görüntüleme • 4 ay önce