Joe Muller's banner

Joe Muller

@BosonJoe • 7,125 subscribers

Local AI enthusiast, suffering from token sickness 2x DGX Spark, 2x RTX 5090

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

GLM 5.2 @ 19.8 tok/sec on 2 DGX Sparks ⚡️ I switched to a dspark draft model with K=2 (model from Red Hat AI) Acceptance is ~68% because the drafter was trained with the full FP8 model... Next step is to fine tune the drafter so acceptance on this super quant goes up

GLM 5.2 @ 19.8 tok/sec on 2 DGX Sparks ⚡️ I switched to a dspark draft model with K=2 (model from Red Hat AI) Acceptance is ~68% because the drafter was trained with the full FP8 model... Next step is to fine tune the drafter so acceptance on this super quant goes up

73,297 görüntüleme • 2 ay önce

We did it. GLM 5.2 running on 2 DGX Sparks at 4.1 tok/sec. 704GB (FP8) down to 192GB using 2-bit expert quantization. Frontier intelligence wants to come home.

We did it. GLM 5.2 running on 2 DGX Sparks at 4.1 tok/sec. 704GB (FP8) down to 192GB using 2-bit expert quantization. Frontier intelligence wants to come home.

32,953 görüntüleme • 2 ay önce

#Flutter Architect v1 is out! I built a developer tool using #GithubCopilot to make Flutter development even faster. - Quickly build nested widgets - Click to copy common snippets - Create multi-child layouts

#Flutter Architect v1 is out! I built a developer tool using #GithubCopilot to make Flutter development even faster. - Quickly build nested widgets - Click to copy common snippets - Create multi-child layouts

30,273 görüntüleme • 3 yıl önce

Daha fazla içerik yok.