Atharva Ingle's banner

Atharva Ingle

@AtharvaIngle7 • 2,304 subscribers

AI @e2enetworks (building @jarvislabsai) , @kaggle Competition Expert, Dev Expert @weights_biases

Shorts

Got DeepSeek V4 Flash running on 2x H200s at 160–200 tok/s on JarvisLabsAI this speed is perfect for in the loop things I do with these agents. It feels like a GLM-5.2-class model with much lower hardware requirements. I’m going to daily-drive it for a bit and see how it performs, but first impressions are really good.

Got DeepSeek V4 Flash running on 2x H200s at 160–200 tok/s on JarvisLabsAI this speed is perfect for in the loop things I do with these agents. It feels like a GLM-5.2-class model with much lower hardware requirements. I’m going to daily-drive it for a bit and see how it performs, but first impressions are really good.

21,913 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

GLM 5.2 in pi running at almost 100 tokens/sec on 8x H200. I really like this model. It feels a frontier-level model you can actually self-host. Next step: squeeze more out of it by benchmarking different quants, tuning the stack, and figuring out the minimum GPU setup people can realistically run it on. Expect more on this soon.

GLM 5.2 in pi running at almost 100 tokens/sec on 8x H200. I really like this model. It feels a frontier-level model you can actually self-host. Next step: squeeze more out of it by benchmarking different quants, tuning the stack, and figuring out the minimum GPU setup people can realistically run it on. Expect more on this soon.

26,751 просмотров • 2 месяцев назад

Больше нет контента для загрузки