0xSero's banner
0xSero's profile picture

0xSero

@0xSero • 75,097 subscribers

do you think like I do?

Shorts

This is running on a 16gb mac mini and 3090 Incredible model beats most of the mid stuff, qwen3.8-next-flash in exl3-3bits over half the model is being streamed from NVME it's 31 tok/s that is faster than Codex as of late.. for 2600$ I feel like my mission needs updating

This is running on a 16gb mac mini and 3090 Incredible model beats most of the mid stuff, qwen3.8-next-flash in exl3-3bits over half the model is being streamed from NVME it's 31 tok/s that is faster than Codex as of late.. for 2600$ I feel like my mission needs updating

17,260 views

Tibo, why? Why must the performance suck so bad.

Tibo, why? Why must the performance suck so bad.

122,193 views

100 tok/s on GLM-5.3-Flash, GLM-5.3 runs on the 6000s @ 80-180 tok/s I have not tried the Studio, I’m sure it’s an amazing machine especially if you are in the Mac world already. From a pure logistics POV the sparks use little power, make less noise, serve good model & tokens

100 tok/s on GLM-5.3-Flash, GLM-5.3 runs on the 6000s @ 80-180 tok/s I have not tried the Studio, I’m sure it’s an amazing machine especially if you are in the Mac world already. From a pure logistics POV the sparks use little power, make less noise, serve good model & tokens

69,259 views

Codex nooooooo I can't close this popup

Codex nooooooo I can't close this popup

135,941 views

Local AI: - can see reasoning - faster - will do whatever I want

Local AI: - can see reasoning - faster - will do whatever I want

21,334 views

Deepseek-v4-Flash running locally. Makes me dizzy, this is one of 6 sessions running rn

Deepseek-v4-Flash running locally. Makes me dizzy, this is one of 6 sessions running rn

37,219 views

Kitty litter, GLM-5.2 running locally. Have you seen 180 tok/s? Do you see how much room we have to push things forward? Most owners don’t know how to squeeze every token out of their GPUs

Kitty litter, GLM-5.2 running locally. Have you seen 180 tok/s? Do you see how much room we have to push things forward? Most owners don’t know how to squeeze every token out of their GPUs

22,222 views

GLM-5.2-REAP-NVFP4 This experiment I calibrated the model on 30,000+ samples of my agent sessions, tweets, writing, and codebases. Pretty charming, every dataset produced something different.

GLM-5.2-REAP-NVFP4 This experiment I calibrated the model on 30,000+ samples of my agent sessions, tweets, writing, and codebases. Pretty charming, every dataset produced something different.

22,535 views

The fact that a 284B parameter model is able to in a single 400K token session - ssh into my Homelab to find docs - ssh into lambda / prime intellect - rewrite reap to support the DS4 attention - download models & datasets - run tests to check it works

The fact that a 284B parameter model is able to in a single 400K token session - ssh into my Homelab to find docs - ssh into lambda / prime intellect - rewrite reap to support the DS4 attention - download models & datasets - run tests to check it works

22,762 views

If you've done work in OSS AI, or Local AI and want to have you and your company on State of Local AI - 2026 Get in touch, you'll be on as a coauthor with the companies and people who make this all possible. We moved release date to August 7th, we have 6 contributors so far

If you've done work in OSS AI, or Local AI and want to have you and your company on State of Local AI - 2026 Get in touch, you'll be on as a coauthor with the companies and people who make this all possible. We moved release date to August 7th, we have 6 contributors so far

13,869 views

Asking Codex (GPU) to find and kill Codex (Cerebras)

Asking Codex (GPU) to find and kill Codex (Cerebras)

24,131 views

What 4 concurrency on GLM sounds like. So gosh damn loud, open air frames are easier to build but so gosh darn loud

What 4 concurrency on GLM sounds like. So gosh damn loud, open air frames are easier to build but so gosh darn loud

11,809 views

Videos

0xSero's profile picture

Yours to keep.

0xSero

145,527 views • 2 months ago