0xSero's banner

0xSero

@0xSero • 75,097 subscribers

do you think like I do?

Shorts

This is running on a 16gb mac mini and 3090 Incredible model beats most of the mid stuff, qwen3.8-next-flash in exl3-3bits over half the model is being streamed from NVME it's 31 tok/s that is faster than Codex as of late.. for 2600$ I feel like my mission needs updating

This is running on a 16gb mac mini and 3090 Incredible model beats most of the mid stuff, qwen3.8-next-flash in exl3-3bits over half the model is being streamed from NVME it's 31 tok/s that is faster than Codex as of late.. for 2600$ I feel like my mission needs updating

17,260 görüntüleme

Tibo, why? Why must the performance suck so bad.

Tibo, why? Why must the performance suck so bad.

122,213 görüntüleme

100 tok/s on GLM-5.3-Flash, GLM-5.3 runs on the 6000s @ 80-180 tok/s I have not tried the Studio, I’m sure it’s an amazing machine especially if you are in the Mac world already. From a pure logistics POV the sparks use little power, make less noise, serve good model & tokens

100 tok/s on GLM-5.3-Flash, GLM-5.3 runs on the 6000s @ 80-180 tok/s I have not tried the Studio, I’m sure it’s an amazing machine especially if you are in the Mac world already. From a pure logistics POV the sparks use little power, make less noise, serve good model & tokens

69,259 görüntüleme

Codex nooooooo I can't close this popup

Codex nooooooo I can't close this popup

135,941 görüntüleme

Local AI: - can see reasoning - faster - will do whatever I want

Local AI: - can see reasoning - faster - will do whatever I want

21,334 görüntüleme

Deepseek-v4-Flash running locally. Makes me dizzy, this is one of 6 sessions running rn

Deepseek-v4-Flash running locally. Makes me dizzy, this is one of 6 sessions running rn

37,219 görüntüleme

Kitty litter, GLM-5.2 running locally. Have you seen 180 tok/s? Do you see how much room we have to push things forward? Most owners don’t know how to squeeze every token out of their GPUs

Kitty litter, GLM-5.2 running locally. Have you seen 180 tok/s? Do you see how much room we have to push things forward? Most owners don’t know how to squeeze every token out of their GPUs

22,222 görüntüleme

GLM-5.2-REAP-NVFP4 This experiment I calibrated the model on 30,000+ samples of my agent sessions, tweets, writing, and codebases. Pretty charming, every dataset produced something different.

GLM-5.2-REAP-NVFP4 This experiment I calibrated the model on 30,000+ samples of my agent sessions, tweets, writing, and codebases. Pretty charming, every dataset produced something different.

22,535 görüntüleme

The fact that a 284B parameter model is able to in a single 400K token session - ssh into my Homelab to find docs - ssh into lambda / prime intellect - rewrite reap to support the DS4 attention - download models & datasets - run tests to check it works

The fact that a 284B parameter model is able to in a single 400K token session - ssh into my Homelab to find docs - ssh into lambda / prime intellect - rewrite reap to support the DS4 attention - download models & datasets - run tests to check it works

22,762 görüntüleme

If you've done work in OSS AI, or Local AI and want to have you and your company on State of Local AI - 2026 Get in touch, you'll be on as a coauthor with the companies and people who make this all possible. We moved release date to August 7th, we have 6 contributors so far

If you've done work in OSS AI, or Local AI and want to have you and your company on State of Local AI - 2026 Get in touch, you'll be on as a coauthor with the companies and people who make this all possible. We moved release date to August 7th, we have 6 contributors so far

13,869 görüntüleme

Asking Codex (GPU) to find and kill Codex (Cerebras)

Asking Codex (GPU) to find and kill Codex (Cerebras)

24,131 görüntüleme

What 4 concurrency on GLM sounds like. So gosh damn loud, open air frames are easier to build but so gosh darn loud

What 4 concurrency on GLM sounds like. So gosh damn loud, open air frames are easier to build but so gosh darn loud

11,809 görüntüleme

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Running a local agent 24/7 until it successfully gets paid for a security bug bounty Qwen3.8-27B - intel arc b70 - 262k context - vision - 60 tok/s decode - 1500-6000 tok/s prefill

Running a local agent 24/7 until it successfully gets paid for a security bug bounty Qwen3.8-27B - intel arc b70 - 262k context - vision - 60 tok/s decode - 1500-6000 tok/s prefill

191,423 görüntüleme • 18 gün önce

If you’re someone who has 1 or more expensive GPUs and you want to run bigger models without dropping 5 digits to get more cards 1. Buy M2 > PCIe gen 5 raid0 adapter 2. Buy 4x 1TB Samsung gen 5 NVMe You can get 60 GB/s on these fast enough to move data in and out of GPUs

If you’re someone who has 1 or more expensive GPUs and you want to run bigger models without dropping 5 digits to get more cards 1. Buy M2 > PCIe gen 5 raid0 adapter 2. Buy 4x 1TB Samsung gen 5 NVMe You can get 60 GB/s on these fast enough to move data in and out of GPUs

92,222 görüntüleme • 10 gün önce

Guess the model, it took about 2 hours. "Make me a full 3d render in blender and godot of San Francisco."

Guess the model, it took about 2 hours. "Make me a full 3d render in blender and godot of San Francisco."

29,762 görüntüleme • 3 gün önce

I interviewed DHH, the creator of Omarchy - The Agent Operating system + Ruby on Rails, one of the most important frameworks of our time. He's a father, builder, race-car driver, and such an inspiring person. One of the most positive people I've had the honor of meeting.

I interviewed DHH, the creator of Omarchy - The Agent Operating system + Ruby on Rails, one of the most important frameworks of our time. He's a father, builder, race-car driver, and such an inspiring person. One of the most positive people I've had the honor of meeting.

186,914 görüntüleme • 1 ay önce

You thought I was joking 🤓 Here's Deepseek-v4.1-Flash running on CPU + DDR4 with just a single RTX 3090 Wow Mia great quant (:

You thought I was joking 🤓 Here's Deepseek-v4.1-Flash running on CPU + DDR4 with just a single RTX 3090 Wow Mia great quant (:

99,299 görüntüleme • 16 gün önce

You think you could go back to 20 tok/s after this?

You think you could go back to 20 tok/s after this?

18,526 görüntüleme • 3 gün önce

Opus at home, at 200+ tok/s I love ZAI

Opus at home, at 200+ tok/s I love ZAI

201,663 görüntüleme • 1 ay önce

Qwen3.8-next-flash has been going for 5 hours!!! on 3x DGX Spark. Prompt: make a photorealistic 3d version on San Francisco. It's got drone views, skateboarding, driving and junping around the map. GLM-5.3 and Flash were both done in an hour and put out garbage wtf

Qwen3.8-next-flash has been going for 5 hours!!! on 3x DGX Spark. Prompt: make a photorealistic 3d version on San Francisco. It's got drone views, skateboarding, driving and junping around the map. GLM-5.3 and Flash were both done in an hour and put out garbage wtf

17,212 görüntüleme • 4 gün önce

I read Pi because the code is good, it's well thought through, it's simple, it works. Armin, and Mario share their experience building Pi, and how they're thinking through their roadmap. Such an honour to sit down with amazing engineers (:

I read Pi because the code is good, it's well thought through, it's simple, it works. Armin, and Mario share their experience building Pi, and how they're thinking through their roadmap. Such an honour to sit down with amazing engineers (:

33,845 görüntüleme • 11 gün önce

I just saw AGI, what the heck. Deepseek-v4-flash-0731 invented vision for itself, this is so incredible. Result in the next post:

I just saw AGI, what the heck. Deepseek-v4-flash-0731 invented vision for itself, this is so incredible. Result in the next post:

175,626 görüntüleme • 2 ay önce

3 months ago I said local AI will be competitive.

3 months ago I said local AI will be competitive.

104,452 görüntüleme • 1 ay önce

What local ai looks like at 2000$ Left: qwen3.8-27b in 4 bits on 1x 3090 w vision and full context right: same model running on intel arc b70

What local ai looks like at 2000$ Left: qwen3.8-27b in 4 bits on 1x 3090 w vision and full context right: same model running on intel arc b70

56,977 görüntüleme • 25 gün önce

Explaining what I think I understood about NVMe-PCIe adapters, I’m hoping i can make expert offloading for qwen3.6-35b or qwen3.8-flash-next working Might be able to get away with 8-12GB of VRAM although I’m just saying things at this point This bring down the cost to run tons

Explaining what I think I understood about NVMe-PCIe adapters, I’m hoping i can make expert offloading for qwen3.6-35b or qwen3.8-flash-next working Might be able to get away with 8-12GB of VRAM although I’m just saying things at this point This bring down the cost to run tons

38,607 görüntüleme • 17 gün önce

Learn about Harnesses! I went over all these - omp - pi - claude code - zcode - codex - warp This is what I am using everyday, I explain the difference and benefits of each.

Learn about Harnesses! I went over all these - omp - pi - claude code - zcode - codex - warp This is what I am using everyday, I explain the difference and benefits of each.

92,814 görüntüleme • 1 ay önce

Yours to keep.

Yours to keep.

145,527 görüntüleme • 2 ay önce

I told you Local AI will be competitive. 12 / 15 sessions running on my machine rn are local, DS4.1-Flash and GLM-5.3-Flash are better than anything else out there. So fast, don't complain, no rate limits. Why we gotta live like plebs?

I told you Local AI will be competitive. 12 / 15 sessions running on my machine rn are local, DS4.1-Flash and GLM-5.3-Flash are better than anything else out there. So fast, don't complain, no rate limits. Why we gotta live like plebs?

65,627 görüntüleme • 1 ay önce

GLM-5.2 Nvidia NVFP4 No pruning, no quantising, exact same model card. 110 tok/s single stream. My friend is a genius, holy fudge. Here's the repo, he got full DS4-Flash on a 5090 + DDR5 at 38.5 tok/s This is a breakthrough.

GLM-5.2 Nvidia NVFP4 No pruning, no quantising, exact same model card. 110 tok/s single stream. My friend is a genius, holy fudge. Here's the repo, he got full DS4-Flash on a 5090 + DDR5 at 38.5 tok/s This is a breakthrough.

158,188 görüntüleme • 3 ay önce

This is the best thing I've ever designed. I am so happy with how it turned out, I will be using my b70s Omarchy turns your pc into AI Free AI that works, battle tested - codex - claude code - pi / omp - crush - opencode If you have 12GB of Nvidia VRAM build a box and join

This is the best thing I've ever designed. I am so happy with how it turned out, I will be using my b70s Omarchy turns your pc into AI Free AI that works, battle tested - codex - claude code - pi / omp - crush - opencode If you have 12GB of Nvidia VRAM build a box and join

43,765 görüntüleme • 25 gün önce

Harness tierlist TLDR: Deepseek and Pi rock, antigravity is really bad

Harness tierlist TLDR: Deepseek and Pi rock, antigravity is really bad

24,760 görüntüleme • 13 gün önce

Deepseek-v4.1-flash can build 3d worlds like no other local model, it's incredible at this kind of task. 1 shot! 40 score on AA for this model is just wrong, it's so good. It's just weak in UI, and has about 200M token window before it goes off track

Deepseek-v4.1-flash can build 3d worlds like no other local model, it's incredible at this kind of task. 1 shot! 40 score on AA for this model is just wrong, it's so good. It's just weak in UI, and has about 200M token window before it goes off track

18,820 görüntüleme • 12 gün önce