Video wird geladen...
Video konnte nicht geladen werden
GLM 5.3 Flash on 2x RTX PRO 6000s
49,494 Aufrufe • vor 1 Tag •via X (Twitter)
38 Kommentare

@NVIDIAAI If I'm reading the new recipe right, there's nothing like spill? That was a game-changer for those of us who use multiple long-running chats...

@NVIDIAAI This is the new recipe yes.

@NVIDIAAI Okay, but slow the video down 😆

@NVIDIAAI hahaha yeah need to do 0.5x

@NVIDIAAI

@NVIDIAAI Zoomy, zoomy

@NVIDIAAI @davekennedy end game

@TechMDAI @NVIDIAAI @MiaAI_lab how fast would she be if you had (4)? @NVIDIAAI

@TechMDAI @NVIDIAAI Need this xd

@NVIDIAAI You don’t need frontier models at this speed

@TechMDAI @NVIDIAAI That’s a serious stack. What throughput and quality are you achieving?

@NVIDIAAI legal models are getting really capable of recent , love the speed and direction at which they move in

@NVIDIAAI dam thats fast

@NVIDIAAI That's a recipe I'd like to see!

@NVIDIAAI Going to fire up a 0.8B on a 3060 so I can feel something

@NVIDIAAI 👀

@NVIDIAAI I think you're seeing why modern agentic UIs don't generally render token-by-token anymore lol.

@NVIDIAAI 🥲 My hope is that the project I'm building with "frontier" models provides me with the financial freedom to be more like Mia. Very cool stuff!

@NVIDIAAI If only I had 50k to dump on a computer lol.

@NVIDIAAI Crazy 😳

@NVIDIAAI How many simultaneous streams it supports at 1M context window?

@NVIDIAAI ok how ?

@NVIDIAAI That's so fast! How does it compare to 2xGB10 for speed and intelligence?

@NVIDIAAI Wanna see how this looks in @OpenWebUI with open terminal

@NVIDIAAI That's crisp. One can dream

@NVIDIAAI hyperspeed

@NVIDIAAI Side by sides with dsv4f 0731 would be awesome... I think i need to try this GLM

@NVIDIAAI Wow! Wtf?! That's crazy!

@NVIDIAAI That's awesome. I saw you said you use hermes as well. Is yours dumb too? 😂 If not, would like to know your setup.

@NVIDIAAI Dang. That’s amazing!

@NVIDIAAI good stuff. Now show them how you can get 8+ concurrent connections with multimillion deep KV caches with minimal impact to TPS. it's in 1.2.2 of TensorFold now.

@NVIDIAAI What is this UI / platform ?

@NVIDIAAI my harness, unreleased yet

@NVIDIAAI What's the actual tok/s? The video doesn't give any useful info.

@NVIDIAAI 🔥🔥🔥🔥

@NVIDIAAI Sexy

@NVIDIAAI Damn... Are you working on any single 6000 recipes?

@TechMDAI @NVIDIAAI Crazy! 🔥🔥
