
Vettan
@Vettan0 • 35,041 subscribers
Sharing fresh AI tools, real business stories, and new tech ideas that drive revenue || follow for more!
Videos

A 397B parameter model is running on somebody's desk right now. Not a datacenter. A desk. Qwen shipped their new 397B flagship and the usual take was instant: nobody runs this at home. One creator took that personally. He chained 4 DGX Sparks into a single cluster. 128GB of memory each, linked with the kind of networking you normally see in server rooms. The clip is 76 seconds. Watch the memory readouts around the halfway point. All boxes pinned at 112 of 119GB. The model barely fits, and it fits. Then he opens a terminal on his Mac and benchmarks the whole thing like it's a cloud API. Same commands, same endpoint, except the endpoint is 3 feet away. I paused twice on the monitoring screen just to count the memory bars. A year ago this class of model lived behind an API key and a waitlist. The datacenter lost its monopoly. It just doesn't know yet.
Vettan15,542 görüntüleme • 3 ay önce
Daha fazla içerik yok.