Loading video...
Video Failed to Load
Listening to Elon Musk tonight explain the engineering challenges that xAI faced when scaling up their massive GPU cluster in Memphis is him at his best. Breaking down the problems, coming up with creative solutions, using resources & products from his other companies to help solve issues, etc. Super interesting.
680,559 views • 1 year ago •via X (Twitter)
11 Comments

I’m sure he had a lot of help from some VERY talented people

Obviously. I'm just saying it's always really interesting to hear him talk about engineering. It's something he's very passionate about.

Elon Musk claims to have finished a 100,000-strong H100 cluster in four months. How likely is that?

Engineering and first principles are the core. And Elons ability to use technology from his other companies like Tesla is amazing. No one else can do this.

my fav part

Not to mention the ability to explain it in accessible terms… that’s not easy when the reality is much more complicated

Honestly, we don’t see many people like Elon (in history I mean). He seems to be working non-stop to make this a better world.

You can tell he is thinking about each step and figuring solutions on the fly. Elon is very calculated. Love seeing this.

This is why XAI is the leader in AI. They don't take NO for an answer.

The man's mind seems to run at the speed of light. You can just see the wheels spinning at all times. It doesn't turn off.

Elon is the most innovative person on the planet.
Related Videos
Sensitive content
Elon Musk gives the xAI scaling law behind Grok 5: 10x more compute, 2x intelligence "In terms of training Grok 5, you're scaling up your supercluster in Colossus in Memphis." "If you throw twice as much compute at it, do you get a 10% better model, do you get 100% better model?" "I think there's a natural logarithmic function associated with the amount of compute." "Say for argument's sake, 10x more compute will double the intelligence." "That still means that you go from 100 IQ to 200 IQ. Still pretty big deal." Most people talk about compute like it is a budget line. Elon is talking about it like a conversion rate: capital into intelligence. If that curve holds, the company with the biggest cluster is not just buying faster training runs. It is buying jumps in capability that feel discontinuous to everyone else. - Elon Musk (Elon Musk), CEO of xAI, on All-In Summit (The All-In Podcast)
Karl Mehta
86,191 views • 1 month ago

