Loading video...

Video Failed to Load

Go Home

Everything Elon said about Optimus at the All-In Summit today: • We’re finalizing the design of Optimus v3. That release is going to be a very remarkable robot. It will have manual dexterity comparable to a human, meaning a very complex hand, an AI mind that can navigate and...

238,877 views • 11 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Elon Musk: At Tesla, we basically had two different chip programs: one Dojo and one. Dojo on the training side, and then what we call AI4, it's just our inference chip The AI4 is what's currently shipping in all vehicles, and we're finalizing the design of AI5, which will be an immense jump from AI4. By some metrics, the improvement in AI5 will be 40 times better than AI4. So not 40%, 40 times This is because we work so closely at a very fine-grained level on the AI software and the AI hardware. So we know exactly where the limiting factors are. And so effectively the AI hardware and software teams are co-designing the chip Compared to the worst limitation on AI4, which is running the SoftMax operation, we currently have to run SoftMax in around 40 steps in emulation mode, whereas that'll just be done in a few steps natively in AI5 AI5 will also be able to easily handle mixed precision models, so you don't have it, it'll dynamically handle mixed precision. There's a bunch of sort of technical stuff that AI5 will do a lot better In terms of nominal raw compute, it's eight times more compute, about nine times more memory, and roughly five times more memory bandwidth But because we're addressing some core limitations in AI4, you multiply that 8x compute improvement by another 5x improvement because of optimization at a very fine-grained silicon level of things that are currently suboptimal in AI4, that's where you get the 40x improvement

X Freeze

21,223,192 views • 9 months ago

ELON MUSK: We believe the AI5 chip will be roughly comparable performance to an NVIDIA Blackwell, and at much less than 10% of the cost Transcription: I'm super hardcore on chips right now as you may be able to tell. I have chips on the brain. I dream about chips, Literally! Because in order to have a functional robot, you have to have a great AI chip. And it needs to be an inexpensive chip and it needs to be very power efficient So we think we believe the AI5 chip will be probably about a third of the power of say something like a Blackwell, an NVIDIA Blackwell, which is a great chip, for roughly comparable performance. And much less than 10% of the cost. This is a chip that is very much optimized for the Tesla AI software stack. So it's not meant to be a general purpose chip, it's meant to be an amazing chip for the Tesla AI software And I mean a couple of things that I think make... like how is Tesla able to achieve such an improvement? I think it is because we are specialized. We're not trying to... you know, NVIDIA has to serve the superset of all past and future customers. So all of their requirements, all of the software that they've written has to work, which is a very difficult problem. Whereas we just need to make it work for our software. And so we're able to simplify the chip dramatically And then we also, I think we're unique in this, but like we have an integer-based system. And integer operations are fundamentally more efficient than floating point operations. So we can do floating point, but the vast majority of our inference is done in integer. Which is, if you're familiar with sort of logic gates, the simplicity of integer... it's integer is much more power efficient, much more silicon efficient, but you have to, you actually have to train for integer inference, which everyone else is training for floating point. That's kind of like a niche technical detail, but it's actually very important. So, yeah, this is going to be a great chip So this chip will be made in basically in four places: TSMC Taiwan, Samsung Korea, TSMC Arizona, and TSMC Texas. And we already know what improvements to make for AI6. So I'm hopeful that we can within less than a year of AI5 starting production, we can actually transition in the same fab to AI6 and double all of the performance metrics

X Freeze

305,109 views • 9 months ago

Everything Elon said about Optimus on the Q4 2024 earnings call: ⦿ I see a path for Tesla to be the most valuable company in the world, possibly bigger than the next five companies combined, overwhelmingly due to autonomous vehicles and autonomous humanoid robots. ⦿ The training compute needed for Optimus will ultimately probably be 10× what is needed for cars. Humanoids likely have 1,000× more useS than a car, which doesn't mean training scales by 1,000×, but probably close to 10×. The training compute will scale progressively as Optimus becomes more productive. ⦿ Long-term, Optimus has the potential to generate $10 trillion in revenue. In that scenario, we can support a lot of training compute. Even $500 billion in training compute is a good deal (chuckles). ⦿ There's a lot of uncertainty with timing because several aspects are being iterated simultaneously. The internal plan is for roughly 10,000 robots to be built this year, but we'll more likely produce several thousand. ⦿ I'm confident those several thousand robots will be able to do useful things. ⦿ The lessons from Production V1 will inform the changes in Production V2, which we expect to launch around mid-next year. ⦿ Our goal, aspirationally, is to ramp 10× every year, but perhaps we end up with 5× growth per year. With that kind of growth, it won't be many years before we're making 100 million robots a year. ⦿ The off-the-shelf components didn't work well, so we had to design everything in-house, including the most sophisticated hand ever made. Optimus will be able to play a piano and thread a needle. ⦿ My long-term prediction is that Optimus will overwhelmingly be the value of the company. ⦿ Optimus is not design-locked. It is rapidly evolving in a good direction. Tesla has by far the best humanoid robotics engineers in the world. Tesla also has all the other necessary ingredients: battery pack, power electronics, charging, communications, real-world AI, and the ability to scale production. ⦿ What other companies are missing is real-world AI and the ability to scale to millions of units a year. ⦿ This year, we aim to use Optimus internally at Tesla. We can easily use several thousand robots at Tesla for repetitive tasks, such as loading sheet metal at the welding line. ⦿ The Production V1 line is roughly 1,000 units per month. The Production V2, launching around mid-next year, will be for 10k units per month. The line after that will be for 100k units a month. Of course, it takes time for any given line to reach its maximum potential. ⦿ A very rough guess: we'll start delivering Optimus to companies outside of Tesla in the second half of 2026. The ramp is going to be exponential, and demand will not be a problem. ⦿ Once we're above 1 million units per year, the production cost of Optimus will be less than $20,000. Its total mass and complexity are much lower than a car. At a similar production volume to the Model Y, Optimus should be about half the cost of a Model Y. ⦿ The price is a different matter than cost. The price of Optimus will be set by market demand. [This is by far the longest Elon has ever spent discussing Optimus on an earnings call.]

The Humanoid Hub

96,475 views • 1 year ago