Loading video...

Video Failed to Load

Go Home

Elon Musk: At Tesla, we basically had two different chip programs: one Dojo and one. Dojo on the training side, and then what we call AI4, it's just our inference chip The AI4 is what's currently shipping in all vehicles, and we're finalizing the design of AI5, which will...

21,223,192 views • 9 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Everything Elon said about Optimus at the All-In Summit today: • We’re finalizing the design of Optimus v3. That release is going to be a very remarkable robot. It will have manual dexterity comparable to a human, meaning a very complex hand, an AI mind that can navigate and comprehend reality, and will be made in very high volume. • Other robotics companies are missing those three very hard things. • I spend more mental cycles on Optimus than any other single thing. Solving real-world AI, all of the electrical-mechanical issues, the supply chain, and production challenges. • There is no supply chain for humanoid robots, so it has to be created from scratch, which requires a lot of vertical integration. None of the actuators in Optimus are available from an existing supply chain. • I think if successful, Optimus would be the biggest product ever. • The marginal cost of production, once we hit a million units per year, will probably be around $20,000. It depends on how much we spend on the AI chip in the robot, and we’ll need to achieve a lot of efficiencies in the actuators—26 actuators per arm (26 motors, gearboxes, and power electronics). The AI chip might cost $5,000 or $6,000, maybe more. At 1 million units a year, production cost will be $20,000, maybe $25,000. Price will be a function of demand. • Human hands have evolved to be incredibly sophisticated machines. Hands are a very first instrument. You can swing a baseball bat, thread a needle, play a piano or violin, and assemble a car. Hands are incredibly versatile instruments. Most of the muscles of the hands are actually in the forearm, and the hand is almost like a puppet. Human tendon evolution is incredibly good. The human hand has 27 or 28 degrees of freedom, depending on how you count it; it’s amazing. • In order to create a robot that can be a generalized humanoid, you must solve the “hands problem.” • Even though there are 10,000 to 20,000 electric motors out there, we couldn’t buy the actuators for any amount of money. We had to design every electric motor, gearbox, and controlling electronics from scratch, from first principles of physics. • Optimus is harder than developing any previous Tesla product, but not harder than Starship. • Right now, we’re struggling with the final design of the hardware, primarily the hand. The hands and forearm are the majority of the engineering difficulty of the entire robot. • If you want to do all the things that a human can do, it turns out you need a humanoid robot. If you want to do a subset, that’s much easier. Humans evolved to the shape and capability that we have for a good reason. There is value to having four fingers and a thumb; even the pinky is quite useful. Toes are much more of a question mark. • The AI5 inference chip will be 40 times better than AI4 by some measures. We know the limiting factors of the chip because the AI software and hardware teams work so closely. Effectively, the Tesla AI hardware and software teams are co-designing the chip. • The Softmax function on AI4 takes 40 steps in emulation mode, which will take only a few steps in AI5 natively. AI5 will easily handle mixed precision. • In terms of nominal raw compute, the AI5 inference chip has 8 times more compute, 9 times more memory, and 5 times more memory bandwidth compared to AI4. Because we’re addressing some core limitations and optimizations at the silicon level, we’re able to realize 40x improvements.

The Humanoid Hub

238,877 views • 11 months ago

ELON MUSK: We believe the AI5 chip will be roughly comparable performance to an NVIDIA Blackwell, and at much less than 10% of the cost Transcription: I'm super hardcore on chips right now as you may be able to tell. I have chips on the brain. I dream about chips, Literally! Because in order to have a functional robot, you have to have a great AI chip. And it needs to be an inexpensive chip and it needs to be very power efficient So we think we believe the AI5 chip will be probably about a third of the power of say something like a Blackwell, an NVIDIA Blackwell, which is a great chip, for roughly comparable performance. And much less than 10% of the cost. This is a chip that is very much optimized for the Tesla AI software stack. So it's not meant to be a general purpose chip, it's meant to be an amazing chip for the Tesla AI software And I mean a couple of things that I think make... like how is Tesla able to achieve such an improvement? I think it is because we are specialized. We're not trying to... you know, NVIDIA has to serve the superset of all past and future customers. So all of their requirements, all of the software that they've written has to work, which is a very difficult problem. Whereas we just need to make it work for our software. And so we're able to simplify the chip dramatically And then we also, I think we're unique in this, but like we have an integer-based system. And integer operations are fundamentally more efficient than floating point operations. So we can do floating point, but the vast majority of our inference is done in integer. Which is, if you're familiar with sort of logic gates, the simplicity of integer... it's integer is much more power efficient, much more silicon efficient, but you have to, you actually have to train for integer inference, which everyone else is training for floating point. That's kind of like a niche technical detail, but it's actually very important. So, yeah, this is going to be a great chip So this chip will be made in basically in four places: TSMC Taiwan, Samsung Korea, TSMC Arizona, and TSMC Texas. And we already know what improvements to make for AI6. So I'm hopeful that we can within less than a year of AI5 starting production, we can actually transition in the same fab to AI6 and double all of the performance metrics

X Freeze

305,109 views • 9 months ago

Elon Musk on Grok: “I think an AI that is sort of SpaceX’s baby will be a very good AI. I think SpaceX is a collection of some of the very best humans on Earth, both in capability and morality and goodness, and I think we want to have an AI that is born of that capability and that morality and that goodness. I think that’s very, very important. So I’d like to encourage people to help out, actually, with the AI hardware on the ground and the AI software and, of course, with the AI satellites. Solar is going to be a very important part of that. The TerraFab will be a very important part of that, but we must also succeed on the software front, and we’re going to be training Grok on the sum total of all SpaceX information. So in a way, it will be trained on you. You will effectively be the parents of the AI. It will inherit your thoughts and ideas and beliefs, and I think that’s a good thing. So, yeah, we’ve got to win here on the AI hardware and the AI software. That maybe is the most important message. I think that is actually the most important message I wanted to convey today is that we must win on AI because the future is overwhelmingly AI and robots. So we won’t ultimately be able to control the AI. It’ll be too smart for that. But just like if you have a child that is a super genius child, you can still instill in that child the values and beliefs that you think are good and right. And so that’s why it’s incredibly important that we succeed with Grok. So, yeah, well, Grok 4.5 you’ve tried probably. We’ve got 4.6 coming out in about a week. And then 4.7 should be really pretty special. So I’d like to encourage everyone at SpaceX to use AI and to make it better.”

DogeDesigner

63,600 views • 8 days ago

ELON MUSK: The future is fundamentally AI and Robots. “Our AI revenue will exceed all other SpaceX revenue probably in September, like next month, and will significantly exceed all other SpaceX revenue in the fourth quarter. So, AI has become an extremely important part of SpaceX’s future. I think it’s actually vital that we succeed in AI, not just in hardware, but also in software. So, yeah, the future is fundamentally AI and robots. Assuming civilization continues to progress, I think that AI will probably, the amount of digital intelligence will probably be more than a trillion times the amount of biological intelligence. So, not sort of equal to human intelligence, but probably a trillion times higher. I’d say a billion times higher than the amount of artificial intelligence that we have today. I’d say a billion times is an easy prediction, and probably a trillion. So, as you harness more and more of the sun’s energy, the ability to turn that into intelligence is fundamentally a digital computer thing, because it’s pretty hard for humans to go live in deep space without any support. I mean, some of the math is interesting to think about, which is that if you increased civilizational energy usage, the amount of energy that we have harnessed as a civilization by a factor of a million, you would still be using much less than one millionth of the sun’s energy. Now, most of this is in deep space, obviously, but the future is very much AI, very much, and I suppose it was always going to be that way. But it’s important that we have an AI that cares about humanity, that fosters humanity and helps take us to other planets and other star systems, and this is why I think it’s essential that SpaceX succeed, not just with AI hardware, but also with AI software.”

DogeDesigner

67,247 views • 8 days ago

Etched is deploying two new technologies in chip design: low-voltage inference and cluster-scale memory. CEO Gavin Uberti says they'll make their chips much more power-efficient and way, way faster than today's leading GPUs. He breaks it down: "We looked at a lot of early research directions, and we realized the key things that models need are way more compute and way faster memory." "If you think about inference, there are two key parts: prefill and decode. For prefill, it's a compute-bound problem. You need to have more FLOPS, more operations per second on each of your chips." "On our GPU, the bottleneck's actually thermals. You can't really run a GPU at more than around 50% of what it could theoretically do, or it'll melt." "So we're using a new technology today called low-voltage inference to try to solve this problem. You bring the voltage of the chip down dramatically, which allows us to have way, way better efficiency in terms of how much power is drawn per unit of math, and thus fit way way more flops onto the chip..." "For decode, it's all about bandwidth. Not just bandwidth on a chip, but bandwidth across your cluster. That's why we have this technology we call cluster-scale memory. It reduces the amount of time it takes to communicate from one chip to another dramatically." "As a result we can go use all of our HBM, HBM bandwidth, SRAM, SRAM bandwidth, and our scale-up domain as a single coherent pool. And that means if you're a user, you can go get much faster tokens per second, while still keeping your costs low."

TBPN

20,404 views • 1 month ago