Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

First time I have seen $NVDA's Jensen having some issues in explaining $NVDA's moat vs ASICs like $GOOGL TPUs and $AMZN Trainium. Why does Anthropic use TPUs and Trainium? Jensen: "Anthropic is a unique instance, not a trend" I really got to tip my hat to Dwarkesh Patel; he... show more

Rihard Jarc

81,045 subscribers

347,400 views • 4 months ago •via X (Twitter)

News & Politics Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

$AMZN having a market cap $1.5T lower than $GOOGL makes no sense. $AMZN is the only big tech company that fully designs its own in-house ASIC chips, without relying on Broadcom $AVGO like $GOOGL does for its TPUs. On top of that, its Trainium chips are 40% more price-performance efficient than leading $NVDA GPUs. And let’s not forget — $AMZN owns more than 15% of Anthropic. $AMZN is such an obvious play.

$AMZN having a market cap $1.5T lower than $GOOGL makes no sense. $AMZN is the only big tech company that fully designs its own in-house ASIC chips, without relying on Broadcom $AVGO like $GOOGL does for its TPUs. On top of that, its Trainium chips are 40% more price-performance efficient than leading $NVDA GPUs. And let’s not forget — $AMZN owns more than 15% of Anthropic. $AMZN is such an obvious play.

Daniel

249,429 views • 6 months ago

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

TBPN

36,474 views • 3 months ago

$NVDA $GOOGL Jensen responds to concerns about Google’s TPUs: “We’ve been competing against ASICs for an long time. Google has had them for a long time and they do a great job. What Nvidia does is much more versatile. We are everywhere. We are in every cloud. The Nvidia opportunity is just much larger.” Morgan Stanley put out a report today saying that they forecast Alphabet selling approximately 12 million TPUs over 2027–2028, nearly doubling its prior estimate of ~6.2 million,where every 500,000 TPUs sold could add ~$13 billion in revenue and $0.40 to $GOOGL earnings per share in 2027 alone.

$NVDA $GOOGL Jensen responds to concerns about Google’s TPUs: “We’ve been competing against ASICs for an long time. Google has had them for a long time and they do a great job. What Nvidia does is much more versatile. We are everywhere. We are in every cloud. The Nvidia opportunity is just much larger.” Morgan Stanley put out a report today saying that they forecast Alphabet selling approximately 12 million TPUs over 2027–2028, nearly doubling its prior estimate of ~6.2 million,where every 500,000 TPUs sold could add ~$13 billion in revenue and $0.40 to $GOOGL earnings per share in 2027 alone.

amit

356,996 views • 8 months ago

$AMZN CEO Andy Jassy reveals customers want Trainium chips outside AWS and says there's a real chance Amazon sells them that way. "On the question about selling Trainium, we're quite excited about what's happening in our chips business." "As I mentioned earlier, it's over $25 billion in annual revenue at this point. We think we have the leading price performance chip in both the AI space with Trainium and in the CPU space with Graviton." "The fact that we have multi-year, multi-gigawatt commitments from the two largest AI labs, Anthropic and OpenAI, and more and more companies, as I mentioned in my opening comments, using Trainium is exciting and promising." "And we just have an incredible amount of demand for Trainium. So there are a lot of customers who are very excited about using it in the form that we're providing right now." "We do have an increasing number of customers who are interested in us providing the Trainium chips to them separate from our cloud. And we're actively having those conversations and exploring. And I expect there's a real chance we'll do that in the future."

$AMZN CEO Andy Jassy reveals customers want Trainium chips outside AWS and says there's a real chance Amazon sells them that way. "On the question about selling Trainium, we're quite excited about what's happening in our chips business." "As I mentioned earlier, it's over $25 billion in annual revenue at this point. We think we have the leading price performance chip in both the AI space with Trainium and in the CPU space with Graviton." "The fact that we have multi-year, multi-gigawatt commitments from the two largest AI labs, Anthropic and OpenAI, and more and more companies, as I mentioned in my opening comments, using Trainium is exciting and promising." "And we just have an incredible amount of demand for Trainium. So there are a lot of customers who are very excited about using it in the form that we're providing right now." "We do have an increasing number of customers who are interested in us providing the Trainium chips to them separate from our cloud. And we're actively having those conversations and exploring. And I expect there's a real chance we'll do that in the future."

Fireside Alpha

11,669 views • 16 days ago

Jensen to AI Leaders: “We have to be far more thoughtful” when communicating to the public Jensen Huang: “(AI) is not a biological being. It is not alien. It is not conscious. It is computer software.” “We say things like, ‘We don't understand it at all.’ It is not true. We understand a lot of things about this technology.” Chamath: “If you were in the seat in the boardroom of Anthropic over that whole scuttlebutt with the Department of War, what do you think you would've told Dario and that team to do, maybe, differently to try to change some of this outcome and some of this perception?” Jensen: “The first thing that I would say about Anthropic is, first of all, the technology is incredible. We are a large consumer of Anthropic technology.” “The desire to warn people about the capability of the technology is also really terrific.” “We just have to make sure that we understand that the world has a spectrum, and that warning is good, scaring is less good because this technology is too important to us.” “I think that it is fine to predict the future, but we need to be a little bit more circumspect. We need to have a little bit more humility, that, in fact, we can't completely predict the future.” “And to say things that are quite extreme, quite catastrophic, that there's no evidence of it happening, could be more damaging than people think.” “And of course we are technology leaders.” “There was a time when nobody listened to us, but now because technology is so important in the social fabric, such an important industry, so important to national security, our words do matter.” “And I think we have to be much more circumspect, we have to be more moderate, we have to be more balanced, we have to be far more thoughtful.”

Jensen to AI Leaders: “We have to be far more thoughtful” when communicating to the public Jensen Huang: “(AI) is not a biological being. It is not alien. It is not conscious. It is computer software.” “We say things like, ‘We don't understand it at all.’ It is not true. We understand a lot of things about this technology.” Chamath: “If you were in the seat in the boardroom of Anthropic over that whole scuttlebutt with the Department of War, what do you think you would've told Dario and that team to do, maybe, differently to try to change some of this outcome and some of this perception?” Jensen: “The first thing that I would say about Anthropic is, first of all, the technology is incredible. We are a large consumer of Anthropic technology.” “The desire to warn people about the capability of the technology is also really terrific.” “We just have to make sure that we understand that the world has a spectrum, and that warning is good, scaring is less good because this technology is too important to us.” “I think that it is fine to predict the future, but we need to be a little bit more circumspect. We need to have a little bit more humility, that, in fact, we can't completely predict the future.” “And to say things that are quite extreme, quite catastrophic, that there's no evidence of it happening, could be more damaging than people think.” “And of course we are technology leaders.” “There was a time when nobody listened to us, but now because technology is so important in the social fabric, such an important industry, so important to national security, our words do matter.” “And I think we have to be much more circumspect, we have to be more moderate, we have to be more balanced, we have to be far more thoughtful.”

The All-In Podcast

57,581 views • 5 months ago

“I am going to probably use $300M of Anthropic this year at Salesforce.” - Marc Benioff “ These coding agents are awesome. Anthropic is awesome. Coding, everything's going to be cheaper to make, it's more efficient. I can do things that I just could not do before. I can go faster than ever before. I can implement my software and sell it at the same time. I've never been able to do that before. Today, I have humans, agents, and headless platforms all interoperating, never before. So the opportunity for my own company and the efficiency that I have in my own company, in service and support, in distribution and marketing, across the board, is unprecedented. What I can do for our customers, unprecedented. And, to that point, my gosh, have you seen Anthropic? It is a rocket ship that will not stop.”

“I am going to probably use $300M of Anthropic this year at Salesforce.” - Marc Benioff “ These coding agents are awesome. Anthropic is awesome. Coding, everything's going to be cheaper to make, it's more efficient. I can do things that I just could not do before. I can go faster than ever before. I can implement my software and sell it at the same time. I've never been able to do that before. Today, I have humans, agents, and headless platforms all interoperating, never before. So the opportunity for my own company and the efficiency that I have in my own company, in service and support, in distribution and marketing, across the board, is unprecedented. What I can do for our customers, unprecedented. And, to that point, my gosh, have you seen Anthropic? It is a rocket ship that will not stop.”

The All-In Podcast

229,386 views • 3 months ago

I asked Jensen: “2 out of the top 3 models in the world, Claude and Gemini, were trained on TPU. What does that mean for Nvidia going forward?” After a long technical back and forth about what the right accelerator for AI looks like (see full episode), Jensen lays down the gauntlet: Jensen: "Nvidia's computing stack is the best performance per TCO in the world, bar none. Dylan's InferenceMax is sitting out there for everybody to use, and TPU won't come, Trainium won't come. Nobody wants to show up." “I'm not offended by other people using something else and trying things. If they don't try these other things, how would they know how good ours is?” “There are always big claims, but look at the number of ASICs that have been canceled. Just because you're going to build an ASIC, you still have to build something better than Nvidia. It's not that easy building something better than Nvidia. Nvidia's got to be missing something seriously, because of our scale and our velocity.”

I asked Jensen: “2 out of the top 3 models in the world, Claude and Gemini, were trained on TPU. What does that mean for Nvidia going forward?” After a long technical back and forth about what the right accelerator for AI looks like (see full episode), Jensen lays down the gauntlet: Jensen: "Nvidia's computing stack is the best performance per TCO in the world, bar none. Dylan's InferenceMax is sitting out there for everybody to use, and TPU won't come, Trainium won't come. Nobody wants to show up." “I'm not offended by other people using something else and trying things. If they don't try these other things, how would they know how good ours is?” “There are always big claims, but look at the number of ASICs that have been canceled. Just because you're going to build an ASIC, you still have to build something better than Nvidia. It's not that easy building something better than Nvidia. Nvidia's got to be missing something seriously, because of our scale and our velocity.”

Dwarkesh Patel

419,326 views • 4 months ago

Distilled recap of the back-and-forth with Jensen on export controls: Dwarkesh: Wouldn’t selling Nvidia chips to China enable them to train models like Claude Mythos with cyber offensive capabilities that would be threats to American companies and national security? Jensen: First of all, Mythos was trained on fairly mundane capacity and a fairly mundane amount of it by an extraordinary company. The amount of capacity and the type of compute it was trained on is abundantly available in China. Dwarkesh: With that, could they eventually train a model like Mythos? Yes. But the question is, because we have more FLOPs, American labs are able to get to this level of capabilities first. Furthermore, even if they trained a model like this, the ability to deploy it at scale matters. If you had a cyber hacker, it's much more dangerous if they have a million of them versus a thousand of them. Jensen: Your premise is just wrong. The fact of the matter is their AI development is going just fine. The best AI researchers in the world, because they are limited in compute, also come up with extremely smart algorithms. DeepSeek is not an inconsequential advance. The day that DeepSeek comes out on Huawei first, that is a horrible outcome for our nation. Dwarkesh: Currently, you can have a model like DeepSeek that can run on any accelerator if it's open source. Why would that stop being the case in the future? Jensen: Suppose it optimizes for Huawei. Suppose it optimizes for their architecture. It would put others at a disadvantage. As AI diffuses out into the rest of the world, their standards and their tech stack will become superior to ours because their models are open. Dwarkesh: Tesla sold extremely good electric vehicles to China for a long time. iPhones are sold in China. They didn't cause some lock-in. China will still make their version of EVs, and they're dominating, or smartphones, they're dominating. Jensen: We are not a car. The fact that I can buy this car brand one day and use another car brand another day is easy. Computing is not like that. There's a reason why x86 still exists. There's a reason why Arm is so sticky. These ecosystems are hard to replace. Dwarkesh: It's just hard to imagine that there's a long-term lock-in to the Chinese ecosystem, even if they have this slightly better open-source model for a while. American labs port across accelerators constantly. Anthropic's models are run on GPUs, they're run on Trainium, they're run on TPUs. There are so many things you can do, from distilling to a model that's well fit for your chips. Jensen: China is the largest contributor to open source software in the world. China's the largest contributor to open models in the world. Today it's built on the American tech stack, Nvidia’s. Fact. All five layers of the tech stack for AI are important. The United States ought to go win all five of them. in a few years time, I'm making you the prediction that when we want American technology to be diffused around the world—out to India, out to the Middle East, out to Africa, out to Southeast Asia—on that day, I will tell you exactly about today's conversation, about how your policy ... caused the United States to concede the second largest market in the world for no good reason at all.

Dwarkesh Patel

1,252,795 views • 4 months ago

“There is no one, no company that has a moat like Karp and Palantir. And I think those that think that because of Anthropic or because of the overall market that in some way is going to eat into Palantir’s moat, I think that’s just way wrong,” Wedbush Securities’ Dan Ives says.

“There is no one, no company that has a moat like Karp and Palantir. And I think those that think that because of Anthropic or because of the overall market that in some way is going to eat into Palantir’s moat, I think that’s just way wrong,” Wedbush Securities’ Dan Ives says.

Yahoo Finance

73,715 views • 1 month ago

What an afternoon for #NYR Gabe Perreault. He gets his first NHL hat trick and played against his favorite player growing up for the first time in Patrick Kane: “On that first draw I was like holy shit I’m next to Patrick Kane — so, it was definitely pretty cool and when you’re looking up to a guy like that, to play him for the first time is a dream come true.”

What an afternoon for #NYR Gabe Perreault. He gets his first NHL hat trick and played against his favorite player growing up for the first time in Patrick Kane: “On that first draw I was like holy shit I’m next to Patrick Kane — so, it was definitely pretty cool and when you’re looking up to a guy like that, to play him for the first time is a dream come true.”

Jonny Lazarus

36,764 views • 4 months ago

A sneak peek of Princess Jane's home world. I know AI is nowhere near to creating perfect movies yet, but this feels like the beginning of something great. Experimenting with AI-generated scripts like this feels like an important first step on the journey towards more human-AI creativity in filmmaking. For those wondering if I use AI to write my scripts, yes and no, I craft the base ideas, then use Anthropic AI to refine and polish it. I have successfully trained Anthropic on my story; it automatically knows and predicts each plot in the story. I do not wish to destroy human creativity but enhance it through AI; I believe a human and AI partnership will transcend anything we have ever seen.

A sneak peek of Princess Jane's home world. I know AI is nowhere near to creating perfect movies yet, but this feels like the beginning of something great. Experimenting with AI-generated scripts like this feels like an important first step on the journey towards more human-AI creativity in filmmaking. For those wondering if I use AI to write my scripts, yes and no, I craft the base ideas, then use Anthropic AI to refine and polish it. I have successfully trained Anthropic on my story; it automatically knows and predicts each plot in the story. I do not wish to destroy human creativity but enhance it through AI; I believe a human and AI partnership will transcend anything we have ever seen.

Rufus

1,968,293 views • 2 years ago

🗣️ "I like to have the football, I like energy, and I like to play a brand of football that is exciting and gets the fans wanting to watch the game." Watch Kelvin's first interview after joining the #Spitfires! 🎥👇

Eastleigh FC

13,280 views • 2 years ago

Chris Camillo says AI is accelerating so fast that going to school might not be worth it anymore "One of my kids is 16 years old and he drives himself to school, and one day he slept in and I was so astonished. I was like, how is that even possible? If I would have done that as a kid, the thought of what my parents would have done to me" "But there was a part of me in the back of my head, does it even matter anymore? I'm looking at my kid going to school and I am like, why are you even in school? I know I can't say that to them, but does any of this really matter at all right now? The world is moving so quickly that the stuff you're learning is just too slow"

Chris Camillo says AI is accelerating so fast that going to school might not be worth it anymore "One of my kids is 16 years old and he drives himself to school, and one day he slept in and I was so astonished. I was like, how is that even possible? If I would have done that as a kid, the thought of what my parents would have done to me" "But there was a part of me in the back of my head, does it even matter anymore? I'm looking at my kid going to school and I am like, why are you even in school? I know I can't say that to them, but does any of this really matter at all right now? The world is moving so quickly that the stuff you're learning is just too slow"

Mikli

1,543,731 views • 5 months ago

The #NancyGuthrie “Kidnapper” video is out: 2 Thoughts/Questions. 1: This is not an experienced kidnapper, he was not remotely prepared to come across a camera doorbell that is not sophistication that is not even preparation. He literally turns around and grabbed some of the flowers from Nancy’s flower bed to cover the camera after he notices that He’s being filmed. Not someone who knows the scene or the property. Or in any way prepared for a possible variable, like someone having a camera door doorbell. Which is not really a variable it’s more common sense. 2: Why did it take 10 days to release this to the public? I do not buy for one second that it took 10 days to get this data - someone completely dropped the ball, or SOMETHING ELSE is dramatically at play here. Your thoughts??

The #NancyGuthrie “Kidnapper” video is out: 2 Thoughts/Questions. 1: This is not an experienced kidnapper, he was not remotely prepared to come across a camera doorbell that is not sophistication that is not even preparation. He literally turns around and grabbed some of the flowers from Nancy’s flower bed to cover the camera after he notices that He’s being filmed. Not someone who knows the scene or the property. Or in any way prepared for a possible variable, like someone having a camera door doorbell. Which is not really a variable it’s more common sense. 2: Why did it take 10 days to release this to the public? I do not buy for one second that it took 10 days to get this data - someone completely dropped the ball, or SOMETHING ELSE is dramatically at play here. Your thoughts??

Tony Brueski

123,747 views • 6 months ago

Does anyone really think that Elon Musk runs SpaceX, Tesla, Neuralink, Twitter/X etc., spends '80 percent of my time designing, engineering and manufacturing', while scattergun posting on Twitter/X every day at all hours? Who REALLY controls these companies is a question worth asking. At the same time he flies around meeting world leaders who supposed not to like his platform 'disinformation' yet drool over him, even interview him like Sunak, and promote him for propaganda like Netanyahu. Here Musk-groupie Joe Rogan buys the lie that all of the above is true, that Musk is a genius, and likens him to an 'alien'. It is not possible to do all of these things - and more - at the same time and he obviously doesn't. It's all part of the making of the myth that is Elon Musk. The question is why? The answer will be clear in due course.

Does anyone really think that Elon Musk runs SpaceX, Tesla, Neuralink, Twitter/X etc., spends '80 percent of my time designing, engineering and manufacturing', while scattergun posting on Twitter/X every day at all hours? Who REALLY controls these companies is a question worth asking. At the same time he flies around meeting world leaders who supposed not to like his platform 'disinformation' yet drool over him, even interview him like Sunak, and promote him for propaganda like Netanyahu. Here Musk-groupie Joe Rogan buys the lie that all of the above is true, that Musk is a genius, and likens him to an 'alien'. It is not possible to do all of these things - and more - at the same time and he obviously doesn't. It's all part of the making of the myth that is Elon Musk. The question is why? The answer will be clear in due course.

David Icke

2,633,315 views • 2 years ago

The battle between Anthropic and OpenAI is heating up. Jordi Visser says "Sam Altman in my guess is not going to be the leader of OpenAI at some point soon." "I would be shocked within a year if he is still running OpenAI." "I am not sure it is fun to be in that position right now...Sam Altman seems to have nobody who really likes him, but the product people do like." "In the end, OpenAI has an uphill battle because they made a bad decision. They tried to choose the consumer, Apple side as opposed to the enterprise side." "I just think in the end Anthropic is the winner of that battle."

The battle between Anthropic and OpenAI is heating up. Jordi Visser says "Sam Altman in my guess is not going to be the leader of OpenAI at some point soon." "I would be shocked within a year if he is still running OpenAI." "I am not sure it is fun to be in that position right now...Sam Altman seems to have nobody who really likes him, but the product people do like." "In the end, OpenAI has an uphill battle because they made a bad decision. They tried to choose the consumer, Apple side as opposed to the enterprise side." "I just think in the end Anthropic is the winner of that battle."

Anthony Pompliano 🌪

106,184 views • 2 months ago

Walz: "Donald did an interview a while back. It was like a 30 minute interview, and in that interview 11 times he volunteered and told the person why he wasn't weird. My observation in life is if you're explaining to people why you're not weird, you very well could be."

Walz: "Donald did an interview a while back. It was like a 30 minute interview, and in that interview 11 times he volunteered and told the person why he wasn't weird. My observation in life is if you're explaining to people why you're not weird, you very well could be."

Aaron Rupar

872,016 views • 1 year ago