Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Stephen Jones, NVIDIA CUDA Architect, put it best. What excites him most about CUDA Tile is not just what it does on paper, but what developers will build with it in ways the team never imagined.

NVIDIA Newsroom

46,029 subscribers

14,488 views • 8 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

YOUR PARENTS PAID FOR THE CUDA MOAT! The #1 contributor to the CUDA MOAT isn't the the developers at NVIDIA, but it is the millions of developers outside of NVIDIA that invent new algorithms for CUDA like Flash Attention. For most of them, it started with an GeForce gaming GPU. NVIDIA is the only companies that has an reasonable good developer stack on consumer grade GPUs. As people grow up beyond playing CSGO & League of Legends & Minecraft, they either become anime weeaboos or they start programming on their existing computer with has an GeForce GPU

YOUR PARENTS PAID FOR THE CUDA MOAT! The #1 contributor to the CUDA MOAT isn't the the developers at NVIDIA, but it is the millions of developers outside of NVIDIA that invent new algorithms for CUDA like Flash Attention. For most of them, it started with an GeForce gaming GPU. NVIDIA is the only companies that has an reasonable good developer stack on consumer grade GPUs. As people grow up beyond playing CSGO & League of Legends & Minecraft, they either become anime weeaboos or they start programming on their existing computer with has an GeForce GPU

SemiAnalysis

25,230 views • 4 months ago

Ben Thompson explains how LLMs greatly diminished Nvidia's CUDA moat even as they sent the stock to the moon "So the weird thing about large language models is they were obviously incredible for Nvidia. That's why their stock went to the moon." "They have been on and off the most valuable company in the world." "It was also very bad for Nvidia. And the reason it was bad for Nvidia is that the play with CUDA is to build a developer ecosystem on top of CUDA." "But CUDA only works on Nvidia GPUs. So you get CUDA for free. It's easier to use, and it's a tremendous investment. Nvidia almost went under trying to build CUDA at a time when no one understood what they were doing or why they were wasting money on it." "And that's why Jensen Huang will get bristly, particularly when people question their rent-seeking or profit, whatever. It's like, no, they earned their spot fair and square." "Absolutely. It shouldn't be forgotten. They have earned every dollar they've gotten through 25 years of taking massive risks." "It bottomed out in October 2022. I wrote an article like three weeks before ChatGPT came out, tracing their bottoming-out history and their search for what was next." "'Nvidia in the Valley.' So, go back to this GTC. So I wrote an article at the time called 'Nvidia Waves and Moats'." "And what was interesting about that GTC was, number one, it was very boring. All the cool stuff kind of got scrubbed out." "Now, Jensen Huang has brought that stuff back, so the last few GTCs he's more talking about other things. Now it comes across as, oh, you're still looking for something beyond the LLM." "Because the problem with the LLM is it shifts the developer platform far above where Nvidia sits. All the activity is happening on top of LLMs. And so no one who's writing an AI application today is using CUDA." "Now, some people are, if you're training your own model and you're doing some low-level things or non-LLM things." "But the vast majority of the energy and all the money and the ecosystem is far removed from CUDA." "They have no idea and don't need to know or care what chips their application is running on. They're just on the OpenAI API, or the Anthropic API, or using Bedrock on Amazon, and it's sitting on Trainium, and they're using a Chinese open-source model. It's totally abstracted away, and this is why LLMs were bad for Nvidia." "Now, again, all the money they made along the way is worth it, but their moat has been tremendously diminished." "CUDA is still a moat if you need to do stuff that requires CUDA. But the vast majority of stuff, in energy, doesn't require CUDA, like in a post-LLM world."

Ben Thompson explains how LLMs greatly diminished Nvidia's CUDA moat even as they sent the stock to the moon "So the weird thing about large language models is they were obviously incredible for Nvidia. That's why their stock went to the moon." "They have been on and off the most valuable company in the world." "It was also very bad for Nvidia. And the reason it was bad for Nvidia is that the play with CUDA is to build a developer ecosystem on top of CUDA." "But CUDA only works on Nvidia GPUs. So you get CUDA for free. It's easier to use, and it's a tremendous investment. Nvidia almost went under trying to build CUDA at a time when no one understood what they were doing or why they were wasting money on it." "And that's why Jensen Huang will get bristly, particularly when people question their rent-seeking or profit, whatever. It's like, no, they earned their spot fair and square." "Absolutely. It shouldn't be forgotten. They have earned every dollar they've gotten through 25 years of taking massive risks." "It bottomed out in October 2022. I wrote an article like three weeks before ChatGPT came out, tracing their bottoming-out history and their search for what was next." "'Nvidia in the Valley.' So, go back to this GTC. So I wrote an article at the time called 'Nvidia Waves and Moats'." "And what was interesting about that GTC was, number one, it was very boring. All the cool stuff kind of got scrubbed out." "Now, Jensen Huang has brought that stuff back, so the last few GTCs he's more talking about other things. Now it comes across as, oh, you're still looking for something beyond the LLM." "Because the problem with the LLM is it shifts the developer platform far above where Nvidia sits. All the activity is happening on top of LLMs. And so no one who's writing an AI application today is using CUDA." "Now, some people are, if you're training your own model and you're doing some low-level things or non-LLM things." "But the vast majority of the energy and all the money and the ecosystem is far removed from CUDA." "They have no idea and don't need to know or care what chips their application is running on. They're just on the OpenAI API, or the Anthropic API, or using Bedrock on Amazon, and it's sitting on Trainium, and they're using a Chinese open-source model. It's totally abstracted away, and this is why LLMs were bad for Nvidia." "Now, again, all the money they made along the way is worth it, but their moat has been tremendously diminished." "CUDA is still a moat if you need to do stuff that requires CUDA. But the vast majority of stuff, in energy, doesn't require CUDA, like in a post-LLM world."

Fireside Alpha

12,980 views • 3 days ago

You can run CUDA, on a Mac ARM GPU, in the browser. It sounds ridiculous but it actually works. HipScript chains CUDA, to OpenCL, to Vulkan, to Tint (Google’s shader translator), to a WASM WebGPU. I got a plasma simulation in running in just a few minutes, no NVIDIA GPU!

You can run CUDA, on a Mac ARM GPU, in the browser. It sounds ridiculous but it actually works. HipScript chains CUDA, to OpenCL, to Vulkan, to Tint (Google’s shader translator), to a WASM WebGPU. I got a plasma simulation in running in just a few minutes, no NVIDIA GPU!

LaurieWired

160,518 views • 1 year ago

this is GPU accelerated, no circular dependency physics "solver" (there is nothing being solved) each particle gets a cuda thread (not literally but you get what i mean). Then it gets reduced up to what it should resolve to regarding the rigid bodies

this is GPU accelerated, no circular dependency physics "solver" (there is nothing being solved) each particle gets a cuda thread (not literally but you get what i mean). Then it gets reduced up to what it should resolve to regarding the rigid bodies

kache

128,536 views • 2 months ago

🚨 NVIDIA Had CUDA. Is Tesla Building Its Own Inflection Point? NVIDIA spent years investing in CUDA before AI turned it into a massive advantage. Tesla has now traded sideways for about five years while spending heavily on FSD, Robotaxi, AI, energy, and Optimus. The comparison isn’t perfect, but it raises an interesting question: are investors judging Tesla before the payoff, or simply pricing in the risks? $TSLA $NVDA

🚨 NVIDIA Had CUDA. Is Tesla Building Its Own Inflection Point? NVIDIA spent years investing in CUDA before AI turned it into a massive advantage. Tesla has now traded sideways for about five years while spending heavily on FSD, Robotaxi, AI, energy, and Optimus. The comparison isn’t perfect, but it raises an interesting question: are investors judging Tesla before the payoff, or simply pricing in the risks? $TSLA $NVDA

Herbert Ong

20,320 views • 22 days ago

Be the best at what you do success will never come easy, but that’s what makes it worth it.

Be the best at what you do success will never come easy, but that’s what makes it worth it.

𖣂Prince𖣂

104,100 views • 1 year ago

Sometimes, it is what it is. But most of the time, it's not even about you. Don't spiral.

Sometimes, it is what it is. But most of the time, it's not even about you. Don't spiral.

Larkin Love

19,360 views • 1 year ago

What does it say on the piece of paper?

What does it say on the piece of paper?

Karli Bonne’ 🇺🇸

15,957 views • 4 months ago

"You begged us, you was a fan, n*gga." Cam'ron makes it clear Jim Jones didn’t start Dipset, exposes Jim Jones for being cool with people who put hands on him, and reveals Maino checked Jim Jones when they first met. (🎥 It Is What It Is / It Is What It Is/YouTube)

"You begged us, you was a fan, n*gga." Cam'ron makes it clear Jim Jones didn’t start Dipset, exposes Jim Jones for being cool with people who put hands on him, and reveals Maino checked Jim Jones when they first met. (🎥 It Is What It Is / It Is What It Is/YouTube)

The Art Of Dialogue

2,399,580 views • 1 year ago

Day 1 at NVIDIA GTC What an awesome first day - it was great to connect with thousands of developers, researchers, and business leaders to hear what they're most excited about for the week ahead. #GTC2026

Day 1 at NVIDIA GTC What an awesome first day - it was great to connect with thousands of developers, researchers, and business leaders to hear what they're most excited about for the week ahead. #GTC2026

IREN

39,741 views • 5 months ago

This is what Jocko Willinks does on the days he's just not feeling it.

This is what Jocko Willinks does on the days he's just not feeling it.

Joe Rogan Podcast News

64,123 views • 6 months ago

Shams on Steph's thumb: "What he deals with is irritation at times. He has told people around him that it hurts, but he's not talking about it, he's just playing through it"

Shams on Steph's thumb: "What he deals with is irritation at times. He has told people around him that it hurts, but he's not talking about it, he's just playing through it"

Oh No He Didn't

133,990 views • 1 year ago

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

TBPN

36,474 views • 3 months ago

They taught you electricity was just wires and connections. Nothing more. But there was a hidden power... One they never told you about. Tesla understood it. He exposed it. And that's why they silenced him. Electricity was never just energy. It was control. It was consciousness. Something never meant for the masses. What the awakened know isn't in textbooks. It's not tauaht in schools And you'll never see it on the news. The truth is there. But first, you have to learn how to see it. Nothing is what it seems. Do you dare to question what you have been taught? In "The Truth of the World,"

They taught you electricity was just wires and connections. Nothing more. But there was a hidden power... One they never told you about. Tesla understood it. He exposed it. And that's why they silenced him. Electricity was never just energy. It was control. It was consciousness. Something never meant for the masses. What the awakened know isn't in textbooks. It's not tauaht in schools And you'll never see it on the news. The truth is there. But first, you have to learn how to see it. Nothing is what it seems. Do you dare to question what you have been taught? In "The Truth of the World,"

Kyle L

148,120 views • 6 months ago

a narcissistic parent does not care about anything but what a child can do for them & how that child makes them look. victor doesn’t care if the creature has a companion he only cares what it means in relation to HIM. what it says about him & how his societal value will decrease

a narcissistic parent does not care about anything but what a child can do for them & how that child makes them look. victor doesn’t care if the creature has a companion he only cares what it means in relation to HIM. what it says about him & how his societal value will decrease

𝔟𝔯𝔦𝔱𝔱

163,869 views • 9 months ago

This was never just about football, but about impact. Four years in New Orleans. Not just playing in this city, but pouring into it. The “thumbs down” wasn’t just a celebration. It was a message that what starts on the field travels far beyond it. The work continues.

This was never just about football, but about impact. Four years in New Orleans. Not just playing in this city, but pouring into it. The “thumbs down” wasn’t just a celebration. It was a message that what starts on the field travels far beyond it. The work continues.

Alontae Taylor

85,506 views • 6 months ago