正在加载视频...

视频加载失败

返回首页

"Nvidia is positioned perfectly to thrive on the coding agent wave" and the explosion in inference demand, says tae kim. "I met with Ian Buck and dozens of engineers at Meta, Google, and Nvidia. All of them are seeing crazy inference demand and AI compute shortages." "People are building...

tbpn's profile picture

TBPN

335,717 subscribers

32,912 次观看 • 4 个月前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS
1:46

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

TBPN

36,474 次观看 • 3 个月前

CoreWeave cofounder brannin mcbee says older GPUs and servers still have strong demand, even as new generations ramp up: "Our pricing on Ampere went up during 2025, and our pricing on Hopper stayed within 10% or so of where we started the year." "Why is that happening? I think it's largely driven by inference and the idea that—not every workload needs the latest, greatest GPUs or servers." "There are different types of workloads that need different compute, and the market is efficiently pairing the right GPUs and servers with the workloads that need them." "We see incredibly robust demand all the way back to the Ampere generation, which I believe is six years old at this point."
1:37

CoreWeave cofounder brannin mcbee says older GPUs and servers still have strong demand, even as new generations ramp up: "Our pricing on Ampere went up during 2025, and our pricing on Hopper stayed within 10% or so of where we started the year." "Why is that happening? I think it's largely driven by inference and the idea that—not every workload needs the latest, greatest GPUs or servers." "There are different types of workloads that need different compute, and the market is efficiently pairing the right GPUs and servers with the workloads that need them." "We see incredibly robust demand all the way back to the Ampere generation, which I believe is six years old at this point."

TBPN

31,256 次观看 • 4 个月前

When we first met Tom, his obsession with energy markets came through immediately. Seemed random, but it's "actually" central to what he's building at Actual Computer. The thesis is that local inference is inevitable. Open source models are getting good enough, people don't want to feed their thoughts to AI labs, and demand for compute will continue to be insatiable. But the main forcing function is that chips aren't the bottleneck anymore - power is. Compute is derivative of energy, and the massive data center buildout has created an energy shortage where GPUs sit idle waiting for power to come online. Yet one place that already has power, and always will, is everywhere else. Homes. Businesses. Universities. Collectively, they have more compute than all the data centers combined. Tom Lynch goal is to build a distributed network of people plugging in their local compute (devices like Mac minis to consumer Nvidia cards) to serve inference demand. The substrate he's chosen is Bittensor, on Subnet 95. Actual Computer has an exceptional team behind it, and this is one of the projects that's gotten me most excited in a long time. Enjoy this conversation with the two of us!
37:17

When we first met Tom, his obsession with energy markets came through immediately. Seemed random, but it's "actually" central to what he's building at Actual Computer. The thesis is that local inference is inevitable. Open source models are getting good enough, people don't want to feed their thoughts to AI labs, and demand for compute will continue to be insatiable. But the main forcing function is that chips aren't the bottleneck anymore - power is. Compute is derivative of energy, and the massive data center buildout has created an energy shortage where GPUs sit idle waiting for power to come online. Yet one place that already has power, and always will, is everywhere else. Homes. Businesses. Universities. Collectively, they have more compute than all the data centers combined. Tom Lynch goal is to build a distributed network of people plugging in their local compute (devices like Mac minis to consumer Nvidia cards) to serve inference demand. The substrate he's chosen is Bittensor, on Subnet 95. Actual Computer has an exceptional team behind it, and this is one of the projects that's gotten me most excited in a long time. Enjoy this conversation with the two of us!

Sami Kassab

35,706 次观看 • 7 个月前

People are selling hardware stocks because OpenAI missed 2025 revenue and user target.. Meanwhile $GOOG Cloud CEO says compute wil be supply constrained for the next 10 years. OpenAI’s blunder is a result of company level missteps, particularly lack of product focus. It doesn’t bode ill for the broader demand. Anthropic revenue tripled in three months, validating broader demand. Being short compute and hardware is probably the biggest mistake you can make now.
0:30

People are selling hardware stocks because OpenAI missed 2025 revenue and user target.. Meanwhile $GOOG Cloud CEO says compute wil be supply constrained for the next 10 years. OpenAI’s blunder is a result of company level missteps, particularly lack of product focus. It doesn’t bode ill for the broader demand. Anthropic revenue tripled in three months, validating broader demand. Being short compute and hardware is probably the biggest mistake you can make now.

Oguz Erkan

68,252 次观看 • 3 个月前

Micron is going to $4,000 and once you understand what inference actually is, the number stops sounding crazy (Save this). Dylan Patel just said that by 2030, OpenAI and Anthropic alone will need over 100 gigawatts of compute combined and by 2040, we may not even be measuring AI infrastructure in gigawatts anymore. We may be talking about terawatts. Every single one of those gigawatts needs memory to function. Without it, the compute is worthless. Most people heard that and thought about Nvidia but they should be thinking about Micron. Every AI model generating a response has two phases. The first is prefill, processing your prompt which is compute-heavy and the second is decode generating each word one token at a time and that phase is almost entirely memory-bound, not compute-bound. During decode, the GPU's processing units sit idle more than 95% of the time, waiting for data to arrive from memory. Google confirmed it in a research paper that decode-phase bottlenecks are dominated by memory bandwidth and capacity not raw compute. The GPU is not the bottleneck but the memory feeding the GPU is. This matters because inference is now where all the money lives. Training a model happens once, Inference happens billions of times a day every ChatGPT response, every Claude output, every agentic workflow running in the background and every one of those token streams is a billing event tied directly to memory performance. Adding more GPUs does not fix this because GPUs are already underutilized in inference because they are sitting idle waiting on memory. Adding more memory bandwidth and capacity is what directly reduces token cost, reduces latency, and allows the same cluster to serve dramatically more users simultaneously. Longer context windows compound the problem further, a model running a 1 million token context window requires dramatically more memory per session than a 10,000 token window, and every new model generation pushes context longer. The market treats memory as a downstream beneficiary of Nvidia orders. The correct framework is the opposite, Micron is the upstream constraint on how much value every Nvidia GPU can actually generate at inference scale. Micron guided Q4 to $50 billion in revenue, has HBM4 ramping at twice the pace of the prior generation, and CEO Sanjay Mehrotra has said supply will not catch demand before the end of 2027. At 8x forward earnings on $112 projected FY2027 EPS, Micron is the most undervalued infrastructure company in the entire AI stack. Inference is memory. Memory is Micron and the inference ramp has barely started. Milk Road Pro members are already up massively on this position and we're just getting started. If you want the full breakdown of what we're buying and why, come join us for just a dollar using the link below!
0:39

Micron is going to $4,000 and once you understand what inference actually is, the number stops sounding crazy (Save this). Dylan Patel just said that by 2030, OpenAI and Anthropic alone will need over 100 gigawatts of compute combined and by 2040, we may not even be measuring AI infrastructure in gigawatts anymore. We may be talking about terawatts. Every single one of those gigawatts needs memory to function. Without it, the compute is worthless. Most people heard that and thought about Nvidia but they should be thinking about Micron. Every AI model generating a response has two phases. The first is prefill, processing your prompt which is compute-heavy and the second is decode generating each word one token at a time and that phase is almost entirely memory-bound, not compute-bound. During decode, the GPU's processing units sit idle more than 95% of the time, waiting for data to arrive from memory. Google confirmed it in a research paper that decode-phase bottlenecks are dominated by memory bandwidth and capacity not raw compute. The GPU is not the bottleneck but the memory feeding the GPU is. This matters because inference is now where all the money lives. Training a model happens once, Inference happens billions of times a day every ChatGPT response, every Claude output, every agentic workflow running in the background and every one of those token streams is a billing event tied directly to memory performance. Adding more GPUs does not fix this because GPUs are already underutilized in inference because they are sitting idle waiting on memory. Adding more memory bandwidth and capacity is what directly reduces token cost, reduces latency, and allows the same cluster to serve dramatically more users simultaneously. Longer context windows compound the problem further, a model running a 1 million token context window requires dramatically more memory per session than a 10,000 token window, and every new model generation pushes context longer. The market treats memory as a downstream beneficiary of Nvidia orders. The correct framework is the opposite, Micron is the upstream constraint on how much value every Nvidia GPU can actually generate at inference scale. Micron guided Q4 to $50 billion in revenue, has HBM4 ramping at twice the pace of the prior generation, and CEO Sanjay Mehrotra has said supply will not catch demand before the end of 2027. At 8x forward earnings on $112 projected FY2027 EPS, Micron is the most undervalued infrastructure company in the entire AI stack. Inference is memory. Memory is Micron and the inference ramp has barely started. Milk Road Pro members are already up massively on this position and we're just getting started. If you want the full breakdown of what we're buying and why, come join us for just a dollar using the link below!

Milk Road AI

128,678 次观看 • 1 个月前

Jensen Huang just admitted Nvidia is paying for BOTH ends of its own $500 billion deal. Every outlet ran the same headline: Nvidia is putting half a trillion dollars into Korea. The largest AI infrastructure commitment ever announced with a single partner. But when asked what was actually inside that number and whether this is Nvidia spending money in the Korean economy, or SK fronting the capital themselves, Jensen said this: "We're gonna be purchasing memories from them for many years to come. In order to build a trillion dollars worth of Vera Rubin systems, you're gonna have to buy a lot of system memories to go with it. And so we have large purchase agreements and large purchase intentions with SK Hynix. Meanwhile, SK Telecom is gonna become an AI cloud. And in that agreement, we will be selling AI supercomputers to them. So between us, we're gonna do $500 billion worth of business." He literally described two completely different transactions and added them together. Nvidia pays SK Hynix for memory chips. SK Telecom pays Nvidia for supercomputers. Both directions get stacked into one figure and handed to the market as demand. A large share of that half trillion dollars is Nvidia's own money going OUT the door. This is the CEO of the most important chip company on Earth. His silicon runs every serious AI system on the planet. If anyone alive could announce a clean half trillion in customer demand, it's him. Instead he announced a number that counts his own supplier payments as "business." But now this is where it gets genuinely crazy... Bloomberg asked how badly Nvidia needs Korean supply to grow. Jensen said Nvidia does not have enough bits. He said the company is constrained in HBM memory, constrained in LPDDR memory, and constrained in just about every part of the supply chain. Then he named the bottleneck nobody expected: "We're even constrained now with land and power and construction workers to set up the data centers." The company announcing the biggest AI deal in history cannot hire enough people to pour concrete. Then he capped the entire industry. He said the industry has the ability to double each year, and will have a hard time growing much faster than that. Now hold that against the target he set at the top of the same interview: He said the semiconductor industry probably has to become 10x larger than it is today over the next decade. Doubling annually clears that on a spreadsheet. But in reality it only happens if land, power and construction crews cooperate every single year for ten years straight. And the demand justifying all of it is a number most people have not heard yet. Jensen is planning for 100 BILLION AI agents and billions of robots using computers. That is the actual bet. 10x the industry, financed by deals where the vendor is also the customer, and gated by how fast you can find electricians. Korea's market did not celebrate any of this by the way. The KOSPI has been falling hard and SK Hynix and Samsung both slumped while the half trillion dollar headline was running. Jensen listed both directions of money and totaled them on camera because he does not think there is anything wrong with it. Maybe there isn't. Chips have to be bought before systems can be sold. But the market is pricing these announcements as demand, and at least half of this one is spending.
1:21

Jensen Huang just admitted Nvidia is paying for BOTH ends of its own $500 billion deal. Every outlet ran the same headline: Nvidia is putting half a trillion dollars into Korea. The largest AI infrastructure commitment ever announced with a single partner. But when asked what was actually inside that number and whether this is Nvidia spending money in the Korean economy, or SK fronting the capital themselves, Jensen said this: "We're gonna be purchasing memories from them for many years to come. In order to build a trillion dollars worth of Vera Rubin systems, you're gonna have to buy a lot of system memories to go with it. And so we have large purchase agreements and large purchase intentions with SK Hynix. Meanwhile, SK Telecom is gonna become an AI cloud. And in that agreement, we will be selling AI supercomputers to them. So between us, we're gonna do $500 billion worth of business." He literally described two completely different transactions and added them together. Nvidia pays SK Hynix for memory chips. SK Telecom pays Nvidia for supercomputers. Both directions get stacked into one figure and handed to the market as demand. A large share of that half trillion dollars is Nvidia's own money going OUT the door. This is the CEO of the most important chip company on Earth. His silicon runs every serious AI system on the planet. If anyone alive could announce a clean half trillion in customer demand, it's him. Instead he announced a number that counts his own supplier payments as "business." But now this is where it gets genuinely crazy... Bloomberg asked how badly Nvidia needs Korean supply to grow. Jensen said Nvidia does not have enough bits. He said the company is constrained in HBM memory, constrained in LPDDR memory, and constrained in just about every part of the supply chain. Then he named the bottleneck nobody expected: "We're even constrained now with land and power and construction workers to set up the data centers." The company announcing the biggest AI deal in history cannot hire enough people to pour concrete. Then he capped the entire industry. He said the industry has the ability to double each year, and will have a hard time growing much faster than that. Now hold that against the target he set at the top of the same interview: He said the semiconductor industry probably has to become 10x larger than it is today over the next decade. Doubling annually clears that on a spreadsheet. But in reality it only happens if land, power and construction crews cooperate every single year for ten years straight. And the demand justifying all of it is a number most people have not heard yet. Jensen is planning for 100 BILLION AI agents and billions of robots using computers. That is the actual bet. 10x the industry, financed by deals where the vendor is also the customer, and gated by how fast you can find electricians. Korea's market did not celebrate any of this by the way. The KOSPI has been falling hard and SK Hynix and Samsung both slumped while the half trillion dollar headline was running. Jensen listed both directions of money and totaled them on camera because he does not think there is anything wrong with it. Maybe there isn't. Chips have to be bought before systems can be sold. But the market is pricing these announcements as demand, and at least half of this one is spending.

Ricardo

35,609 次观看 • 1 个月前

Groq's LPU is faster than GPUs, handling requests and responding more quickly. Groq's LPUs don't need speedy data delivery like Nvidia GPUs do because they don't have HBM in their system. They use SRAM, which is about 20 times faster than what GPUs use. Since inference runs use way less data than model training, Groq's LPU is more energy-efficient. It reads less from external memory and uses less power than a Nvidia GPU for inference tasks. The LPU works differently from GPUs. It uses a Temporal Instruction Set Computer architecture, so it doesn't have to reload data from memory as often as GPUs do with High Bandwidth Memory (HBM). This helps avoid issues with HBM shortages and keeps costs down. If Groq's LPU is used in places that do AI processing, you might not need special storage for Nvidia GPUs. The LPU doesn't demand super-fast storage like GPUs do. Groq is claiming that its technology could replace GPUs in AI tasks with its powerful chip and software.
7:57

Groq's LPU is faster than GPUs, handling requests and responding more quickly. Groq's LPUs don't need speedy data delivery like Nvidia GPUs do because they don't have HBM in their system. They use SRAM, which is about 20 times faster than what GPUs use. Since inference runs use way less data than model training, Groq's LPU is more energy-efficient. It reads less from external memory and uses less power than a Nvidia GPU for inference tasks. The LPU works differently from GPUs. It uses a Temporal Instruction Set Computer architecture, so it doesn't have to reload data from memory as often as GPUs do with High Bandwidth Memory (HBM). This helps avoid issues with HBM shortages and keeps costs down. If Groq's LPU is used in places that do AI processing, you might not need special storage for Nvidia GPUs. The LPU doesn't demand super-fast storage like GPUs do. Groq is claiming that its technology could replace GPUs in AI tasks with its powerful chip and software.

Brian Roemmele

87,214 次观看 • 2 年前

"Compute is the currency of the future." "Compute is the new OIL." Great, so how do I invest? You can play with the NVIDIA stock, or spin up an AI-Ready Data Center. Challenges of Spinning up AI-Ready Compute: Cost: Even a small cluster of H100 machines is upward to $10M GPU Scarcity: Unallocated or “underutilized” H100, A100, and RTX4090 GPUs are almost non-existent. Very Specific Physical & Technical Requirements: A data center with the right infrastructure is also very rare. There are only 10 in North America that deploy thousands of GPUs, in the open market. Domain Expertise: Teams of experts with the years of experience required to operate, deploy, and manage AI compute at scale are as rare as the GPUs they deploy. Exabits checks all of these boxes and we are the premier Compute Tokenization Platform. We are backed by REAL COMPUTE used by REAL CUSTOMERS.
0:30

"Compute is the currency of the future." "Compute is the new OIL." Great, so how do I invest? You can play with the NVIDIA stock, or spin up an AI-Ready Data Center. Challenges of Spinning up AI-Ready Compute: Cost: Even a small cluster of H100 machines is upward to $10M GPU Scarcity: Unallocated or “underutilized” H100, A100, and RTX4090 GPUs are almost non-existent. Very Specific Physical & Technical Requirements: A data center with the right infrastructure is also very rare. There are only 10 in North America that deploy thousands of GPUs, in the open market. Domain Expertise: Teams of experts with the years of experience required to operate, deploy, and manage AI compute at scale are as rare as the GPUs they deploy. Exabits checks all of these boxes and we are the premier Compute Tokenization Platform. We are backed by REAL COMPUTE used by REAL CUSTOMERS.

Exabits

13,896 次观看 • 2 年前

$NVDA CEO Jensen Huang said demand has gone parabolic because agentic AI has arrived, AI can now do productive work and tokens are becoming profitable. If tokens are profitable then model builders have a reason to produce more of them which means more inference, more compute and more demand across networking, memory, CPUs, power and data centers. The near-term stock reaction is about expectations but long-term story is still that the AI factory buildout is running through Nvidia which is why I think it has a real path to becoming the world’s first $10T company.
0:24

$NVDA CEO Jensen Huang said demand has gone parabolic because agentic AI has arrived, AI can now do productive work and tokens are becoming profitable. If tokens are profitable then model builders have a reason to produce more of them which means more inference, more compute and more demand across networking, memory, CPUs, power and data centers. The near-term stock reaction is about expectations but long-term story is still that the AI factory buildout is running through Nvidia which is why I think it has a real path to becoming the world’s first $10T company.

Shay Boloor

261,814 次观看 • 3 个月前

Jensen Huang just said this is the greatest era in history to build software. AI agents will not kill software. They will do the exact opposite: create a massive new wave of software demand. at NVIDIA GTC Taipei 2026 "Click and type. We now replace that with explaining to the AI what we want, our intent, and the AI generates the code or uses tools to produce the necessary output. This is how computers are going to work in the future. This is Agentic AI. For two years, we've been building toward this, and now it has arrived. One of the big breakthroughs, of course, is tool use. A lot of people have said, “Jensen, AI is coming. Agentic AI is coming. Therefore, all the software companies are going to go out of business.” This is exactly the opposite. Because there are going to be so many agents, the world is no longer limited by the number of people. Therefore, those agents are going to use more tools than ever. This is actually an incredible time to be a software company. But the software has to be presented to the agent in a way that the agent can use it. This is a big breakthrough. And in fact, what we have done, as you know, what Nvidia’s treasure..." ---- From 'NVIDIA' YT channel (link in comment)
0:59

Jensen Huang just said this is the greatest era in history to build software. AI agents will not kill software. They will do the exact opposite: create a massive new wave of software demand. at NVIDIA GTC Taipei 2026 "Click and type. We now replace that with explaining to the AI what we want, our intent, and the AI generates the code or uses tools to produce the necessary output. This is how computers are going to work in the future. This is Agentic AI. For two years, we've been building toward this, and now it has arrived. One of the big breakthroughs, of course, is tool use. A lot of people have said, “Jensen, AI is coming. Agentic AI is coming. Therefore, all the software companies are going to go out of business.” This is exactly the opposite. Because there are going to be so many agents, the world is no longer limited by the number of people. Therefore, those agents are going to use more tools than ever. This is actually an incredible time to be a software company. But the software has to be presented to the agent in a way that the agent can use it. This is a big breakthrough. And in fact, what we have done, as you know, what Nvidia’s treasure..." ---- From 'NVIDIA' YT channel (link in comment)

Rohan Paul

16,584 次观看 • 2 个月前

Jensen Huang just made a statement that every investor in AI infrastructure needs to hear (Save this). He said that the AI buildout is accelerating, the second half of this year is going to be much larger than the first half, and next year is going to be very, very large. Micron is the best positioned to win from this because every Nvidia GPU requires High Bandwidth Memory stacked directly on the chip to feed it data fast enough to keep up. There is no AI compute without memory, and right now there is simply not enough memory to go around. Micron's entire HBM supply for 2026 is already completely sold out under multi-year agreements before the year even started. Micron's own management has acknowledged they can only satisfy 50 to 65 percent of demand from some of their most important customers. That is not a problem that gets fixed quickly, because new fabs take years to build. Micron's Idaho expansion does not come online until mid-2026, a second Idaho facility is not expected until 2028, and a new New York fab is looking at 2030. The demand Jensen just described is arriving right now, and the supply to meet it is years away. The financial results already reflect this dynamic. Micron's Q2 fiscal 2026 revenue came in at $23.86 billion, nearly triple what it was a year earlier beating consensus by roughly $3.8 billion. The HBM market alone is expected to grow from $35 billion today to $100 billion by 2028, and Micron has been consistently ahead of that forecast. Jensen just told the world the second half of this year and all of next year are going to be larger than anything that came before. Micron is the company that supplies the memory those GPUs need to run, and it cannot build supply fast enough to keep up with demand. Come join Milk Road Pro for our full deep dive on Micron, the HBM supply thesis and our AI trade thesis! Link below!
1:28

Jensen Huang just made a statement that every investor in AI infrastructure needs to hear (Save this). He said that the AI buildout is accelerating, the second half of this year is going to be much larger than the first half, and next year is going to be very, very large. Micron is the best positioned to win from this because every Nvidia GPU requires High Bandwidth Memory stacked directly on the chip to feed it data fast enough to keep up. There is no AI compute without memory, and right now there is simply not enough memory to go around. Micron's entire HBM supply for 2026 is already completely sold out under multi-year agreements before the year even started. Micron's own management has acknowledged they can only satisfy 50 to 65 percent of demand from some of their most important customers. That is not a problem that gets fixed quickly, because new fabs take years to build. Micron's Idaho expansion does not come online until mid-2026, a second Idaho facility is not expected until 2028, and a new New York fab is looking at 2030. The demand Jensen just described is arriving right now, and the supply to meet it is years away. The financial results already reflect this dynamic. Micron's Q2 fiscal 2026 revenue came in at $23.86 billion, nearly triple what it was a year earlier beating consensus by roughly $3.8 billion. The HBM market alone is expected to grow from $35 billion today to $100 billion by 2028, and Micron has been consistently ahead of that forecast. Jensen just told the world the second half of this year and all of next year are going to be larger than anything that came before. Micron is the company that supplies the memory those GPUs need to run, and it cannot build supply fast enough to keep up with demand. Come join Milk Road Pro for our full deep dive on Micron, the HBM supply thesis and our AI trade thesis! Link below!

Milk Road AI

77,554 次观看 • 2 个月前

Look at the expression on Jensen’s face when a reporter asks if TSMC is going to make enough wafers for Nvidia this year. I'm not a CIA body language expert, but GOOD LUCK to da bears. $NVDA Reporter: "Jensen will TSMC be supplying enough for you guys this year?" Nvidia CEO Jensen Huang: "TSMC needs to work very hard this year because I need a lot of wafers and CoWoS this year. ... So TSMC is doing an incredible job and they're working very, very hard. We have a lot of demand this year."
0:28

Look at the expression on Jensen’s face when a reporter asks if TSMC is going to make enough wafers for Nvidia this year. I'm not a CIA body language expert, but GOOD LUCK to da bears. $NVDA Reporter: "Jensen will TSMC be supplying enough for you guys this year?" Nvidia CEO Jensen Huang: "TSMC needs to work very hard this year because I need a lot of wafers and CoWoS this year. ... So TSMC is doing an incredible job and they're working very, very hard. We have a lot of demand this year."

tae kim

403,365 次观看 • 6 个月前

Dylan on why Anthropic leading on models doesn't mean OpenAI loses. Even the tier 2 and 3 labs will sell out of tokens: "Everyone's like Anthropic won. They had Mythos, Opus 4.7 and their revenue is adding $10 billion a month all before OpenAI's alleged Spud release. So clearly Anthropic is in the lead and OpenAI is cooked. Anthropic has such bounds on compute, they can only grow it so fast. Dario used to gloat about how OpenAI was being too aggressive on compute and Anthropic was more sensible in their scaling. Now Anthropic is like I wish we had a lot more compute. OpenAI just raised a ton of money to get incremental compute in addition to the irresponsible levels of compute that they were buying. By the end of the year, let's say a 4.6 Opus tier model, the economy would spend $100 billion on. Anthropic won't have enough compute to do that. And presumably OpenAI and Google will hit that tier soon. Anthropic may get to charge 70%+ gross margins but if OpenAI hits it next, they charge 50% gross margins. They still get all of this incremental demand. There is such demand for these tokens and such limitations on compute. It's pretty clear even the tier 2 or tier 3 lab are going to be sold out of tokens. The economic value that the best model can deliver is growing faster than our ability to actually serve those tokens to people via the infrastructure."
2:33

Dylan on why Anthropic leading on models doesn't mean OpenAI loses. Even the tier 2 and 3 labs will sell out of tokens: "Everyone's like Anthropic won. They had Mythos, Opus 4.7 and their revenue is adding $10 billion a month all before OpenAI's alleged Spud release. So clearly Anthropic is in the lead and OpenAI is cooked. Anthropic has such bounds on compute, they can only grow it so fast. Dario used to gloat about how OpenAI was being too aggressive on compute and Anthropic was more sensible in their scaling. Now Anthropic is like I wish we had a lot more compute. OpenAI just raised a ton of money to get incremental compute in addition to the irresponsible levels of compute that they were buying. By the end of the year, let's say a 4.6 Opus tier model, the economy would spend $100 billion on. Anthropic won't have enough compute to do that. And presumably OpenAI and Google will hit that tier soon. Anthropic may get to charge 70%+ gross margins but if OpenAI hits it next, they charge 50% gross margins. They still get all of this incremental demand. There is such demand for these tokens and such limitations on compute. It's pretty clear even the tier 2 or tier 3 lab are going to be sold out of tokens. The economic value that the best model can deliver is growing faster than our ability to actually serve those tokens to people via the infrastructure."

Patrick OShaughnessy

295,307 次观看 • 4 个月前

"Every former Nvidia employee that goes to a large tech company like Google and MSFT says it's extremely difficult to adjust to the culture, Nvidia is faster but the work ethic is on a different level" 3dfx was the No 1 graphics company in the mid-to-late 90s, their main competitor Nvidia beat them and essentially destroyed them - acquired their assets and hired 100 of their engineers. The 3dfx engineers kept looking for Nvidia's secret or magic trick, but it turned out the only secret was relentless execution & working crazy hard. This culture obviously stems from the CEO, Jensen - who loves to work on Sunday nights & finds it relaxing. Jensen is constantly focused on cultivating talent - he rewards highly performing engineers by doubling or tripling their stock compensation. To avoid the internal politics that plague large organizations (where projects get stuck in quicksand needing multiple approvals), Jensen made the organization flat. Every time they need to make decisions, he brings together top 10-15 people, including lower-level employees, to hash out the main problems in an intellectually honest way and execute quickly - what they call "speed of light" at Nvidia.
2:38

"Every former Nvidia employee that goes to a large tech company like Google and MSFT says it's extremely difficult to adjust to the culture, Nvidia is faster but the work ethic is on a different level" 3dfx was the No 1 graphics company in the mid-to-late 90s, their main competitor Nvidia beat them and essentially destroyed them - acquired their assets and hired 100 of their engineers. The 3dfx engineers kept looking for Nvidia's secret or magic trick, but it turned out the only secret was relentless execution & working crazy hard. This culture obviously stems from the CEO, Jensen - who loves to work on Sunday nights & finds it relaxing. Jensen is constantly focused on cultivating talent - he rewards highly performing engineers by doubling or tripling their stock compensation. To avoid the internal politics that plague large organizations (where projects get stuck in quicksand needing multiple approvals), Jensen made the organization flat. Every time they need to make decisions, he brings together top 10-15 people, including lower-level employees, to hash out the main problems in an intellectually honest way and execute quickly - what they call "speed of light" at Nvidia.

Aish

692,758 次观看 • 1 年前

Every conversation I have with Dylan Patel, I'm really just trying to understand the supply and demand of tokens. This is a unique episode in that it's entirely dedicated to talking about both sides of that equation. We discuss: - The infinite demand for the newest models - SemiAnalysis going from $10K on AI spend to $7M - Mythos and Anthropic's compute problem - Why TSMC spending $100B on CapEx could cause a shortage - Robotics as next demand wave - Why memory prices will double again This is my second conversation with Dylan and find myself needing to speak with him more and more often to make sense of it all. Enjoy! Timestamps: 0:00 Intro 1:00 Surging AI Spend 10:27 Token Demand 16:21 When Ideas Are Cheap and Execution is Easy 20:46 Model Hoarding 22:34 Robotics 27:03 The Compute Bottleneck 30:26 The AI Permanent Underclass 31:39 Supply Chain Reality 37:47 CPUs 42:54 Predictions: Public Backlash
45:33

Every conversation I have with Dylan Patel, I'm really just trying to understand the supply and demand of tokens. This is a unique episode in that it's entirely dedicated to talking about both sides of that equation. We discuss: - The infinite demand for the newest models - SemiAnalysis going from $10K on AI spend to $7M - Mythos and Anthropic's compute problem - Why TSMC spending $100B on CapEx could cause a shortage - Robotics as next demand wave - Why memory prices will double again This is my second conversation with Dylan and find myself needing to speak with him more and more often to make sense of it all. Enjoy! Timestamps: 0:00 Intro 1:00 Surging AI Spend 10:27 Token Demand 16:21 When Ideas Are Cheap and Execution is Easy 20:46 Model Hoarding 22:34 Robotics 27:03 The Compute Bottleneck 30:26 The AI Permanent Underclass 31:39 Supply Chain Reality 37:47 CPUs 42:54 Predictions: Public Backlash

Patrick OShaughnessy

893,210 次观看 • 4 个月前

Bitzero is positioning itself ahead of the AI compute boom. Bitzero President Mohammed Bakhashwain tells Remy Blaire their assets are "strategically positioned to leverage that demand with scale." The company has 110MW announced in Norway with discussions to expand up to 300MW, and is actively developing a Finland site alongside CBRE and Turner & Townsend.
1:40

Bitzero is positioning itself ahead of the AI compute boom. Bitzero President Mohammed Bakhashwain tells Remy Blaire their assets are "strategically positioned to leverage that demand with scale." The company has 110MW announced in Norway with discussions to expand up to 300MW, and is actively developing a Finland site alongside CBRE and Turner & Townsend.

FINTECH.TV

11,890 次观看 • 3 个月前

Watch Nvidia CEO Jensen Huang reveal what he described as the state of the art in AI hardware: the new Rubin computing architecture. “Vera Rubin is designed to address this fundamental challenge that we have: The amount of computation necessary for AI is skyrocketing.” Huang said. “Today, I can tell you that Vera Rubin is in full production.” According to Nvidia’s tests, Rubin architecture operates three and a half times faster than the previous Blackwell architecture on model-training tasks and five times faster on inference tasks, and that's just the start.
3:29

Watch Nvidia CEO Jensen Huang reveal what he described as the state of the art in AI hardware: the new Rubin computing architecture. “Vera Rubin is designed to address this fundamental challenge that we have: The amount of computation necessary for AI is skyrocketing.” Huang said. “Today, I can tell you that Vera Rubin is in full production.” According to Nvidia’s tests, Rubin architecture operates three and a half times faster than the previous Blackwell architecture on model-training tasks and five times faster on inference tasks, and that's just the start.

TechCrunch

76,412 次观看 • 7 个月前

Jensen Huang just doubled NVIDIA's demand forecast to $1 Trillion through 2027 🤯 Then spent two hours explaining why that number is conservative… Here's everything today from GTC: - NemoClaw: NVIDIA's open-source enterprise AI agent stack built around OpenClaw. Jensen called OpenClaw "the operating system for personal AI" and said every company needs a strategy for it. - Space-1: NVIDIA is putting Vera Rubin data centers in orbit. Not a concept. An actual system being designed for space deployment right now. - DLSS 5: 3D-guided neural rendering that blends raw graphics with generative AI. Jensen called it the future of real-time rendering. - AWS: Deploying 1 million+ NVIDIA GPUs starting this year. Azure was the first hyperscaler to power up Vera Rubin. - Vera Rubin: NVIDIA's next-gen AI supercomputer. 10x more performance per watt than Blackwell, 700 million tokens per second, shipping later this year. - Groq 3 LPU: First chip from NVIDIA's $20B Groq acquisition. A purpose-built inference accelerator that ships Q3. NVIDIA now owns training AND inference. -Feynman: The architecture after Rubin, coming 2028. New GPU, new LPU, new CPU. NVIDIA is on a 12-month chip cadence and the treadmill never stops. - Autonomous driving: BYD, Hyundai, Nissan, and Geely building Level 4 vehicles on NVIDIA. Uber deploying NVIDIA-powered robotaxis across 28 cities by 2028. The man doubled his demand forecast to a trillion dollars, announced data centers in space, and closed the show with a robot singing country music. This is NVIDIA's world. Everyone else is just renting compute in it.
0:49

Jensen Huang just doubled NVIDIA's demand forecast to $1 Trillion through 2027 🤯 Then spent two hours explaining why that number is conservative… Here's everything today from GTC: - NemoClaw: NVIDIA's open-source enterprise AI agent stack built around OpenClaw. Jensen called OpenClaw "the operating system for personal AI" and said every company needs a strategy for it. - Space-1: NVIDIA is putting Vera Rubin data centers in orbit. Not a concept. An actual system being designed for space deployment right now. - DLSS 5: 3D-guided neural rendering that blends raw graphics with generative AI. Jensen called it the future of real-time rendering. - AWS: Deploying 1 million+ NVIDIA GPUs starting this year. Azure was the first hyperscaler to power up Vera Rubin. - Vera Rubin: NVIDIA's next-gen AI supercomputer. 10x more performance per watt than Blackwell, 700 million tokens per second, shipping later this year. - Groq 3 LPU: First chip from NVIDIA's $20B Groq acquisition. A purpose-built inference accelerator that ships Q3. NVIDIA now owns training AND inference. -Feynman: The architecture after Rubin, coming 2028. New GPU, new LPU, new CPU. NVIDIA is on a 12-month chip cadence and the treadmill never stops. - Autonomous driving: BYD, Hyundai, Nissan, and Geely building Level 4 vehicles on NVIDIA. Uber deploying NVIDIA-powered robotaxis across 28 cities by 2028. The man doubled his demand forecast to a trillion dollars, announced data centers in space, and closed the show with a robot singing country music. This is NVIDIA's world. Everyone else is just renting compute in it.

Josh Kale

45,875 次观看 • 5 个月前

Nebius will be the first neocloud to hit $1 trillion dollar company and here is exactly why (Save this). As dylan patel says Jensen Huang absolutely hates a world where the hyperscalers have all the power. A world where Microsoft, Amazon, and Google are the only ones building compute is a world where Nvidia is slowly being squeezed by a handful of customers all simultaneously developing custom chips to replace Nvidia GPUs entirely. Google's TPU, Amazon's Trainium and Microsoft's Maia all exist for one reason, to cut Nvidia out of the stack and Jensen knows it so he is playing a long game most investors haven't registered yet. By funding NeoClouds and NeoLabs at scale, Jensen is deliberately engineering a multipolar compute world where no single hyperscaler can dictate terms and where Nvidia hardware remains the default infrastructure layer regardless of which model or platform ultimately wins. Nvidia has deployed roughly $40 billion in AI ecosystem investments across OpenAI, Anthropic, CoreWeave, Nebius, xAI, and dozens of infrastructure companies, all running almost exclusively on Nvidia chips, cementing GPU dependency across the entire AI stack.sedaily Every neocloud that survives and scales becomes a permanent Nvidia GPU customer structurally opposed to the hyperscalers building custom silicon expanding Nvidia's market while simultaneously weakening its biggest competitive threat. Dylan Patel described the neocloud ecosystem as throwing bait into the water and letting the best fish survive, warning that many heavily-backed teams will fail, but the ones that emerge will pull hundreds of millions in ARR right out of the gate. Nebius is that fish because it's the only neocloud operating at hyperscaler scale while remaining fully purpose-engineered for AI workloads from silicon to software. The numbers confirm Nebius has already cleared the survival bar that will eliminate most of the 200+ neoclouds competing right now. Revenue hit $399 million in Q1 2026, up 684% year-over-year, backed by $46 billion in contracted backlog, 3.5 GW of contracted power across seven site and a target of $7–$9 billion in annualized revenue by year-end. When Google approached neoclouds about deploying TPUs, Nebius said no, its Chief Revenue Officer noting that demand is 99% for Nvidia GPUs and that TPU interest comes almost entirely from former Google employees rather than the actual market. That alignment with Nvidia's ecosystem, at this scale, with this backlog, and this level of strategic backing is why Nebius sits in a category of one among the neocloud field. Patel framed the broader play correctly, every neocloud that survives makes Google's TPU and Amazon's Trainium structurally weaker simply by existing and five years from now, the winners will have reshaped the entire compute landscape in Nvidia's favor. Nebius is already hundreds of millions in ARR ahead of the competition while most of the field is still treading water. Milk Road subscribers are already up massively on the Nebius trade, and we are tracking the neocloud buildout as Nvidia works to reshape the entire compute market. Come join Milk Road Pro for our full Nebius breakdown, the valuation framework, the revenue targets we are watching, and the AI infrastructure names we like next for just $1. Link below!
2:12

Nebius will be the first neocloud to hit $1 trillion dollar company and here is exactly why (Save this). As dylan patel says Jensen Huang absolutely hates a world where the hyperscalers have all the power. A world where Microsoft, Amazon, and Google are the only ones building compute is a world where Nvidia is slowly being squeezed by a handful of customers all simultaneously developing custom chips to replace Nvidia GPUs entirely. Google's TPU, Amazon's Trainium and Microsoft's Maia all exist for one reason, to cut Nvidia out of the stack and Jensen knows it so he is playing a long game most investors haven't registered yet. By funding NeoClouds and NeoLabs at scale, Jensen is deliberately engineering a multipolar compute world where no single hyperscaler can dictate terms and where Nvidia hardware remains the default infrastructure layer regardless of which model or platform ultimately wins. Nvidia has deployed roughly $40 billion in AI ecosystem investments across OpenAI, Anthropic, CoreWeave, Nebius, xAI, and dozens of infrastructure companies, all running almost exclusively on Nvidia chips, cementing GPU dependency across the entire AI stack.sedaily Every neocloud that survives and scales becomes a permanent Nvidia GPU customer structurally opposed to the hyperscalers building custom silicon expanding Nvidia's market while simultaneously weakening its biggest competitive threat. Dylan Patel described the neocloud ecosystem as throwing bait into the water and letting the best fish survive, warning that many heavily-backed teams will fail, but the ones that emerge will pull hundreds of millions in ARR right out of the gate. Nebius is that fish because it's the only neocloud operating at hyperscaler scale while remaining fully purpose-engineered for AI workloads from silicon to software. The numbers confirm Nebius has already cleared the survival bar that will eliminate most of the 200+ neoclouds competing right now. Revenue hit $399 million in Q1 2026, up 684% year-over-year, backed by $46 billion in contracted backlog, 3.5 GW of contracted power across seven site and a target of $7–$9 billion in annualized revenue by year-end. When Google approached neoclouds about deploying TPUs, Nebius said no, its Chief Revenue Officer noting that demand is 99% for Nvidia GPUs and that TPU interest comes almost entirely from former Google employees rather than the actual market. That alignment with Nvidia's ecosystem, at this scale, with this backlog, and this level of strategic backing is why Nebius sits in a category of one among the neocloud field. Patel framed the broader play correctly, every neocloud that survives makes Google's TPU and Amazon's Trainium structurally weaker simply by existing and five years from now, the winners will have reshaped the entire compute landscape in Nvidia's favor. Nebius is already hundreds of millions in ARR ahead of the competition while most of the field is still treading water. Milk Road subscribers are already up massively on the Nebius trade, and we are tracking the neocloud buildout as Nvidia works to reshape the entire compute market. Come join Milk Road Pro for our full Nebius breakdown, the valuation framework, the revenue targets we are watching, and the AI infrastructure names we like next for just $1. Link below!

Milk Road AI

92,855 次观看 • 1 个月前

$AMZN CEO Andy Jassy describes AI adoption as very barbelled, with most existing enterprise workloads still not using inference though he expects that to change significantly over time. "I think it's actually kind of useful to look at at least our view of what we see in the demand and adoption curve right now, which is we see this adoption curve in AI right now is very barbelled." "There is on one end of the barbell, the AI labs are consuming gobs and gobs of compute. And there are a few runaway successful generative AI applications like Claude Code and ChatGPT." "And on the other end of the barbell are enterprises who are getting real value from AI in cost avoidance and productivity. And these are things like automating customer service or business process automation or fraud." "In the middle of the barbell is all of the current enterprise production workloads, some of which are using inference in a pervasive way, but most of which aren't. And that is going to change very significantly over time." "And that will be, in my opinion, that will be the largest absolute segment, the existing production workloads in the enterprise and new businesses and workloads that startups build too."
1:10

$AMZN CEO Andy Jassy describes AI adoption as very barbelled, with most existing enterprise workloads still not using inference though he expects that to change significantly over time. "I think it's actually kind of useful to look at at least our view of what we see in the demand and adoption curve right now, which is we see this adoption curve in AI right now is very barbelled." "There is on one end of the barbell, the AI labs are consuming gobs and gobs of compute. And there are a few runaway successful generative AI applications like Claude Code and ChatGPT." "And on the other end of the barbell are enterprises who are getting real value from AI in cost avoidance and productivity. And these are things like automating customer service or business process automation or fraud." "In the middle of the barbell is all of the current enterprise production workloads, some of which are using inference in a pervasive way, but most of which aren't. And that is going to change very significantly over time." "And that will be, in my opinion, that will be the largest absolute segment, the existing production workloads in the enterprise and new businesses and workloads that startups build too."

Fireside Alpha

29,242 次观看 • 23 天前