Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Creator of High Bandwidth Memory: "How much HBM a country possesses determines national AI hegemony and the competitiveness of AI companies. Memory determines which is better: Google Gemini, OpenAI, or Anthropic Claude."

firesidealpha's profile picture

Fireside Alpha

10,577 subscribers

98,087 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

HBM innovation knows no limits. From 8 layers to 12 layers, and now 16 layers—SK hynix keeps pushing the boundaries of AI memory. With up to 48GB capacity and 1.2TB/s+ bandwidth, our latest 16-Layer HBM takes AI performance to the next level. #SKhynix #HBM #AI #Memory
0:25

HBM innovation knows no limits. From 8 layers to 12 layers, and now 16 layers—SK hynix keeps pushing the boundaries of AI memory. With up to 48GB capacity and 1.2TB/s+ bandwidth, our latest 16-Layer HBM takes AI performance to the next level. #SKhynix #HBM #AI #Memory

SK hynix

15,059 Aufrufe • vor 1 Jahr

OpenAI founder Greg Brockman said that future GDP growth will be driven by how much compute a country can deploy as AI agents begin running for hours or days for every person. He added that scaling this world requires billions of GPUs which is why OpenAI is optimizing inference on $AMD MI455 around bandwidth & HBM memory per dollar rather than raw peak specs.
2:48

OpenAI founder Greg Brockman said that future GDP growth will be driven by how much compute a country can deploy as AI agents begin running for hours or days for every person. He added that scaling this world requires billions of GPUs which is why OpenAI is optimizing inference on $AMD MI455 around bandwidth & HBM memory per dollar rather than raw peak specs.

Shay Boloor

158,315 Aufrufe • vor 7 Monaten

We just launched a new primitive for AI Walrus Memory gives your agents persistent, portable memory that you own, and it drops straight into the platforms you already build on. Anthropic Claude, OpenAI ChatGPT, and Google Gemini, you name it plus native MCP and SDKs, added in a few lines of code LIVE TODAY
1:04

We just launched a new primitive for AI Walrus Memory gives your agents persistent, portable memory that you own, and it drops straight into the platforms you already build on. Anthropic Claude, OpenAI ChatGPT, and Google Gemini, you name it plus native MCP and SDKs, added in a few lines of code LIVE TODAY

Adeniyi.sui

46,164 Aufrufe • vor 2 Monaten

SK Hynix's Hoshik Kim admits high bandwidth memory "is not the answer" to the memory-wall problem, and SK is working on different solutions to solve the bottleneck. "No, actually, I kind of agree with Pat. So HBM is not the answer." [SK Hynix is admitting that HBM is a bad memory?] "Nothing is a bad memory. It's a good memory, but it's not the final answer. So actually, HBM will not solve the memory-wall problem. Memory-wall problem is an inherent AI problem, which you cannot avoid." "So we try our best to provide higher bandwidth with this memory, with HBM technology even though it has some limitation, as Pat already mentioned, with thermal, IOs, cost, a lot of stuff. "But that's the only thing we got right now to help ease this memory-wall problem, memory-bottleneck problem. But at the same time, we are working in different directions to solve this memory-wall problem with different solutions."
0:51

SK Hynix's Hoshik Kim admits high bandwidth memory "is not the answer" to the memory-wall problem, and SK is working on different solutions to solve the bottleneck. "No, actually, I kind of agree with Pat. So HBM is not the answer." [SK Hynix is admitting that HBM is a bad memory?] "Nothing is a bad memory. It's a good memory, but it's not the final answer. So actually, HBM will not solve the memory-wall problem. Memory-wall problem is an inherent AI problem, which you cannot avoid." "So we try our best to provide higher bandwidth with this memory, with HBM technology even though it has some limitation, as Pat already mentioned, with thermal, IOs, cost, a lot of stuff. "But that's the only thing we got right now to help ease this memory-wall problem, memory-bottleneck problem. But at the same time, we are working in different directions to solve this memory-wall problem with different solutions."

Fireside Alpha

140,156 Aufrufe • vor 10 Tagen

Persistent memory is the Achilles heel of AI. Engramme’s Large Memory Models (LMMs) empower every app with persistent memory. Google solved search. OpenAI solved language. Engramme solved memory. Join beta:
1:01

Persistent memory is the Achilles heel of AI. Engramme’s Large Memory Models (LMMs) empower every app with persistent memory. Google solved search. OpenAI solved language. Engramme solved memory. Join beta:

Engramme

1,135,324 Aufrufe • vor 3 Monaten

Teaming up with SanDisk to build the next standard for AI inference. As a full-stack AI memory creator, SK hynix is launching the global standardization of #HBF with Sandisk & Open Compute Project (OCP). HBF is the new memory layer bridging the gap between #HBM and #SSD. #SKhynix
1:25

Teaming up with SanDisk to build the next standard for AI inference. As a full-stack AI memory creator, SK hynix is launching the global standardization of #HBF with Sandisk & Open Compute Project (OCP). HBF is the new memory layer bridging the gap between #HBM and #SSD. #SKhynix

SK hynix

194,727 Aufrufe • vor 5 Monaten

the most important thing about walrus memory is it works everywhere you're already building Anthropic Claude, OpenAI ChatGPT, and Google Gemini, with native mcp support and sdks for python, typescript and javascript plus, it's fully open source go start building
0:58

the most important thing about walrus memory is it works everywhere you're already building Anthropic Claude, OpenAI ChatGPT, and Google Gemini, with native mcp support and sdks for python, typescript and javascript plus, it's fully open source go start building

Adeniyi.sui

16,775 Aufrufe • vor 1 Monat

Speaking of spot on. Gavin Gavin Baker was asked in early Jan'25 his prediction for best performing asset class of the year (as @jason references in latest The All-In Podcast): "I think the companies that make high bandwidth memory. Going back to "we're going to run out of compute," it's actually a pretty shocking stat: high bandwidth memory is a bigger part of NVIDIA's COGS on GPUs than Taiwan Semi is. And today there's two companies that can make it, SK Hynix and Micron. We'll see if Samsung gets their act together. But HBM, it's in NVIDIA GPUs, AMD GPUs, Amazon Trainiums. And particularly in a world of test-time compute and inference being so important, high bandwidth memory is arguably more important than it ever was. And it's been sold out for the last two years. So high bandwidth memory would be my pick."
0:52

Speaking of spot on. Gavin Gavin Baker was asked in early Jan'25 his prediction for best performing asset class of the year (as @jason references in latest The All-In Podcast): "I think the companies that make high bandwidth memory. Going back to "we're going to run out of compute," it's actually a pretty shocking stat: high bandwidth memory is a bigger part of NVIDIA's COGS on GPUs than Taiwan Semi is. And today there's two companies that can make it, SK Hynix and Micron. We'll see if Samsung gets their act together. But HBM, it's in NVIDIA GPUs, AMD GPUs, Amazon Trainiums. And particularly in a world of test-time compute and inference being so important, high bandwidth memory is arguably more important than it ever was. And it's been sold out for the last two years. So high bandwidth memory would be my pick."

Fireside Alpha

66,227 Aufrufe • vor 1 Monat

Claude Code performs a complete analysis of Gemini-CLI and OpenAI Codex using Deep Graph MCP... one command to implement Claude Code automatically pulls two popular AI assistant repos and performs deep architectural analysis to determine which one is actually better built. Single command to implement: claude mcp add "Deep Graph MCP" npx -- -y mcp-code-graph@latest google-gemini/gemini-cli openai/codex The results might surprise you 👇
1:23

Claude Code performs a complete analysis of Gemini-CLI and OpenAI Codex using Deep Graph MCP... one command to implement Claude Code automatically pulls two popular AI assistant repos and performs deep architectural analysis to determine which one is actually better built. Single command to implement: claude mcp add "Deep Graph MCP" npx -- -y mcp-code-graph@latest google-gemini/gemini-cli openai/codex The results might surprise you 👇

Daniel San

68,001 Aufrufe • vor 1 Jahr

$MU hit a $1T valuation today because the market is waking up to the idea that memory may actually become one of the core infrastructure layers of the AI economy. The catalyst was SK Hynix unveiling iHBM which is a new cooling technology for next-gen HBM but the bigger point is that token growth, AI factories, inference demand & next-gen accelerators all require more HBM per system. More HBM per accelerator means more memory dollar content & with only three major HBM suppliers in the world the entire memory complex is getting re-rated.
0:54

$MU hit a $1T valuation today because the market is waking up to the idea that memory may actually become one of the core infrastructure layers of the AI economy. The catalyst was SK Hynix unveiling iHBM which is a new cooling technology for next-gen HBM but the bigger point is that token growth, AI factories, inference demand & next-gen accelerators all require more HBM per system. More HBM per accelerator means more memory dollar content & with only three major HBM suppliers in the world the entire memory complex is getting re-rated.

Shay Boloor

306,107 Aufrufe • vor 2 Monaten

$MU $00060 $00530 $TSM Evolution of the AI Memory Hierarchy: HBM, DRAM, & SRAM Overview and Market Analysis The video outlines the strategic shift of modern computing toward a memory-centric architecture driven by the demands of generative AI. It explains that the industry is moving away from a traditional commodity model to a tightly coupled hierarchy of specialized technologies, where High Bandwidth Memory (HBM) and advanced packaging act as primary bottlenecks for performance. Leading manufacturers like SK hynix, Samsung, and Micron are navigating complex transitions to HBM4 and CXL-based expansion to overcome data movement constraints. Beyond the memory producers, the ecosystem relies on integration enablers like TSMC for packaging and specialized equipment providers for high-precision manufacturing. Ultimately, the analysis suggests that memory intensity and power efficiency have become the decisive factors in the success of gigawatt-scale data centers.
14:38

$MU $00060 $00530 $TSM Evolution of the AI Memory Hierarchy: HBM, DRAM, & SRAM Overview and Market Analysis The video outlines the strategic shift of modern computing toward a memory-centric architecture driven by the demands of generative AI. It explains that the industry is moving away from a traditional commodity model to a tightly coupled hierarchy of specialized technologies, where High Bandwidth Memory (HBM) and advanced packaging act as primary bottlenecks for performance. Leading manufacturers like SK hynix, Samsung, and Micron are navigating complex transitions to HBM4 and CXL-based expansion to overcome data movement constraints. Beyond the memory producers, the ecosystem relies on integration enablers like TSMC for packaging and specialized equipment providers for high-precision manufacturing. Ultimately, the analysis suggests that memory intensity and power efficiency have become the decisive factors in the success of gigawatt-scale data centers.

TheValueist

23,901 Aufrufe • vor 7 Monaten

ELON MUSK: "How often is the most ironic outcome the most likely? Look at the names of AI companies. Midjourney is not mid. Stability AI is unstable. OpenAI is closed. Anthropic is misanthropic."
0:52

ELON MUSK: "How often is the most ironic outcome the most likely? Look at the names of AI companies. Midjourney is not mid. Stability AI is unstable. OpenAI is closed. Anthropic is misanthropic."

DogeDesigner

87,864 Aufrufe • vor 3 Monaten

The heads of AI companies OpenAI and Anthropic refused to hold hands in a group photo at the opening of a major AI summit in India. The rivalry between Sam Altman of OpenAI and Dario Amodei of Anthropic escalated this year when the latter ran attack ads during the Super Bowl.
0:20

The heads of AI companies OpenAI and Anthropic refused to hold hands in a group photo at the opening of a major AI summit in India. The rivalry between Sam Altman of OpenAI and Dario Amodei of Anthropic escalated this year when the latter ran attack ads during the Super Bowl.

Al Jazeera English

27,810 Aufrufe • vor 5 Monaten

Dario Amodei, CEO of Anthropic says that researcher-lead AI companies, like Anthropic and Google will succeed going forward. He declined to comment about what would happen to companies, like OpenAI, xAI and META, that aren't led by researchers.
0:34

Dario Amodei, CEO of Anthropic says that researcher-lead AI companies, like Anthropic and Google will succeed going forward. He declined to comment about what would happen to companies, like OpenAI, xAI and META, that aren't led by researchers.

Lisan al Gaib

180,583 Aufrufe • vor 6 Monaten

Robinhood CEO Vlad Tenev says AI lacks public support because everyday investors are shut out of the upside, and can’t invest in any of the significant AI companies: "Aside from Google—OpenAI, Anthropic, all the startups, they’re basically out of reach for normal people."
1:38

Robinhood CEO Vlad Tenev says AI lacks public support because everyday investors are shut out of the upside, and can’t invest in any of the significant AI companies: "Aside from Google—OpenAI, Anthropic, all the startups, they’re basically out of reach for normal people."

sourcery

70,384 Aufrufe • vor 2 Monaten

Context memory essentially unlocks Agentic AI Much needed for Opus 4.6's "multi-agent swarms" In this SemiDoped pod, Vikram Sekar talks to Val Bercovici from Weka about context storage. - How token warehouses save inference costs - A new networking tier? Context Storage Network! - High Bandwidth Flash for context? - Weka's Augmented Memory Grid for context storage - Where this is all headed The convo is info packed. Don't miss out on it! b/acc, context platform engineer Chapters (00:00) Introduction to Weka and AI Storage Solutions (05:18) The Evolution of Context Memory in AI (09:30) Understanding Memory Hierarchies and Their Impact (16:24) Latency Challenges in Modern Storage Solutions (21:32) The Role of Networking in AI Storage Efficiency (29:42) Dynamic Resource Utilization in AI Networks (30:04) Introducing the Context Memory Network (31:13) High Bandwidth Flash: A Game Changer (32:54) Weka’s Neural Mesh and Storage Solutions (35:01) Axon: Transforming GPU Storage into Memory (39:00) Augmented Memory Grid Explained (42:00) Pooling DRAM and CXL Innovations (46:02) Token Warehouses and Inference Economics (52:10) The Future of Storage Innovations
54:27

Context memory essentially unlocks Agentic AI Much needed for Opus 4.6's "multi-agent swarms" In this SemiDoped pod, Vikram Sekar talks to Val Bercovici from Weka about context storage. - How token warehouses save inference costs - A new networking tier? Context Storage Network! - High Bandwidth Flash for context? - Weka's Augmented Memory Grid for context storage - Where this is all headed The convo is info packed. Don't miss out on it! b/acc, context platform engineer Chapters (00:00) Introduction to Weka and AI Storage Solutions (05:18) The Evolution of Context Memory in AI (09:30) Understanding Memory Hierarchies and Their Impact (16:24) Latency Challenges in Modern Storage Solutions (21:32) The Role of Networking in AI Storage Efficiency (29:42) Dynamic Resource Utilization in AI Networks (30:04) Introducing the Context Memory Network (31:13) High Bandwidth Flash: A Game Changer (32:54) Weka’s Neural Mesh and Storage Solutions (35:01) Axon: Transforming GPU Storage into Memory (39:00) Augmented Memory Grid Explained (42:00) Pooling DRAM and CXL Innovations (46:02) Token Warehouses and Inference Economics (52:10) The Future of Storage Innovations

Semi Doped

12,796 Aufrufe • vor 5 Monaten

I did not know how much of a data advantage Google has over the other AI companies. Matthew Prince 🌥 says they can access 3X as much data as OpenAI and nearly 5X as much as Bing. This could make it hard for those models—and Grok—to beat Gemini in the long run.
4:24

I did not know how much of a data advantage Google has over the other AI companies. Matthew Prince 🌥 says they can access 3X as much data as OpenAI and nearly 5X as much as Bing. This could make it hard for those models—and Grok—to beat Gemini in the long run.

nxthompson

22,536 Aufrufe • vor 6 Monaten

The creator of High Bandwidth Memory (HBM) put a number on the AI build that should stop every infra investor cold. A cluster of a million GPUs runs at roughly 10-20% utilization (Save this). Kim Jung-ho spent thirty years building what feeds the GPU, and his claim is that the GPU is barely working. Here is what is actually happening. Every time a model generates output, the data has to be read out of memory, computed, and written back. The read and the write swallow almost the entire cycle. While that data moves, the GPU does nothing. It sits there, fully powered, fully paid for, waiting. By Kim's estimate the memory is doing only about 30 percent of the work it needs to do. The processor idles the rest. So a million installed GPUs run at 10 to 20 percent. You are not compute constrained. You are memory constrained, and the expensive part is standing around. Adding more GPUs does not fix this. It gives you more processors starving for the same data. Here is the part that decides the next decade. Memory can grow. When a cell cannot shrink any further, you stack it into a high-rise, layer on layer. A GPU cannot be stacked. It runs too hot and needs a cooler bolted to its back, so the one move that rescues memory is closed to the processor. The thing that can keep stacking compounds. The thing that cannot plateaus. The marginal dollar in an AI build now buys more by fixing the memory path than by bolting on another idle GPU. Which is why the companies that control memory bandwidth and supply are not suppliers to the AI trade. They are the AI trade.
0:50

The creator of High Bandwidth Memory (HBM) put a number on the AI build that should stop every infra investor cold. A cluster of a million GPUs runs at roughly 10-20% utilization (Save this). Kim Jung-ho spent thirty years building what feeds the GPU, and his claim is that the GPU is barely working. Here is what is actually happening. Every time a model generates output, the data has to be read out of memory, computed, and written back. The read and the write swallow almost the entire cycle. While that data moves, the GPU does nothing. It sits there, fully powered, fully paid for, waiting. By Kim's estimate the memory is doing only about 30 percent of the work it needs to do. The processor idles the rest. So a million installed GPUs run at 10 to 20 percent. You are not compute constrained. You are memory constrained, and the expensive part is standing around. Adding more GPUs does not fix this. It gives you more processors starving for the same data. Here is the part that decides the next decade. Memory can grow. When a cell cannot shrink any further, you stack it into a high-rise, layer on layer. A GPU cannot be stacked. It runs too hot and needs a cooler bolted to its back, so the one move that rescues memory is closed to the processor. The thing that can keep stacking compounds. The thing that cannot plateaus. The marginal dollar in an AI build now buys more by fixing the memory path than by bolting on another idle GPU. Which is why the companies that control memory bandwidth and supply are not suppliers to the AI trade. They are the AI trade.

Fireside Alpha

38,370 Aufrufe • vor 1 Monat

Anthropic CEO Dario Amodei: "Some early companies got Mythos and told us this is a super weapon, please don't release it" On leaving OpenAI: "When you can't trust someone, and their values don't match what they say, it becomes very hard to stay" Boris Cherny, head of Claude Code: "90% of code at Anthropic is written by Claude, a lot of Claude Code is written by Claude Code" Then Dario says the quiet part even louder: 10–25% odds of civilizational collapse from AI 47 minutes Free Dario, Daniela, Boris Probably the deepest look inside Anthropic ever filmed Mythos Claude Code OpenAI split Superweapon models 90% AI-written code Bookmark it and watch ↓
48:30

Anthropic CEO Dario Amodei: "Some early companies got Mythos and told us this is a super weapon, please don't release it" On leaving OpenAI: "When you can't trust someone, and their values don't match what they say, it becomes very hard to stay" Boris Cherny, head of Claude Code: "90% of code at Anthropic is written by Claude, a lot of Claude Code is written by Claude Code" Then Dario says the quiet part even louder: 10–25% odds of civilizational collapse from AI 47 minutes Free Dario, Daniela, Boris Probably the deepest look inside Anthropic ever filmed Mythos Claude Code OpenAI split Superweapon models 90% AI-written code Bookmark it and watch ↓

rari

65,014 Aufrufe • vor 1 Monat