The Circuit
@T_h_e_Circuit • 2,261 subscribers
The Circuit - a show dedicated to the business of the semiconductor industry featuring Jay Goldberg and Ben Bajarin. Top 50 in Tech on Apple Podcasts.
Videos
Breaking the Memory Wall: Micron’s Strategy for the AI Era Ben Bajarin and Jay Goldberg 顾忠南 talk micron's strategy for the AI era with Jeremy Werner SVP and GM of Micron’s Core Data Center Business Unit. Chapters: (00:00) Introduction and Guest Welcome (01:12) How the AI Cycle Differs from Past Volatility (04:23) Anticipating the Explosive Growth of AI (06:40) The Long-Term Sustainability of the AI Market (10:07) The "Memory Wall" in AI Inference (12:05) Explaining KV Cache and Context Windows (15:07) The Memory Hierarchy: From HBM to SSDs (20:21) Scaling for Billions of Simultaneous Users (23:05) Solving the Power and Efficiency Bottleneck (26:27) Why AI is Driving a Storage Shortage (29:57) Personal AI Agents and Persistent Memory Needs (34:13) Innovations in Ultra-High-Capacity SSDs (39:00) Accelerating the Pace of Engineering Innovation (43:50) Market Misunderstandings and the Future Potential of AI (47:38) The Global Race to Build New Fabs (51:34) Closing Remarks
The Circuit94,404 views • 3 months ago
More good News for Intel, AI Model Trends, Future of Datacenter With Ben Bajarin and Jay Goldberg 顾忠南 Chapters (00:00) Intel's New Partnership with Tesla (03:02) Market Reactions and Implications for Intel (05:53) Google's Collaboration with Intel (08:56) The Semiconductor Market Dynamics (12:06) Valuation Discrepancies in the Semiconductor Sector (14:59) Deep Dive into Semiconductor Supply Chains (17:56) Future of Data Centers and Energy Efficiency (22:38) The Evolution of Data Center Design (31:24) AI's Impact on Software and Productivity (39:10) Token Usage and Efficiency in AI (42:35) Cost Dynamics in the Semiconductor Industry
The Circuit17,871 views • 4 months ago
TPUs Via Cloud Next, Intel Earnings, Foundry Scarcity Ben Bajarin and Jay Goldberg 顾忠南 discuss: 00:00 - Ben and Jay introduce an action-packed episode covering a massive week of semiconductor announcements. 00:10 - Ben recaps his experience at Google Next, highlighting the launch of the new TPU v5p and v5i accelerators. 02:35 - The hosts discuss the physical design of the new inference chips and how they differ from training hardware. 03:04 - A deep dive into memory architecture explores the use of HBM and the "Boardfly" networking innovation. 04:15 - Jay notes reports of Google working on SRAM-based inference chips to solve the HBM supply bottleneck. 07:22 - Google's leadership draws a historical parallel between today's AI training costs and their early days of indexing the web. 11:11 - The duo critiques the enterprise focus of the Google Next keynote and the current productivity gap in Gemini. 15:24 - Intel's recent earnings report shows a significant beat on revenue and guidance driven by a "CPU resurgence". 18:31 - Ben and Jay debate the strategic advantage of Intel owning its own fabs during a global capacity shortage. 25:51 - The conversation shifts to Intel's manufacturing roadmap and the potential for Tesla to become a 14A customer. 33:23 - An analysis of Intel's new financial reporting structure reveals the massive internal scale of their foundry business. 40:27 - Recent drama at the TSMC Symposium is discussed, specifically regarding the high cost of ASML's High-NA EUV tools. 44:23 - Growing demand for AI and memory is driving Wafer Fabrication Equipment (WFE) forecasts to record highs. 47:06 - Ben and Jay conclude by debating the long-term durability of the current semiconductor bull cycle
The Circuit12,020 views • 3 months ago
No more content to load