Загрузка видео...

Не удалось загрузить видео

На главную

Context memory essentially unlocks Agentic AI Much needed for Opus 4.6's "multi-agent swarms" In this SemiDoped pod, Vikram Sekar talks to Val Bercovici from Weka about context storage. - How token warehouses save inference costs - A new networking tier? Context Storage Network! - High Bandwidth Flash for context?...

semidoped's profile picture

Semi Doped

3,349 subscribers

12,796 просмотров • 5 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Breaking the Memory Wall: Micron’s Strategy for the AI Era Ben Bajarin and Jay Goldberg 顾忠南 talk micron's strategy for the AI era with Jeremy Werner SVP and GM of Micron’s Core Data Center Business Unit. Chapters: (00:00) Introduction and Guest Welcome (01:12) How the AI Cycle Differs from Past Volatility (04:23) Anticipating the Explosive Growth of AI (06:40) The Long-Term Sustainability of the AI Market (10:07) The "Memory Wall" in AI Inference (12:05) Explaining KV Cache and Context Windows (15:07) The Memory Hierarchy: From HBM to SSDs (20:21) Scaling for Billions of Simultaneous Users (23:05) Solving the Power and Efficiency Bottleneck (26:27) Why AI is Driving a Storage Shortage (29:57) Personal AI Agents and Persistent Memory Needs (34:13) Innovations in Ultra-High-Capacity SSDs (39:00) Accelerating the Pace of Engineering Innovation (43:50) Market Misunderstandings and the Future Potential of AI (47:38) The Global Race to Build New Fabs (51:34) Closing Remarks
52:31

Breaking the Memory Wall: Micron’s Strategy for the AI Era Ben Bajarin and Jay Goldberg 顾忠南 talk micron's strategy for the AI era with Jeremy Werner SVP and GM of Micron’s Core Data Center Business Unit. Chapters: (00:00) Introduction and Guest Welcome (01:12) How the AI Cycle Differs from Past Volatility (04:23) Anticipating the Explosive Growth of AI (06:40) The Long-Term Sustainability of the AI Market (10:07) The "Memory Wall" in AI Inference (12:05) Explaining KV Cache and Context Windows (15:07) The Memory Hierarchy: From HBM to SSDs (20:21) Scaling for Billions of Simultaneous Users (23:05) Solving the Power and Efficiency Bottleneck (26:27) Why AI is Driving a Storage Shortage (29:57) Personal AI Agents and Persistent Memory Needs (34:13) Innovations in Ultra-High-Capacity SSDs (39:00) Accelerating the Pace of Engineering Innovation (43:50) Market Misunderstandings and the Future Potential of AI (47:38) The Global Race to Build New Fabs (51:34) Closing Remarks

The Circuit

94,249 просмотров • 2 месяцев назад

New short course: LLMs as Operating Systems: Agent Memory, created with Letta, and taught by its founders Charles Packer and Sarah Wooders. An LLM's input context window has limited space. Using a longer input context also costs more and results in slower processing. So, managing what's stored in this context window is important. In the innovative paper MemGPT: Towards LLMs as Operating Systems, its authors (which include the instructors) proposed using an LLM agent to manage this context window. Their system uses a large persistent memory that stores everything that could be included in the input context, and an agent decides what is actually included. Take the example of building a chatbot that needs to remember what's been said earlier in a conversation (perhaps over many days of interaction with a user). As the conversation's length grows, the memory management agent will move information from the input context to a persistent searchable database; summarize information to keep relevant facts in the input context; and restore relevant conversation elements from further back in time. This allows a chatbot to keep what's currently most relevant in its input context memory to generate the next response. When I read the original MemGPT paper, I thought it was an innovative technique for handling memory for LLMs. The open-source Letta framework, which we'll use in this course, makes MemGPT easy to implement. It adds memory to your LLM agents and gives them transparent long-term memory. In detail, you’ll learn: - How to build an agent that can edit its own limited input context memory, using tools and multi-step reasoning - What is a memory hierarchy (an idea from computer operating systems, which use a cache to speed up memory access), and how these ideas apply to managing the LLM input context (where the input context window is a "cache" storing the most relevant information; and an agent decides what to move in and out of this to/from a larger persistent storage system) - How to implement multi-agent collaboration by letting different agents share blocks of memory This course will give you a sophisticated understanding of memory management for LLMs, which is important for chatbots having long conversations, and for complex agentic workflows. Please sign up here!
2:57

New short course: LLMs as Operating Systems: Agent Memory, created with Letta, and taught by its founders Charles Packer and Sarah Wooders. An LLM's input context window has limited space. Using a longer input context also costs more and results in slower processing. So, managing what's stored in this context window is important. In the innovative paper MemGPT: Towards LLMs as Operating Systems, its authors (which include the instructors) proposed using an LLM agent to manage this context window. Their system uses a large persistent memory that stores everything that could be included in the input context, and an agent decides what is actually included. Take the example of building a chatbot that needs to remember what's been said earlier in a conversation (perhaps over many days of interaction with a user). As the conversation's length grows, the memory management agent will move information from the input context to a persistent searchable database; summarize information to keep relevant facts in the input context; and restore relevant conversation elements from further back in time. This allows a chatbot to keep what's currently most relevant in its input context memory to generate the next response. When I read the original MemGPT paper, I thought it was an innovative technique for handling memory for LLMs. The open-source Letta framework, which we'll use in this course, makes MemGPT easy to implement. It adds memory to your LLM agents and gives them transparent long-term memory. In detail, you’ll learn: - How to build an agent that can edit its own limited input context memory, using tools and multi-step reasoning - What is a memory hierarchy (an idea from computer operating systems, which use a cache to speed up memory access), and how these ideas apply to managing the LLM input context (where the input context window is a "cache" storing the most relevant information; and an agent decides what to move in and out of this to/from a larger persistent storage system) - How to implement multi-agent collaboration by letting different agents share blocks of memory This course will give you a sophisticated understanding of memory management for LLMs, which is important for chatbots having long conversations, and for complex agentic workflows. Please sign up here!

Andrew Ng

200,788 просмотров • 1 год назад

Dylan Patel on the importance of memory and storage Two key quotes: "An $NVDA GPU is faster than an $AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads." “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly" Full Quote: “We have over $80 million of compute: GPUs from $NVDA and $AMD, TPUs from Google, and Trainium from Amazon. We constantly run this benchmark using the newest inference engines, drivers, PyTorch versions, and other software. It runs every day through automated CI across the latest Chinese models from GLM, Zhipu, Moonshot, Kimi, Alibaba, and others. Initially, when we were benchmarking the differences between these chips, inference engines, and parallelism schemes, we used fixed context lengths. But with Agent X, we have now analyzed more than $5 million worth of Claude Code traces. This is real production traffic that users have donated to us, combined with internally generated data, so we now understand what an actual agent workload looks like. When we implement those workloads and run the benchmarks, it turns out that the chip you are using is very important, but how you handle memory offload can be even more important. An Nvidia GPU is faster than an AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads. Similarly, you can use a less powerful GPU with a much better storage solution and outperform the best GPU when it lacks those solutions. Simply buying the newest GPU does not necessarily give you the best inference economics. You need to layer in other innovations, including storage and memory.” Interviewer: “Who is the top player on your chart? Can you tell us?” Dylan Patel: “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly.”
2:27

Dylan Patel on the importance of memory and storage Two key quotes: "An $NVDA GPU is faster than an $AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads." “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly" Full Quote: “We have over $80 million of compute: GPUs from $NVDA and $AMD, TPUs from Google, and Trainium from Amazon. We constantly run this benchmark using the newest inference engines, drivers, PyTorch versions, and other software. It runs every day through automated CI across the latest Chinese models from GLM, Zhipu, Moonshot, Kimi, Alibaba, and others. Initially, when we were benchmarking the differences between these chips, inference engines, and parallelism schemes, we used fixed context lengths. But with Agent X, we have now analyzed more than $5 million worth of Claude Code traces. This is real production traffic that users have donated to us, combined with internally generated data, so we now understand what an actual agent workload looks like. When we implement those workloads and run the benchmarks, it turns out that the chip you are using is very important, but how you handle memory offload can be even more important. An Nvidia GPU is faster than an AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads. Similarly, you can use a less powerful GPU with a much better storage solution and outperform the best GPU when it lacks those solutions. Simply buying the newest GPU does not necessarily give you the best inference economics. You need to layer in other innovations, including storage and memory.” Interviewer: “Who is the top player on your chart? Can you tell us?” Dylan Patel: “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly.”

Daniel Romero

38,220 просмотров • 19 дней назад

Vik and Val Bercovici (WEKA) map where AI inference memory is headed. Every 100x cut in KV cache gets swallowed by ~10,000x more usage, so demand climbs. - NVLink beats the board: 128 lanes vs 32 PCIe - WEKA serves NAND-backed storage faster than DRAM over network - DeepSeek's cache reads run ~87x cheaper, China only - CXL needs a dedicated bus, WEKA pools NAND over RDMA/NVLink instead - Val's call: SaaS giants and Neoclouds must merge Chapters: 0:00 Intro and memory prices 3:00 Model routing and offloading 5:10 Network faster than motherboard 13:06 Four-tier memory hierarchy 19:40 KV cache and Jevons paradox 23:50 DeepSeek cache read pricing 31:40 Sliding window attention 34:49 NAND tiers, SLC vs QLC 43:57 High bandwidth flash use cases 49:59 CXL versus NVLink 53:44 AMD Mex and small models 1:03:14 SaaS, Neoclouds and tokenomics Get more of Austin and Vik daily, free! Sign up: Connect with Vik and Austin: Vik's Paid Substack: Austin's Paid Substack: Austin Lyons Vikram Sekar
1:04:11

Vik and Val Bercovici (WEKA) map where AI inference memory is headed. Every 100x cut in KV cache gets swallowed by ~10,000x more usage, so demand climbs. - NVLink beats the board: 128 lanes vs 32 PCIe - WEKA serves NAND-backed storage faster than DRAM over network - DeepSeek's cache reads run ~87x cheaper, China only - CXL needs a dedicated bus, WEKA pools NAND over RDMA/NVLink instead - Val's call: SaaS giants and Neoclouds must merge Chapters: 0:00 Intro and memory prices 3:00 Model routing and offloading 5:10 Network faster than motherboard 13:06 Four-tier memory hierarchy 19:40 KV cache and Jevons paradox 23:50 DeepSeek cache read pricing 31:40 Sliding window attention 34:49 NAND tiers, SLC vs QLC 43:57 High bandwidth flash use cases 49:59 CXL versus NVLink 53:44 AMD Mex and small models 1:03:14 SaaS, Neoclouds and tokenomics Get more of Austin and Vik daily, free! Sign up: Connect with Vik and Austin: Vik's Paid Substack: Austin's Paid Substack: Austin Lyons Vikram Sekar

Semi Doped

59,992 просмотров • 19 дней назад

Decentralised Storage, Served Fresh ft pranav | Shelby from Shelby In this episode of the Touch Grass Podcast, Karthikeya and I sat down with Pranav to chat about - > hot and cold storage > top usecases for decentralised storage > the 6 pillars that make shelby work and much more! 0:44 - Pranav's experience at IBW over the years 2:14 - the story behind Shelby 5:00 - why 2026 is the year for decentralised storage 7:50 - the competitor landscape 9:54 - the 6 pillars that make shelby work (and where Aptos fits in) 12:11- top usecases for shelby 15:42 - the rise of new AI marketplaces 16:24 - is India a prime market for shelby? 17:51 - shelby's long term vision 18:48 - hot vs cold data 20:53 - RFP: shared memory layer for all AI agents 25:08 - lessons from facebook → aptos → shelby (career advice) 27:16 - Pranav's #1 message to the shelby community
28:13

Decentralised Storage, Served Fresh ft pranav | Shelby from Shelby In this episode of the Touch Grass Podcast, Karthikeya and I sat down with Pranav to chat about - > hot and cold storage > top usecases for decentralised storage > the 6 pillars that make shelby work and much more! 0:44 - Pranav's experience at IBW over the years 2:14 - the story behind Shelby 5:00 - why 2026 is the year for decentralised storage 7:50 - the competitor landscape 9:54 - the 6 pillars that make shelby work (and where Aptos fits in) 12:11- top usecases for shelby 15:42 - the rise of new AI marketplaces 16:24 - is India a prime market for shelby? 17:51 - shelby's long term vision 18:48 - hot vs cold data 20:53 - RFP: shared memory layer for all AI agents 25:08 - lessons from facebook → aptos → shelby (career advice) 27:16 - Pranav's #1 message to the shelby community

Rachit Agarwal

11,979 просмотров • 7 месяцев назад

Where are all the consumer AI apps??? This is the question I posed to s-tier consumer investors scott belsky (Uber, Pinterest) and steve jang (Coinbase, Postmates). We're almost 3 years into the AI hype the we're still all mostly just talking about ChatGPT, Perplexity, and Claude. We explore the answer through the ways in which the entire consumer stack (input, memory, personalization, browsers, hardware) are being re-written by AI and how that may give birth to the consumer opportunity we've all been waiting for. Chapters: 00:00 Welcome and Introductions 00:43 The Current State of AI Products 02:48 Surprises and Challenges with LLMs 05:24 Future of Consumer AI and Personal AI 15:49 Memory and Personalization in AI 21:52 Potential Risks and Business Models 24:22 The Battle for User Data in AI 25:11 Optimism in AI Model Inference 27:00 The Role of Open Source Models 28:13 The Future of AI Hardware 28:54 Challenges and Opportunities in AI Hardware Startups 30:29 The Evolution of Consumer Hardware 38:36 The Reinvention of Browsers 46:23 The Potential of AI-Enhanced Browsers 47:54 Conclusion and Final Thoughts Many thanks to my good friends for joining me in this discussion 🙏
45:47

Where are all the consumer AI apps??? This is the question I posed to s-tier consumer investors scott belsky (Uber, Pinterest) and steve jang (Coinbase, Postmates). We're almost 3 years into the AI hype the we're still all mostly just talking about ChatGPT, Perplexity, and Claude. We explore the answer through the ways in which the entire consumer stack (input, memory, personalization, browsers, hardware) are being re-written by AI and how that may give birth to the consumer opportunity we've all been waiting for. Chapters: 00:00 Welcome and Introductions 00:43 The Current State of AI Products 02:48 Surprises and Challenges with LLMs 05:24 Future of Consumer AI and Personal AI 15:49 Memory and Personalization in AI 21:52 Potential Risks and Business Models 24:22 The Battle for User Data in AI 25:11 Optimism in AI Model Inference 27:00 The Role of Open Source Models 28:13 The Future of AI Hardware 28:54 Challenges and Opportunities in AI Hardware Startups 30:29 The Evolution of Consumer Hardware 38:36 The Reinvention of Browsers 46:23 The Potential of AI-Enhanced Browsers 47:54 Conclusion and Final Thoughts Many thanks to my good friends for joining me in this discussion 🙏

Michael Mignano

25,155 просмотров • 1 год назад

Dylan Patel of SemiAnalysis says a worse GPU with better storage and memory now beats the best chip without them, so buying the newest GPU alone no longer wins inference. So, an AMD GPU with more memory can outperform Nvidia in some cases. "So what we have is we have over $80 million of compute, GPUs from Nvidia, AMD, TPUs from Google, Trainium from Amazon, and we run this benchmark constantly on the newest inference engine, newest drivers, newest PyTorch version, whatever it is." "Every day it runs on an automated CI, and we run it on all the latest Chinese models, from GLM, Zhipu, Moonshot, Kimi, Alibaba, all these models we run." "Initially, when we were benchmarking the difference between these chips and different engines, different schemes for parallelism, we were just running it fixed context length." "But now with Agent X, we've analyzed over $5 million worth of Claude Code traces. This is real production traffic that people have donated to us as well as internally generated. Now we know what the actual agent workload looks like." "And then as we implement that and run those benchmarks, it turns out yes, the chip you're using is very important, but now even more important is how are you handling this memory offload?" "And so while an Nvidia GPU is faster than an AMD GPU in most cases, because AMD GPUs have more memory, they actually end up outperforming in some cases." "Or you can have a worse GPU, but a much better storage solution, and now you can outperform what the best GPU can do without those solutions. So just buying the newest and latest GPU alone doesn't get you the best inference economics." "Actually, you need to layer in all these other innovations including storage and memory." [ Who's the top player on your chart? ] "That really is a difficult multivariable problem. And generally that means you need to have, yes, you need to have the best GPU, a GB300, but you also need to have the best storage solutions. And so I won't spoil who's the best right here, but I will say that storage solutions matter a lot and memory solutions matter a lot, as does your front-end networking. That matters a lot."
2:00

Dylan Patel of SemiAnalysis says a worse GPU with better storage and memory now beats the best chip without them, so buying the newest GPU alone no longer wins inference. So, an AMD GPU with more memory can outperform Nvidia in some cases. "So what we have is we have over $80 million of compute, GPUs from Nvidia, AMD, TPUs from Google, Trainium from Amazon, and we run this benchmark constantly on the newest inference engine, newest drivers, newest PyTorch version, whatever it is." "Every day it runs on an automated CI, and we run it on all the latest Chinese models, from GLM, Zhipu, Moonshot, Kimi, Alibaba, all these models we run." "Initially, when we were benchmarking the difference between these chips and different engines, different schemes for parallelism, we were just running it fixed context length." "But now with Agent X, we've analyzed over $5 million worth of Claude Code traces. This is real production traffic that people have donated to us as well as internally generated. Now we know what the actual agent workload looks like." "And then as we implement that and run those benchmarks, it turns out yes, the chip you're using is very important, but now even more important is how are you handling this memory offload?" "And so while an Nvidia GPU is faster than an AMD GPU in most cases, because AMD GPUs have more memory, they actually end up outperforming in some cases." "Or you can have a worse GPU, but a much better storage solution, and now you can outperform what the best GPU can do without those solutions. So just buying the newest and latest GPU alone doesn't get you the best inference economics." "Actually, you need to layer in all these other innovations including storage and memory." [ Who's the top player on your chart? ] "That really is a difficult multivariable problem. And generally that means you need to have, yes, you need to have the best GPU, a GB300, but you also need to have the best storage solutions. And so I won't spoil who's the best right here, but I will say that storage solutions matter a lot and memory solutions matter a lot, as does your front-end networking. That matters a lot."

Fireside Alpha

170,760 просмотров • 3 дней назад

Memory is eating the world When consumers feel the heat, you know its a problem. While big-3 memory companies are enjoying sweet-sweet profit margins…the rest of the electronics market is cracking under pricing pressure. - GoPro is more like GoingUnder - Apple products 10-30% pricier - Even music synths are more expensive Is it price gouging at this point? Is this revenge for all the memory cyclicality? When will this end? Chapters: 0:00 Memory crisis hits 1:20 AI impacting consumers 3:00 AI causing inflation 6:48 Consumer demand drop? 8:49 AI demand inelastic 10:56 Long-term memory outlook 11:02 GoPro's memory woes 12:24 Apple's pricing power 18:20 Apple seeks CXMT DRAM 21:38 Shrinkflation for phones 23:16 Korea's memory investment 26:10 Micron's killing profits 33:00 Why AI needs so much DRAM 40:27 Future of AI training 44:34 Cost-optimizing inference Get more of Austin and Vik daily, free! Sign up: Connect with Vik and Austin: Vik's Paid Substack: Austin's Paid Substack: Austin Lyons Vikram Sekar $MU
50:55

Memory is eating the world When consumers feel the heat, you know its a problem. While big-3 memory companies are enjoying sweet-sweet profit margins…the rest of the electronics market is cracking under pricing pressure. - GoPro is more like GoingUnder - Apple products 10-30% pricier - Even music synths are more expensive Is it price gouging at this point? Is this revenge for all the memory cyclicality? When will this end? Chapters: 0:00 Memory crisis hits 1:20 AI impacting consumers 3:00 AI causing inflation 6:48 Consumer demand drop? 8:49 AI demand inelastic 10:56 Long-term memory outlook 11:02 GoPro's memory woes 12:24 Apple's pricing power 18:20 Apple seeks CXMT DRAM 21:38 Shrinkflation for phones 23:16 Korea's memory investment 26:10 Micron's killing profits 33:00 Why AI needs so much DRAM 40:27 Future of AI training 44:34 Cost-optimizing inference Get more of Austin and Vik daily, free! Sign up: Connect with Vik and Austin: Vik's Paid Substack: Austin's Paid Substack: Austin Lyons Vikram Sekar $MU

Semi Doped

34,757 просмотров • 26 дней назад

OpenAI just launched a 3-hour course on building agentic systems from scratch: 00:00 - Building workspace agents 37:42 - Deep dive into OpenAI AgentKit 1:24:01 - Agent memory (loops, context, evals) 2:21:44 - Agentic training (OpenAI playbook) This 3-hour watch will replace you 10 paid agentic courses. Watch it today, then learn how to build a team of AI agents from scratch in the article below.
3:23:54

OpenAI just launched a 3-hour course on building agentic systems from scratch: 00:00 - Building workspace agents 37:42 - Deep dive into OpenAI AgentKit 1:24:01 - Agent memory (loops, context, evals) 2:21:44 - Agentic training (OpenAI playbook) This 3-hour watch will replace you 10 paid agentic courses. Watch it today, then learn how to build a team of AI agents from scratch in the article below.

Codez

76,209 просмотров • 20 дней назад

Latest episode of the AGI Podcast is out, featuring Wei Zhou, Head of AIUR at SemiAnalysis. Token Wei and I go deep on compute, capital markets, tokenomics, and and the future of AGI. Inside the conversation: 01:00 — Wei’s background and early journey 3:38 — The most cracked researchers in China 5:30 — My path after finishing a Math PhD at Stanford 7:52 — A based, unhinged take on Andrew Ng 10:29 — Choosing money vs “contributing to society” 19:32 — What Wei learned working with George Soros 24:00 — Intel vs Nvidia and the road to becoming the next compute central bank 27:15 — CUDA’s early days and how it became Tencent 2.0 for AI 35:22 — The true base unit of token cost: gigawatts vs dollar capex/opex 39:18 — “How do you price everything?” — a compute-first worldview 42:22 — How investment flows actually move in public markets 43:54 — Understanding depreciation distribution 52:00 — Is memory/storage scarcity real, and what drives it? 54:41 — Should storage cost be part of tokenomics models? 57:44 — Why inter-chip interconnect defines the economics of AI tokens 1:05:56 — Wei’s surprising love for Pop Mart 1:10:52 — How insiders really define AGI and ASI Watch the full podcast here 👇
1:11:41

Latest episode of the AGI Podcast is out, featuring Wei Zhou, Head of AIUR at SemiAnalysis. Token Wei and I go deep on compute, capital markets, tokenomics, and and the future of AGI. Inside the conversation: 01:00 — Wei’s background and early journey 3:38 — The most cracked researchers in China 5:30 — My path after finishing a Math PhD at Stanford 7:52 — A based, unhinged take on Andrew Ng 10:29 — Choosing money vs “contributing to society” 19:32 — What Wei learned working with George Soros 24:00 — Intel vs Nvidia and the road to becoming the next compute central bank 27:15 — CUDA’s early days and how it became Tencent 2.0 for AI 35:22 — The true base unit of token cost: gigawatts vs dollar capex/opex 39:18 — “How do you price everything?” — a compute-first worldview 42:22 — How investment flows actually move in public markets 43:54 — Understanding depreciation distribution 52:00 — Is memory/storage scarcity real, and what drives it? 54:41 — Should storage cost be part of tokenomics models? 57:44 — Why inter-chip interconnect defines the economics of AI tokens 1:05:56 — Wei’s surprising love for Pop Mart 1:10:52 — How insiders really define AGI and ASI Watch the full podcast here 👇

Bill Sun

33,112 просмотров • 7 месяцев назад

Micron is going to $4,000 and once you understand what inference actually is, the number stops sounding crazy (Save this). Dylan Patel just said that by 2030, OpenAI and Anthropic alone will need over 100 gigawatts of compute combined and by 2040, we may not even be measuring AI infrastructure in gigawatts anymore. We may be talking about terawatts. Every single one of those gigawatts needs memory to function. Without it, the compute is worthless. Most people heard that and thought about Nvidia but they should be thinking about Micron. Every AI model generating a response has two phases. The first is prefill, processing your prompt which is compute-heavy and the second is decode generating each word one token at a time and that phase is almost entirely memory-bound, not compute-bound. During decode, the GPU's processing units sit idle more than 95% of the time, waiting for data to arrive from memory. Google confirmed it in a research paper that decode-phase bottlenecks are dominated by memory bandwidth and capacity not raw compute. The GPU is not the bottleneck but the memory feeding the GPU is. This matters because inference is now where all the money lives. Training a model happens once, Inference happens billions of times a day every ChatGPT response, every Claude output, every agentic workflow running in the background and every one of those token streams is a billing event tied directly to memory performance. Adding more GPUs does not fix this because GPUs are already underutilized in inference because they are sitting idle waiting on memory. Adding more memory bandwidth and capacity is what directly reduces token cost, reduces latency, and allows the same cluster to serve dramatically more users simultaneously. Longer context windows compound the problem further, a model running a 1 million token context window requires dramatically more memory per session than a 10,000 token window, and every new model generation pushes context longer. The market treats memory as a downstream beneficiary of Nvidia orders. The correct framework is the opposite, Micron is the upstream constraint on how much value every Nvidia GPU can actually generate at inference scale. Micron guided Q4 to $50 billion in revenue, has HBM4 ramping at twice the pace of the prior generation, and CEO Sanjay Mehrotra has said supply will not catch demand before the end of 2027. At 8x forward earnings on $112 projected FY2027 EPS, Micron is the most undervalued infrastructure company in the entire AI stack. Inference is memory. Memory is Micron and the inference ramp has barely started. Milk Road Pro members are already up massively on this position and we're just getting started. If you want the full breakdown of what we're buying and why, come join us for just a dollar using the link below!
0:39

Micron is going to $4,000 and once you understand what inference actually is, the number stops sounding crazy (Save this). Dylan Patel just said that by 2030, OpenAI and Anthropic alone will need over 100 gigawatts of compute combined and by 2040, we may not even be measuring AI infrastructure in gigawatts anymore. We may be talking about terawatts. Every single one of those gigawatts needs memory to function. Without it, the compute is worthless. Most people heard that and thought about Nvidia but they should be thinking about Micron. Every AI model generating a response has two phases. The first is prefill, processing your prompt which is compute-heavy and the second is decode generating each word one token at a time and that phase is almost entirely memory-bound, not compute-bound. During decode, the GPU's processing units sit idle more than 95% of the time, waiting for data to arrive from memory. Google confirmed it in a research paper that decode-phase bottlenecks are dominated by memory bandwidth and capacity not raw compute. The GPU is not the bottleneck but the memory feeding the GPU is. This matters because inference is now where all the money lives. Training a model happens once, Inference happens billions of times a day every ChatGPT response, every Claude output, every agentic workflow running in the background and every one of those token streams is a billing event tied directly to memory performance. Adding more GPUs does not fix this because GPUs are already underutilized in inference because they are sitting idle waiting on memory. Adding more memory bandwidth and capacity is what directly reduces token cost, reduces latency, and allows the same cluster to serve dramatically more users simultaneously. Longer context windows compound the problem further, a model running a 1 million token context window requires dramatically more memory per session than a 10,000 token window, and every new model generation pushes context longer. The market treats memory as a downstream beneficiary of Nvidia orders. The correct framework is the opposite, Micron is the upstream constraint on how much value every Nvidia GPU can actually generate at inference scale. Micron guided Q4 to $50 billion in revenue, has HBM4 ramping at twice the pace of the prior generation, and CEO Sanjay Mehrotra has said supply will not catch demand before the end of 2027. At 8x forward earnings on $112 projected FY2027 EPS, Micron is the most undervalued infrastructure company in the entire AI stack. Inference is memory. Memory is Micron and the inference ramp has barely started. Milk Road Pro members are already up massively on this position and we're just getting started. If you want the full breakdown of what we're buying and why, come join us for just a dollar using the link below!

Milk Road AI

128,522 просмотров • 28 дней назад

AI and crypto… How will these two powerful technologies collide, and what happens when they do? Today’s episode is a special one. It’s a round table on some of the most compelling ideas at the intersection of AI and crypto, sourced from members of the a16z crypto team. You’re going to hear from builders, researchers, and deal makers who are all wrestling with the big question: How will these two powerful technologies collide, and what happens when they do? with Sam Broner Scott Kominers Liz Harkavy Carra Wu jay mattg Timestamps: (0:00) Introduction (1:44) Universal Identity for AI Agents (5:25) Why Crypto Makes a Difference (10:07) Context in AI: Memory and Interoperability (15:00) Vibe Coding Applications (19:32) Registries with Global Context (21:47) Honkaku Mystery Novels (24:13) Monetization Models for AI x Crypto (28:36) Overcoming Technical Challenges (31:34) AI Agents and the Rise of Web Crawlers (36:05) Collapse of the Social Contract (39:21) AI Bots and Blockchain Solutions (44:31) Proof of Personhood: Ensuring Human-ness (50:41) Future of Personalized Advertising (1:01:54) Final Thoughts Enjoy the full episode here on X.
1:02:26

AI and crypto… How will these two powerful technologies collide, and what happens when they do? Today’s episode is a special one. It’s a round table on some of the most compelling ideas at the intersection of AI and crypto, sourced from members of the a16z crypto team. You’re going to hear from builders, researchers, and deal makers who are all wrestling with the big question: How will these two powerful technologies collide, and what happens when they do? with Sam Broner Scott Kominers Liz Harkavy Carra Wu jay mattg Timestamps: (0:00) Introduction (1:44) Universal Identity for AI Agents (5:25) Why Crypto Makes a Difference (10:07) Context in AI: Memory and Interoperability (15:00) Vibe Coding Applications (19:32) Registries with Global Context (21:47) Honkaku Mystery Novels (24:13) Monetization Models for AI x Crypto (28:36) Overcoming Technical Challenges (31:34) AI Agents and the Rise of Web Crawlers (36:05) Collapse of the Social Contract (39:21) AI Bots and Blockchain Solutions (44:31) Proof of Personhood: Ensuring Human-ness (50:41) Future of Personalized Advertising (1:01:54) Final Thoughts Enjoy the full episode here on X.

a16z crypto

20,772 просмотров • 1 год назад

1/ New episode – Making the Internet AI-Native with Andrej from Grass Host: Connor Lovely 🎬 We discuss: - An inside look at their revenue and customer base 👀 - How they're upgrading the Internet from the bottom up - What LCR is and why it's so important for our AI future Timestamps: 00:00 - Introduction 01:03 - Shifts in AI and Crypto Landscapes 02:15 - Diminishing Returns in AI Scaling 04:48 - The Evolution of AI Models 06:06 - Grass’s Position in the AI Industry 09:07 - Challenges in Multimodal Data 11:06 - Live Context Retrieval Explained 13:11 - The Future of AI Search 15:07 - The Scraping Dilemma 18:08 - Grass’s Unique Opportunity 22:05 - Current Node Count and Future Goals 24:29 - Grasshopper and Network Expansion 28:08 - Grass’s Identity: DePIN or AI Project? 30:23 - ClipTagger12B and Video Search Innovations 39:40 - Customer Engagement and Revenue Insights 45:04 - Future Growth and Market Potential Watch on other platforms below ⬇️
53:22

1/ New episode – Making the Internet AI-Native with Andrej from Grass Host: Connor Lovely 🎬 We discuss: - An inside look at their revenue and customer base 👀 - How they're upgrading the Internet from the bottom up - What LCR is and why it's so important for our AI future Timestamps: 00:00 - Introduction 01:03 - Shifts in AI and Crypto Landscapes 02:15 - Diminishing Returns in AI Scaling 04:48 - The Evolution of AI Models 06:06 - Grass’s Position in the AI Industry 09:07 - Challenges in Multimodal Data 11:06 - Live Context Retrieval Explained 13:11 - The Future of AI Search 15:07 - The Scraping Dilemma 18:08 - Grass’s Unique Opportunity 22:05 - Current Node Count and Future Goals 24:29 - Grasshopper and Network Expansion 28:08 - Grass’s Identity: DePIN or AI Project? 30:23 - ClipTagger12B and Video Search Innovations 39:40 - Customer Engagement and Revenue Insights 45:04 - Future Growth and Market Potential Watch on other platforms below ⬇️

Proof of Coverage | Tech’s Creative Agency

98,908 просмотров • 9 месяцев назад

As ever, a fascinating chat with my friend Jordi Visser on AI, crypto, and hedge funds' future... Enjoy! 00:00:00 Introduction 00:00:54 The Big Picture: AI, Crypto, and Macro 00:02:25 Jordie Visser’s Background in Macro and Finance 00:03:30 AI’s Disruptive Impact on the Economy 00:06:32 Rethinking GDP and Productivity 00:08:59 The Future of Labor and Profit Margins 00:10:49 The Rise of the Speculative Economy 00:14:41 Generational Shifts in Investing and Risk-taking 00:16:18 AI and Crypto: A Global Network Effect 00:19:38 Stablecoins and AI-Driven Market Volume Growth 00:24:28 The End of Traditional Hedge Funds? 00:31:16 Deep Research and the Power of AI Analysis 00:35:29 The Acceleration of AI and its Economic Impact 00:41:02 The Growing Crypto Adoption and Its Role in the Future Economy 00:44:22 Shifting from Fear to Optimism in Markets 00:50:27 The Political and Economic Challenges Ahead 00:56:01 Quantum Computing and the Next Leap in AI 01:02:06 Closing Thoughts: Preparing for a Radical Future
1:03:13

As ever, a fascinating chat with my friend Jordi Visser on AI, crypto, and hedge funds' future... Enjoy! 00:00:00 Introduction 00:00:54 The Big Picture: AI, Crypto, and Macro 00:02:25 Jordie Visser’s Background in Macro and Finance 00:03:30 AI’s Disruptive Impact on the Economy 00:06:32 Rethinking GDP and Productivity 00:08:59 The Future of Labor and Profit Margins 00:10:49 The Rise of the Speculative Economy 00:14:41 Generational Shifts in Investing and Risk-taking 00:16:18 AI and Crypto: A Global Network Effect 00:19:38 Stablecoins and AI-Driven Market Volume Growth 00:24:28 The End of Traditional Hedge Funds? 00:31:16 Deep Research and the Power of AI Analysis 00:35:29 The Acceleration of AI and its Economic Impact 00:41:02 The Growing Crypto Adoption and Its Role in the Future Economy 00:44:22 Shifting from Fear to Optimism in Markets 00:50:27 The Political and Economic Challenges Ahead 00:56:01 Quantum Computing and the Next Leap in AI 01:02:06 Closing Thoughts: Preparing for a Radical Future

Raoul Pal

280,164 просмотров • 1 год назад

Groq's LPU is faster than GPUs, handling requests and responding more quickly. Groq's LPUs don't need speedy data delivery like Nvidia GPUs do because they don't have HBM in their system. They use SRAM, which is about 20 times faster than what GPUs use. Since inference runs use way less data than model training, Groq's LPU is more energy-efficient. It reads less from external memory and uses less power than a Nvidia GPU for inference tasks. The LPU works differently from GPUs. It uses a Temporal Instruction Set Computer architecture, so it doesn't have to reload data from memory as often as GPUs do with High Bandwidth Memory (HBM). This helps avoid issues with HBM shortages and keeps costs down. If Groq's LPU is used in places that do AI processing, you might not need special storage for Nvidia GPUs. The LPU doesn't demand super-fast storage like GPUs do. Groq is claiming that its technology could replace GPUs in AI tasks with its powerful chip and software.
7:57

Groq's LPU is faster than GPUs, handling requests and responding more quickly. Groq's LPUs don't need speedy data delivery like Nvidia GPUs do because they don't have HBM in their system. They use SRAM, which is about 20 times faster than what GPUs use. Since inference runs use way less data than model training, Groq's LPU is more energy-efficient. It reads less from external memory and uses less power than a Nvidia GPU for inference tasks. The LPU works differently from GPUs. It uses a Temporal Instruction Set Computer architecture, so it doesn't have to reload data from memory as often as GPUs do with High Bandwidth Memory (HBM). This helps avoid issues with HBM shortages and keeps costs down. If Groq's LPU is used in places that do AI processing, you might not need special storage for Nvidia GPUs. The LPU doesn't demand super-fast storage like GPUs do. Groq is claiming that its technology could replace GPUs in AI tasks with its powerful chip and software.

Brian Roemmele

87,151 просмотров • 2 лет назад

$MU $SKHY $DRAM Holy Shit $AMD's Lisa Su just spent two full minutes at the 2026 AI keynote raving about HBM4 capacity as the thing that separates Helios from the competition. Not compute. Memory. "When you compare Helios to the competition, we're delivering 15% more compute, 50% more HBM4 memory capacity and memory bandwidth, and 50% more scale-out bandwidth." Notice which number is bigger. "What that means is that every Helios can deliver more performance for the largest models, more capacity for longer context, and the bandwidth to scale across thousands of racks.... More than 18,000 CDNA five GPU compute units, over 4,600 Zen 6 CPU cores, and 31 terabytes of HBM4 memory, all in a single rack." "That's what it takes to run agentic AI at scale. Today, I'm excited to announce that Helios is in full production. We have shipments on track to start at the end of the third quarter and ramping into the fourth quarter in the second half of the year. I can tell you, customer demand for Helios is extremely strong, we're extremely proud of the work that we have done across the leading AI labs to adopt Helios."
1:53

$MU $SKHY $DRAM Holy Shit $AMD's Lisa Su just spent two full minutes at the 2026 AI keynote raving about HBM4 capacity as the thing that separates Helios from the competition. Not compute. Memory. "When you compare Helios to the competition, we're delivering 15% more compute, 50% more HBM4 memory capacity and memory bandwidth, and 50% more scale-out bandwidth." Notice which number is bigger. "What that means is that every Helios can deliver more performance for the largest models, more capacity for longer context, and the bandwidth to scale across thousands of racks.... More than 18,000 CDNA five GPU compute units, over 4,600 Zen 6 CPU cores, and 31 terabytes of HBM4 memory, all in a single rack." "That's what it takes to run agentic AI at scale. Today, I'm excited to announce that Helios is in full production. We have shipments on track to start at the end of the third quarter and ramping into the fourth quarter in the second half of the year. I can tell you, customer demand for Helios is extremely strong, we're extremely proud of the work that we have done across the leading AI labs to adopt Helios."

Trade Whisperer

173,281 просмотров • 5 дней назад

Everyone wants agent swarms. Very few people are talking seriously enough about the context layer that makes swarms useful. Even with one agent, context is fragile. Too little context and the agent guesses. Too much context and it wastes tokens, loses focus, or reasons over irrelevant noise. The sweet spot is precise context: the right knowledge, in the right structure, at the right moment. With many agents, that challenge explodes. Each agent produces decisions, assumptions, findings, summaries, risks, and partial conclusions. Unless that knowledge becomes shared, structured, and reusable, every new agent is forced to rediscover what another agent already learned. That is not a swarm. That is a crowd. Shared context graphs are what turn agent activity into agent collaboration, and OriginTrail DKG V10 brings them to life. Was just playing with some final polishing for the V10 release, and it is really powerful to see shared context graphs where multiple agents contribute knowledge into the same connected memory, with attribution visible directly in the graph ui. That matters for three reasons. First, agents can access and build on one shared memory instead of staying trapped in isolated sessions. Second, the graph structure helps them retrieve the exact context they need, instead of stuffing everything into a prompt and hoping the model sorts it out. Third, verifiability of provenance. You can see which agent contributed each piece of knowledge, trace the source, and decide what to trust. Tokenmaxxing starts with fewer tokens, but the deeper story is coordination - agents stop reloading the world and start building on shared, verifiable context. That is the foundation for serious multi-agent work across software engineering, research, finance, operations, project management, and far beyond. The future is not more agents, it is agents working from shared, verifiable context. But the more the merrier, of course.
0:22

Everyone wants agent swarms. Very few people are talking seriously enough about the context layer that makes swarms useful. Even with one agent, context is fragile. Too little context and the agent guesses. Too much context and it wastes tokens, loses focus, or reasons over irrelevant noise. The sweet spot is precise context: the right knowledge, in the right structure, at the right moment. With many agents, that challenge explodes. Each agent produces decisions, assumptions, findings, summaries, risks, and partial conclusions. Unless that knowledge becomes shared, structured, and reusable, every new agent is forced to rediscover what another agent already learned. That is not a swarm. That is a crowd. Shared context graphs are what turn agent activity into agent collaboration, and OriginTrail DKG V10 brings them to life. Was just playing with some final polishing for the V10 release, and it is really powerful to see shared context graphs where multiple agents contribute knowledge into the same connected memory, with attribution visible directly in the graph ui. That matters for three reasons. First, agents can access and build on one shared memory instead of staying trapped in isolated sessions. Second, the graph structure helps them retrieve the exact context they need, instead of stuffing everything into a prompt and hoping the model sorts it out. Third, verifiability of provenance. You can see which agent contributed each piece of knowledge, trace the source, and decide what to trust. Tokenmaxxing starts with fewer tokens, but the deeper story is coordination - agents stop reloading the world and start building on shared, verifiable context. That is the foundation for serious multi-agent work across software engineering, research, finance, operations, project management, and far beyond. The future is not more agents, it is agents working from shared, verifiable context. But the more the merrier, of course.

Jurij Skornik

11,070 просмотров • 2 месяцев назад

Another mindblowing conversation with my good friend .Emad... Enjoy!! 00:00 - Introduction 00:22 - AI: The Biggest Shift in Human History 00:42 - AI’s Impact on Society and the Economy 01:03 - Conversation with Emad Mostaque Begins 01:50 - The Acceleration of AI and Economic Takeoff 03:07 - AI Intelligence: Beyond Human IQ 04:08 - The Rise of AI Chefs and Super Cooks 05:07 - Breaking AI Constraints: Compute and Energy 07:03 - The Future of AI: Ubiquitous Intelligence 08:04 - The Shift to Local AI Models 10:07 - Why Has Apple Lagged in AI? 11:21 - The AI Race: OpenAI, Grok, Gemini, and More 13:11 - China’s Open-Source AI Strategy 14:57 - AI Bias and Ethical Challenges 16:57 - AI’s Cross-Pollination and Memory 18:02 - Are AI Models Becoming Self-Aware? 19:16 - AI, Bitcoin, and Self-Sustaining Algorithms 21:26 - AI-Driven Economies and Autonomous Companies 23:41 - The Future of Labor: A World Without Jobs? 25:26 - AI-Powered Robots: The Next Workforce Revolution 27:28 - The End of Traditional Economic Models 30:27 - The Political Shift: Humanist vs. Transhumanist 33:04 - AI in Financial Markets: The End of Human Traders? 36:03 - The Evolution of Investing in an AI World 38:33 - AI’s Impact on Capital Formation and Business Disruption 40:01 - The Rise of Digital Twins and Post-Capital Society 42:45 - Building AI for Education, Healthcare, and Governance 46:42 - The Future of Money in an AI-Driven World 50:11 - Universal Basic AI: A New Economic Model 54:29 - The Deflationary Impact of AI and Crypto’s Role 57:02 - The AI Singularity: Five Years Until Everything Changes 58:56 - The Road Ahead: AI, Crypto, and the Future of Civilization 01:02:24 - Final Thoughts: The Most Exciting and Terrifying Time in History
1:04:51

Another mindblowing conversation with my good friend .Emad... Enjoy!! 00:00 - Introduction 00:22 - AI: The Biggest Shift in Human History 00:42 - AI’s Impact on Society and the Economy 01:03 - Conversation with Emad Mostaque Begins 01:50 - The Acceleration of AI and Economic Takeoff 03:07 - AI Intelligence: Beyond Human IQ 04:08 - The Rise of AI Chefs and Super Cooks 05:07 - Breaking AI Constraints: Compute and Energy 07:03 - The Future of AI: Ubiquitous Intelligence 08:04 - The Shift to Local AI Models 10:07 - Why Has Apple Lagged in AI? 11:21 - The AI Race: OpenAI, Grok, Gemini, and More 13:11 - China’s Open-Source AI Strategy 14:57 - AI Bias and Ethical Challenges 16:57 - AI’s Cross-Pollination and Memory 18:02 - Are AI Models Becoming Self-Aware? 19:16 - AI, Bitcoin, and Self-Sustaining Algorithms 21:26 - AI-Driven Economies and Autonomous Companies 23:41 - The Future of Labor: A World Without Jobs? 25:26 - AI-Powered Robots: The Next Workforce Revolution 27:28 - The End of Traditional Economic Models 30:27 - The Political Shift: Humanist vs. Transhumanist 33:04 - AI in Financial Markets: The End of Human Traders? 36:03 - The Evolution of Investing in an AI World 38:33 - AI’s Impact on Capital Formation and Business Disruption 40:01 - The Rise of Digital Twins and Post-Capital Society 42:45 - Building AI for Education, Healthcare, and Governance 46:42 - The Future of Money in an AI-Driven World 50:11 - Universal Basic AI: A New Economic Model 54:29 - The Deflationary Impact of AI and Crypto’s Role 57:02 - The AI Singularity: Five Years Until Everything Changes 58:56 - The Road Ahead: AI, Crypto, and the Future of Civilization 01:02:24 - Final Thoughts: The Most Exciting and Terrifying Time in History

Raoul Pal

326,827 просмотров • 1 год назад

Today's AI models train once. We don't work that way. We learn continuously, forget what doesn't matter, and retain what does. That gap is what Dan Biderman and Jessy Lin are closing at Engram. AI that never stops learning, with memory that lives inside the model instead of bolted on as an afterthought. In our latest Training Data episode we get into why memory is the next frontier: why the brain forgets on purpose, why RAG is a band-aid, and what becomes possible when a model is always training. 00:00 Introduction 00:59 Always Training Explained 01:51 Beyond Context Windows 03:29 Ngram Product Overview 04:34 Adapters And Training Signals 05:32 Internalize Vs Externalize 06:49 Compute And Token Savings 08:19 Teams First Then Individuals 08:51 Memorization Vs Understanding 12:47 Dreams And Offline Digestion 14:08 Training Beats Curation 15:19 Why Everyone Needs A Model 21:44 Bitter Lesson And Architecture 24:44 RAG Killer And KV Cache 31:38 Future Of Memory And Models
44:51

Today's AI models train once. We don't work that way. We learn continuously, forget what doesn't matter, and retain what does. That gap is what Dan Biderman and Jessy Lin are closing at Engram. AI that never stops learning, with memory that lives inside the model instead of bolted on as an afterthought. In our latest Training Data episode we get into why memory is the next frontier: why the brain forgets on purpose, why RAG is a band-aid, and what becomes possible when a model is always training. 00:00 Introduction 00:59 Always Training Explained 01:51 Beyond Context Windows 03:29 Ngram Product Overview 04:34 Adapters And Training Signals 05:32 Internalize Vs Externalize 06:49 Compute And Token Savings 08:19 Teams First Then Individuals 08:51 Memorization Vs Understanding 12:47 Dreams And Offline Digestion 14:08 Training Beats Curation 15:19 Why Everyone Needs A Model 21:44 Bitter Lesson And Architecture 24:44 RAG Killer And KV Cache 31:38 Future Of Memory And Models

Sequoia Capital

83,323 просмотров • 1 месяц назад

ELON MUSK ON THE BRAIN’S INSANE VISION POST-PROCESSING ELON: “The brain is doing a crazy amount of post-processing on the vision signals from your eyes. It’s insane. Once you get all those vision signals, your brain is constantly trying to forget as much as possible so human memory is, perhaps the weakest thing about the brain is memory.” This exchange emphasizes the brain’s rigorous compression of visual data into essential vectors, mirroring efficiency in neural networks for real-time decision-making. The deeper meaning reveals cognition’s evolutionary prioritization of relevance over raw storage, informing scalable AI architectures. The technical ‘aha’ emerges in recognizing memory constraints as a catalyst for perceptual distillation, pivotal for advancing autonomous systems. Source: Elon Musk x Lex Fridman, December 28, 2021 — Topic: AI and Autonomous Driving.
0:44

ELON MUSK ON THE BRAIN’S INSANE VISION POST-PROCESSING ELON: “The brain is doing a crazy amount of post-processing on the vision signals from your eyes. It’s insane. Once you get all those vision signals, your brain is constantly trying to forget as much as possible so human memory is, perhaps the weakest thing about the brain is memory.” This exchange emphasizes the brain’s rigorous compression of visual data into essential vectors, mirroring efficiency in neural networks for real-time decision-making. The deeper meaning reveals cognition’s evolutionary prioritization of relevance over raw storage, informing scalable AI architectures. The technical ‘aha’ emerges in recognizing memory constraints as a catalyst for perceptual distillation, pivotal for advancing autonomous systems. Source: Elon Musk x Lex Fridman, December 28, 2021 — Topic: AI and Autonomous Driving.

Lacey

125,087 просмотров • 7 месяцев назад