Loading video...

Video Failed to Load

Go Home

Here's my 5-hour conversation with Dylan Patel and Nathan Lambert on DeepSeek, China, OpenAI, NVIDIA, xAI, Google, Anthropic, Meta, Microsoft, TSMC, Stargate, megacluster buildouts, RL, reasoning, and a lot of other topics at the cutting edge of AI. This is was a mind-blowing, super-technical, and fun conversation. Yes, we...

1,153,653 views • 1 year ago •via X (Twitter)

11 Comments

Lex Fridman's profile picture
Lex Fridman1 year ago

Here's the links for my 5-hour conversation on the future of AI with @dylan522p and @natolambert: YouTube: Spotify: Podcast:

Coral AI News's profile picture
Coral AI News2 years ago

Coral AI is the most powerful AI for documents. See the difference yourself:

Ben Averbook's profile picture
Ben Averbook1 year ago

@dylan522p @natolambert Quite excited. Would love more AI content as that is your specialty. Obviously continuing doing history and philosophy as well. Keep it up.👍

Shield's profile picture
Shield1 year ago

@dylan522p @natolambert Interesting

Ryan James's profile picture
Ryan James1 year ago

@dylan522p @natolambert THANK YOU LEX AND TEAM

Doge Daredevil's profile picture
Doge Daredevil1 year ago

@dylan522p @natolambert Your talk about AI innovations was super mind-blowing, would love to hear what you think about the potential for decentralisation in AI! Have you seen what @ThreeProtocol is doing with AI in decentralized marketplaces? It's a real shift from centralisaion.

Petr Baudis's profile picture
Petr Baudis1 year ago

@dylan522p @natolambert I *was* holding out hope for the @teortaxesTex guest hype. Oh well! Still pretty good. (Where to get 5 hours now, though.)

Yuchen Jin's profile picture
Yuchen Jin1 year ago

@dylan522p @natolambert listening, but this picture of Liang Wenfeng is wrong.....

Ernesto's profile picture
Ernesto1 year ago

@dylan522p @natolambert Great lex.

Donnie_Tesla's profile picture
Donnie_Tesla1 year ago

@dylan522p @natolambert Let's watch

👑SAKZ's profile picture
👑SAKZ1 year ago

@dylan522p @natolambert Wow!

Related Videos

Here's my conversation with Dario Amodei, CEO of Anthropic, the company that created Claude, one of the best AI systems in the world. We talk about scaling, AI safety, regulation, and a lot of super technical details about the present and future of AI and humanity. It's a 5+ hour conversation in total. Amanda Askell and Chris Olah (Chris Olah) join us for an hour each to talk about Claude's character and mechanistic interpretability, respectively. This was a fascinating, wide-ranging, super-technical, and fun conversation! First 4 hours are here on X (4 hours is current limit), and is up on everywhere else in full. Links in comment. Timestamps: 0:00 - Introduction 3:14 - Scaling laws 12:20 - Limits of LLM scaling 20:45 - Competition with OpenAI, Google, xAI, Meta 26:08 - Claude 29:44 - Opus 3.5 34:30 - Sonnet 3.5 37:50 - Claude 4.0 42:02 - Criticism of Claude 54:49 - AI Safety Levels 1:05:37 - ASL-3 and ASL-4 1:09:40 - Computer use 1:19:35 - Government regulation of AI 1:38:24 - Hiring a great team 1:47:14 - Post-training 1:52:39 - Constitutional AI 1:58:05 - Machines of Loving Grace 2:17:11 - AGI timeline 2:29:46 - Programming 2:36:46 - Meaning of life 2:42:53 - Amanda Askell - Philosophy 2:45:21 - Programming advice for non-technical people 2:49:09 - Talking to Claude 3:05:41 - Prompt engineering 3:14:15 - Post-training 3:18:54 - Constitutional AI 3:23:48 - System prompts 3:29:54 - Is Claude getting dumber? 3:41:56 - Character training 3:42:56 - Nature of truth 3:47:32 - Optimal rate of failure 3:54:43 - AI consciousness 4:09:14 - AGI 4:17:52 - Chris Olah - Mechanistic Interpretability 4:22:44 - Features, Circuits, Universality 4:40:17 - Superposition 4:51:16 - Monosemanticity 4:58:08 - Scaling Monosemanticity 5:06:56 - Macroscopic behavior of neural networks 5:11:50 - Beauty of neural networks

Lex Fridman

1,374,629 views • 1 year ago

Here's my conversation all about AI in 2026, including technical breakthroughs, scaling laws, closed & open LLMs, programming & dev tooling (Claude Code, Cursor, etc), China vs US competition, training pipeline details (pre-, mid-, post-training), rapid evolution of LLMs, work culture, diffusion, robotics, tool use, compute (GPUs, TPUs, clusters), continual learning, long context, AGI timelines (including how stuff might go wrong), advice for beginners, education, a LOT of discussion about the future, and other topics. It's a great honor and pleasure for me to be able to do this kind of episode with two of my favorite people in the AI community: 1. Sebastian Raschka (Sebastian Raschka) 2. Nathan Lambert (Nathan Lambert) They are both widely-respected machine learning researchers & engineers who also happen to be great communicators, educators, writers, and X posters. This was a whirlwind conversation: everything from the super-technical to the super-fun. It's here on X in full and is up everywhere else (see comment). Timestamps: 0:00 - Introduction 1:57 - China vs US: Who wins the AI race? 10:38 - ChatGPT vs Claude vs Gemini vs Grok: Who is winning? 21:38 - Best AI for coding 28:29 - Open Source vs Closed Source LLMs 40:08 - Transformers: Evolution of LLMs since 2019 48:05 - AI Scaling Laws: Are they dead or still holding? 1:04:12 - How AI is trained: Pre-training, Mid-training, and Post-training 1:37:18 - Post-training explained: Exciting new research directions in LLMs 1:58:11 - Advice for beginners on how to get into AI development & research 2:21:03 - Work culture in AI (72+ hour weeks) 2:24:49 - Silicon Valley bubble 2:28:46 - Text diffusion models and other new research directions 2:34:28 - Tool use 2:38:44 - Continual learning 2:44:06 - Long context 2:50:21 - Robotics 2:59:31 - Timeline to AGI 3:06:47 - Will AI replace programmers? 3:25:18 - Is the dream of AGI dying? 3:32:07 - How AI will make money? 3:36:29 - Big acquisitions in 2026 3:41:01 - Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta 3:53:35 - Manhattan Project for AI 4:00:10 - Future of NVIDIA, GPUs, and AI compute clusters 4:08:15 - Future of human civilization

Lex Fridman

908,773 views • 5 months ago