Loading video...

Video Failed to Load

Go Home

Here's my conversation all about AI in 2026, including technical breakthroughs, scaling laws, closed & open LLMs, programming & dev tooling (Claude Code, Cursor, etc), China vs US competition, training pipeline details (pre-, mid-, post-training), rapid evolution of LLMs, work culture, diffusion, robotics, tool use, compute (GPUs, TPUs, clusters),...

908,773 views • 5 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Here's my conversation with Dario Amodei, CEO of Anthropic, the company that created Claude, one of the best AI systems in the world. We talk about scaling, AI safety, regulation, and a lot of super technical details about the present and future of AI and humanity. It's a 5+ hour conversation in total. Amanda Askell and Chris Olah (Chris Olah) join us for an hour each to talk about Claude's character and mechanistic interpretability, respectively. This was a fascinating, wide-ranging, super-technical, and fun conversation! First 4 hours are here on X (4 hours is current limit), and is up on everywhere else in full. Links in comment. Timestamps: 0:00 - Introduction 3:14 - Scaling laws 12:20 - Limits of LLM scaling 20:45 - Competition with OpenAI, Google, xAI, Meta 26:08 - Claude 29:44 - Opus 3.5 34:30 - Sonnet 3.5 37:50 - Claude 4.0 42:02 - Criticism of Claude 54:49 - AI Safety Levels 1:05:37 - ASL-3 and ASL-4 1:09:40 - Computer use 1:19:35 - Government regulation of AI 1:38:24 - Hiring a great team 1:47:14 - Post-training 1:52:39 - Constitutional AI 1:58:05 - Machines of Loving Grace 2:17:11 - AGI timeline 2:29:46 - Programming 2:36:46 - Meaning of life 2:42:53 - Amanda Askell - Philosophy 2:45:21 - Programming advice for non-technical people 2:49:09 - Talking to Claude 3:05:41 - Prompt engineering 3:14:15 - Post-training 3:18:54 - Constitutional AI 3:23:48 - System prompts 3:29:54 - Is Claude getting dumber? 3:41:56 - Character training 3:42:56 - Nature of truth 3:47:32 - Optimal rate of failure 3:54:43 - AI consciousness 4:09:14 - AGI 4:17:52 - Chris Olah - Mechanistic Interpretability 4:22:44 - Features, Circuits, Universality 4:40:17 - Superposition 4:51:16 - Monosemanticity 4:58:08 - Scaling Monosemanticity 5:06:56 - Macroscopic behavior of neural networks 5:11:50 - Beauty of neural networks

Lex Fridman

1,374,629 views • 1 year ago

Gemini 3, scaling laws and the 'finite data' era: my conversation with Sebastian Borgeaud, research engineer at Google DeepMind and a pre-training lead for Gemini 3 00:00 – Cold intro: “We’re ahead of schedule” + AI is now a system 00:58 – Oriol Vinyals's “secret recipe”: better pre- + post-training 02:09 – Why AI progress still isn’t slowing down 03:04 – Are models actually getting smarter? 04:36 – Two–three years out: what changes first? 06:34 – AI doing AI research: faster, not automated 07:45 – Frontier labs: same playbook or different bets? 10:19 – Post-transformers: will a disruption happen? 10:51 – DeepMind’s advantage: research × engineering × infra 12:26 – What a Gemini 3 pre-training lead actually does 13:59 – From Europe to Cambridge to DeepMind 18:06 – Why he left RL for real-world data 20:05 – From Gopher to Chinchilla to RETRO (and why it matters) 20:28 – “Research taste”: integrate or slow everyone down 23:00 – Fixes vs moonshots: how they balance the pipeline 24:37 – Research vs product pressure (and org structure) 26:24 – Gemini 3 under the hood: MoE in plain English 28:30 – Native multimodality: the hidden costs 30:03 – Scaling laws aren’t dead (but scale isn’t everything) 33:07 – Synthetic data: powerful, dangerous? 35:00 – Reasoning traces: what he can’t say (and why) 37:18 – Long context + attention: what’s next 38:40 – Retrieval vs RAG vs long context 41:49 – The real boss fight: evals (and contamination) 42:28 – Alignment: pre-training vs post-training 43:32 – Deep Think + agents + “vibe coding” 46:34 – Continual learning: updating models over time 49:35 – Advice for researchers + founders 53:35 – “No end in sight” for progress + closing

Matt Turck

51,317 views • 7 months ago

Even within our own research team, timelines for transformative AI differ substantially. In this episode, the two Epoch AI researchers with the longest and the shortest timelines for transformative AI candidly examine the roots of their disagreements. They discuss: How and why their timelines for specific milestones differ Current technical challenges for AI progress Why widespread automation beats geniuses in datacenters Pitfalls of conventional AI prediction approaches Critiquing "single AGI" or "utopia vs. doom" narratives How a world with AGI might look like And much, much more. (0:00:00) - Preview (0:01:08) - Contrasting AGI Timelines (0:08:30) - Updating Beliefs as Capabilities Advance (0:17:07) - Moravec’s Paradox and the Agency Challenge (0:32:40) - Missing Capabilities for AGI (0:47:43) - Beating benchmarks vs Being Useful (0:59:20) - AI Excelling in Some Tasks While Struggling with Others (1:07:33) - Economic Impact of AI vs the Internet (1:24:08) - Widespread Automation Beats Genius in Datacenters (1:51:37) - How Stories Shape Our Expectations of AI (2:03:24) - How AGI Will Impact Culture (2:10:46) - Beyond Utopia-or-Extinction (2:16:57) - AI's Impact on Wages and Labor (2:27:49) - Why Better Preservation of Information Accelerates Change (2:39:32) - Markets Shaping Cultural Priorities (2:55:51) - Challenges in Defining What We Want to Preserve (3:06:47) - Risk Attitudes in AI Decision-Making (3:12:50) - Historical Lessons for AI Coexistence (3:21:45) - A Warning Sign in Safety Discourse (3:30:20) - Revisiting Core Assumptions in AI Alignment (3:49:46) - Simple Models in Complex Domains

Epoch AI

159,795 views • 1 year ago