正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

A conversation with John Schulman on the first year LLMs could have been useful, building research teams, and where RL goes from here. 00:20 - Speedrunning ChatGPT 09:22 - Archetypes of research managers 11:56 - Was OpenAI inspired by Bell Labs? 16:54 - The absence of value functions 18:23... - Continual learning 21:09 - Brittle generalization 24:05 - Co-training generators and verifiers, GANs 27:06 - John’s personal use of AI for research 28:54 - Day in the life 33:01 - Slowdowns in consequential ML ideas 36:21 - "Peer review" within the labs 39:19 - Distribution shift in researchers 43:33 - Future of RL 45:33 - Will the labs coordinate if the world needs them to? 44:46 - Forecasting ills in AGI and engineering 47:53 - Thinking Machinesshow more

Michael Truell

187,622 subscribers

599,424 次观看 • 7 个月前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

How GPT-5 thinks, with OpenAI VP of Research Jerry Tworek 00:00 - Intro 01:01 - What Reasoning Actually Means in AI 02:32 - Chain of Thought: Models Thinking in Words 05:25 - How Models Decide How Long to Think 07:24 - Evolution from o1 to o3 to GPT-5 11:00 - The Road to OpenAI: Growing up in Poland, Dropping out of School, Trading 20:32 - Working on Robotics and Rubik's Cube Solving 23:02 - A Day in the Life: Talking to Researchers 24:06 - How Research Priorities Are Determined 26:53 - OpenAI's Culture of Transparency 29:32 - Balancing Research with Shipping Fast 31:52 - Using OpenAI's Own Tools Daily 32:43 - Pre-Training Plus RL: The Modern AI Stack 35:10 - Reinforcement Learning 101: Training Dogs 40:17 - The Evolution of Deep Reinforcement Learning 42:09 - When GPT-4 Seemed Underwhelming at First 45:39 - How RLHF Made GPT-4 Actually Useful 48:02 - Unsupervised vs Supervised Learning 49:59 - GRPO and How DeepSeek Accelerated US Research 53:05 - What It Takes to Scale Reinforcement Learning 55:36 - Agentic AI and Long-Horizon Thinking 59:19 - Alignment as an RL Problem 1:01:11 - Winning ICPC World Finals Without Specific Training 1:05:53 - Applying RL Beyond Math and Coding 1:09:15 - The Path from Here to AGI 1:12:23 - Pure RL vs Language Models

How GPT-5 thinks, with OpenAI VP of Research Jerry Tworek 00:00 - Intro 01:01 - What Reasoning Actually Means in AI 02:32 - Chain of Thought: Models Thinking in Words 05:25 - How Models Decide How Long to Think 07:24 - Evolution from o1 to o3 to GPT-5 11:00 - The Road to OpenAI: Growing up in Poland, Dropping out of School, Trading 20:32 - Working on Robotics and Rubik's Cube Solving 23:02 - A Day in the Life: Talking to Researchers 24:06 - How Research Priorities Are Determined 26:53 - OpenAI's Culture of Transparency 29:32 - Balancing Research with Shipping Fast 31:52 - Using OpenAI's Own Tools Daily 32:43 - Pre-Training Plus RL: The Modern AI Stack 35:10 - Reinforcement Learning 101: Training Dogs 40:17 - The Evolution of Deep Reinforcement Learning 42:09 - When GPT-4 Seemed Underwhelming at First 45:39 - How RLHF Made GPT-4 Actually Useful 48:02 - Unsupervised vs Supervised Learning 49:59 - GRPO and How DeepSeek Accelerated US Research 53:05 - What It Takes to Scale Reinforcement Learning 55:36 - Agentic AI and Long-Horizon Thinking 59:19 - Alignment as an RL Problem 1:01:11 - Winning ICPC World Finals Without Specific Training 1:05:53 - Applying RL Beyond Math and Coding 1:09:15 - The Path from Here to AGI 1:12:23 - Pure RL vs Language Models

Matt Turck

451,229 次观看 • 9 个月前

.Jerry Tworek helped drive o1, o3, and Codex at OpenAI where he was VP of Research from 2019 to 2025. Then he left to pursue “types of research that are hard to do at OpenAI.” This week on Unsupervised Learning, I sat down with Jerry to discuss where AI research is headed and what he learned from seven years at the forefront of the field. - Why he left OpenAI after helping create some of its biggest breakthroughs - Why Jerry updated his AGI timeline after building reasoning models - The real limits of scaling reinforcement learning - Why Anthropic has done so well in coding - Inside OpenAI's pivotal decisions - What makes great AI researchers Timestamps: 0:00 Intro 1:26 Scaling Paradigms in AI 3:36 Challenges in Reinforcement Learning 11:48 AGI Timelines 18:36 Converging Labs and Economic Forces 25:05 Jerry's Departure from OpenAI 31:18 Pivotal Decisions in OpenAI's Journey 35:06 Balancing Research and Product Development 38:42 The Future of AI Coding 41:33 Specialization vs. Generalization in AI 48:47 Hiring and Building Research Teams 55:21 Quickfire Listen here: YouTube: Spotify: Apple:

.Jerry Tworek helped drive o1, o3, and Codex at OpenAI where he was VP of Research from 2019 to 2025. Then he left to pursue “types of research that are hard to do at OpenAI.” This week on Unsupervised Learning, I sat down with Jerry to discuss where AI research is headed and what he learned from seven years at the forefront of the field. - Why he left OpenAI after helping create some of its biggest breakthroughs - Why Jerry updated his AGI timeline after building reasoning models - The real limits of scaling reinforcement learning - Why Anthropic has done so well in coding - Inside OpenAI's pivotal decisions - What makes great AI researchers Timestamps: 0:00 Intro 1:26 Scaling Paradigms in AI 3:36 Challenges in Reinforcement Learning 11:48 AGI Timelines 18:36 Converging Labs and Economic Forces 25:05 Jerry's Departure from OpenAI 31:18 Pivotal Decisions in OpenAI's Journey 35:06 Balancing Research and Product Development 38:42 The Future of AI Coding 41:33 Specialization vs. Generalization in AI 48:47 Hiring and Building Research Teams 55:21 Quickfire Listen here: YouTube: Spotify: Apple:

Jacob Effron

43,788 次观看 • 6 个月前

At OpenAI, Chief Scientist Jakub Pachocki helps lead the research roadmap to AGI including a research intern-level AI system by September 2026 and a fully automated AI researcher by March 2028. I sat down with Jakub to check on those timelines and ask him all of my top-of-mind AI questions including: ▪️ How OpenAI thinks about extending RL beyond code and math ▪️ The current state of alignment research as more powerful models loom ▪️ The future of continual learning ▪️ How startups should think about building their own models/harnesses And he also shared some great stories around OpenAI’s pioneering work on math. YouTube: Spotify: Apple: 0:00 Intro 1:53 Research Intern Capability Timelines 4:59 Math Breakthroughs 7:59 RL Beyond Verifiable Tasks 12:32 RL vs In-Context 19:01 Allocating Compute Internally 28:18 AI for Science 31:40 Pattern Matching 33:23 Solving the Hardest Math Problems 37:40 Chain of Thought Monitoring 44:33 Generalization and Value Alignment in Models 47:57 Inside OpenAI 51:55 Quickfire

At OpenAI, Chief Scientist Jakub Pachocki helps lead the research roadmap to AGI including a research intern-level AI system by September 2026 and a fully automated AI researcher by March 2028. I sat down with Jakub to check on those timelines and ask him all of my top-of-mind AI questions including: ▪️ How OpenAI thinks about extending RL beyond code and math ▪️ The current state of alignment research as more powerful models loom ▪️ The future of continual learning ▪️ How startups should think about building their own models/harnesses And he also shared some great stories around OpenAI’s pioneering work on math. YouTube: Spotify: Apple: 0:00 Intro 1:53 Research Intern Capability Timelines 4:59 Math Breakthroughs 7:59 RL Beyond Verifiable Tasks 12:32 RL vs In-Context 19:01 Allocating Compute Internally 28:18 AI for Science 31:40 Pattern Matching 33:23 Solving the Hardest Math Problems 37:40 Chain of Thought Monitoring 44:33 Generalization and Value Alignment in Models 47:57 Inside OpenAI 51:55 Quickfire

Jacob Effron

138,223 次观看 • 4 个月前

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Matt Turck

100,966 次观看 • 2 个月前

Nobel laureate John Jumper (John Jumper) on AlphaFold and the future of science. At AI Startup School in San Francisco. 01:02 - Journey from Physics to Computational Biology 02:01 - Transition to Machine Learning and AI 02:59 - Joining Google DeepMind 03:47 - The Mission: Accelerating Scientific Discovery 04:54 - Understanding Protein Structures 07:44 - Challenges in Protein Structure Determination 11:21 - The Role of Data, Compute, and Research 13:28 - AlphaFold: A Breakthrough in Protein Prediction 14:09 - The Importance of Research and Ideas 17:48 - Real-World Applications and Impact 18:02 - Open Sourcing AlphaFold 21:07 - Unexpected Uses and Innovations 23:15 - Case Study: Molecular Syringe 25:28 - Future of AI in Science

Nobel laureate John Jumper (John Jumper) on AlphaFold and the future of science. At AI Startup School in San Francisco. 01:02 - Journey from Physics to Computational Biology 02:01 - Transition to Machine Learning and AI 02:59 - Joining Google DeepMind 03:47 - The Mission: Accelerating Scientific Discovery 04:54 - Understanding Protein Structures 07:44 - Challenges in Protein Structure Determination 11:21 - The Role of Data, Compute, and Research 13:28 - AlphaFold: A Breakthrough in Protein Prediction 14:09 - The Importance of Research and Ideas 17:48 - Real-World Applications and Impact 18:02 - Open Sourcing AlphaFold 21:07 - Unexpected Uses and Innovations 23:15 - Case Study: Molecular Syringe 25:28 - Future of AI in Science

Y Combinator

149,700 次观看 • 1 年前

Perplexity co-founder and CEO Aravind Srinivas (Aravind Srinivas) on the race to build the AI browser of the future. At AI Startup School in San Francisco. 00:48 - Perplexity's Current Status and Challenges 01:16 - Future Plans: The Browser Bet 03:18 - Competition and Market Dynamics 04:43 - The Importance of Speed and Innovation 05:51 - Founding Perplexity: The Early Days 09:18 - Product Evolution and User Experience 19:44 - Running the Company and Future Outlook 20:15 - AI Tools in Software Engineering 20:31 - Adoption and Implementation of AI Coding Tools 21:11 - Challenges and Benefits of AI in Development 22:35 - Brand Value and Competition 23:56 - Network Effects and Integrations 27:40 - Business Model and Revenue Streams 29:54 - Advice for Founders 31:33 - Audience Q&A

Y Combinator

236,501 次观看 • 1 年前

Deeply thoughtful conversation with Zico Kolter, board member at OpenAI and head of the machine learning department at Carnegie Mellon University, about AI safety, AI security, agents and frontier AI 00:00 Intro 01:32 OpenAI board role and Safety & Security Committee 03:53 How OpenAI reviews major model releases 05:33 OpenAI’s preparedness framework explained 09:46 Are frontier AI models getting safer? 12:33 Why AI safety does not come from scale 15:23 The four categories of AI risk 19:38 Doomerism vs accelerationism in AI 24:11 The six-month AI pause debate 26:20 AI safety as a global effort 28:04 How Zico Kolter got into machine learning 31:05 OpenAI in the early days 34:14 Why Carnegie Mellon became an AI powerhouse 38:43 What Gray Swan does in AI security 40:44 AI safety vs AI security 43:15 The GCG jailbreak paper 49:19 How AI labs responded to jailbreak research 50:19 State-of-the-art AI defenses 52:32 State-of-the-art AI attacks 54:22 Why AI agents expand the attack surface 58:39 Are AI agents ready for production? 59:40 Mechanistic interpretability explained 1:02:31 Will AI be safer in two years? 1:03:46 Reinforcement learning and self-improving models 1:08:09 Do post-transformer architectures matter 1:09:29 Best research directions in AI now 1:11:00 Zico Kolter’s Intro to Modern AI course 1:14:53 Why modern AI is simpler than people think

Deeply thoughtful conversation with Zico Kolter, board member at OpenAI and head of the machine learning department at Carnegie Mellon University, about AI safety, AI security, agents and frontier AI 00:00 Intro 01:32 OpenAI board role and Safety & Security Committee 03:53 How OpenAI reviews major model releases 05:33 OpenAI’s preparedness framework explained 09:46 Are frontier AI models getting safer? 12:33 Why AI safety does not come from scale 15:23 The four categories of AI risk 19:38 Doomerism vs accelerationism in AI 24:11 The six-month AI pause debate 26:20 AI safety as a global effort 28:04 How Zico Kolter got into machine learning 31:05 OpenAI in the early days 34:14 Why Carnegie Mellon became an AI powerhouse 38:43 What Gray Swan does in AI security 40:44 AI safety vs AI security 43:15 The GCG jailbreak paper 49:19 How AI labs responded to jailbreak research 50:19 State-of-the-art AI defenses 52:32 State-of-the-art AI attacks 54:22 Why AI agents expand the attack surface 58:39 Are AI agents ready for production? 59:40 Mechanistic interpretability explained 1:02:31 Will AI be safer in two years? 1:03:46 Reinforcement learning and self-improving models 1:08:09 Do post-transformer architectures matter 1:09:29 Best research directions in AI now 1:11:00 Zico Kolter’s Intro to Modern AI course 1:14:53 Why modern AI is simpler than people think

Matt Turck

33,195 次观看 • 3 个月前

Andrew Ng (Andrew Ng) on how startups can build faster with AI. At AI Startup School in San Francisco. 00:31 - The Importance of Speed in Startups 01:13 - Opportunities in the AI Stack 02:06 - The Rise of Agent AI 04:52 - Concrete Ideas for Faster Execution 08:56 - Rapid Prototyping and Engineering 17:06 - The Role of Product Management 21:23 - The Value of Understanding AI 22:33 - Technical Decisions in AI Development 23:26 - Leveraging Gen AI Tools for Startups 24:05 - Building with AI Building Blocks 25:26 - The Importance of Speed in Startups 26:41 - Addressing AI Hype and Misconceptions 37:35 - AI in Education: Current Trends and Future Directions 39:33 - Balancing AI Innovation with Ethical Considerations 41:27 - Protecting Open Source and the Future of AI

Andrew Ng (Andrew Ng) on how startups can build faster with AI. At AI Startup School in San Francisco. 00:31 - The Importance of Speed in Startups 01:13 - Opportunities in the AI Stack 02:06 - The Rise of Agent AI 04:52 - Concrete Ideas for Faster Execution 08:56 - Rapid Prototyping and Engineering 17:06 - The Role of Product Management 21:23 - The Value of Understanding AI 22:33 - Technical Decisions in AI Development 23:26 - Leveraging Gen AI Tools for Startups 24:05 - Building with AI Building Blocks 25:26 - The Importance of Speed in Startups 26:41 - Addressing AI Hype and Misconceptions 37:35 - AI in Education: Current Trends and Future Directions 39:33 - Balancing AI Innovation with Ethical Considerations 41:27 - Protecting Open Source and the Future of AI

Y Combinator

852,973 次观看 • 1 年前

How does math research change when the cost of trying your first dumb idea goes to zero? Daniel Litt joins Greg Burnham and Anson Ho to discuss what today’s models can and can’t do in math, and how far they are from doing high-quality research. 0:00:00 What's the hardest math problem AI can solve today? 00:16:08 How helpful are today’s AI models for math research? 00:23:36 Junk papers, LLM-generated proofs, and the refereeing crisis 00:27:21 AI enables searching through problems at scale 00:33:49 When will AI be good enough to publish in top math journals? 00:42:15 What are the returns to intelligence? 00:59:50 Will AI solve Millennium problems? 01:11:54 Is math full of low-hanging fruit? 01:18:47 How Daniel has adapted his professional life to AI progress 01:25:28 What do AI math benchmarks actually measure? 01:33:05 Designing the Open Problems benchmark 01:56:35 Do mathematicians believe heuristic arguments about conjectures? 02:01:24 What if FrontierMath: Open Problems gets solved? 02:06:53 Is AI on the cusp of accelerating math progress?

How does math research change when the cost of trying your first dumb idea goes to zero? Daniel Litt joins Greg Burnham and Anson Ho to discuss what today’s models can and can’t do in math, and how far they are from doing high-quality research. 0:00:00 What's the hardest math problem AI can solve today? 00:16:08 How helpful are today’s AI models for math research? 00:23:36 Junk papers, LLM-generated proofs, and the refereeing crisis 00:27:21 AI enables searching through problems at scale 00:33:49 When will AI be good enough to publish in top math journals? 00:42:15 What are the returns to intelligence? 00:59:50 Will AI solve Millennium problems? 01:11:54 Is math full of low-hanging fruit? 01:18:47 How Daniel has adapted his professional life to AI progress 01:25:28 What do AI math benchmarks actually measure? 01:33:05 Designing the Open Problems benchmark 01:56:35 Do mathematicians believe heuristic arguments about conjectures? 02:01:24 What if FrontierMath: Open Problems gets solved? 02:06:53 Is AI on the cusp of accelerating math progress?

Epoch AI

178,703 次观看 • 6 个月前

Sonnet 4.5 & the AI Plateau Myth — epic conversation with Sholto Douglas of Anthropic 0:00 - Intro 1:09 - What's Behind The Rapid Pace of AI Releases at Anthropic 2:49 - Opus, Sonnet, and Haiku Model Tiers 4:14 - Sholto's Story: From Australian Fencer to AI Researcher 12:01 - The YouTube Effect: Mastery Through Observation 16:16 - Breaking Into AI Research Without Traditional Academic Signals 18:29 - DeepMind, Gemini, and Building Inference Stacks 23:05 - Why Anthropic? Culture and Mission Differences Amongst AI Research Labs 25:08 - What Is "Taste" in AI Research? 31:46 - This Week's Big Launch: Sonnet 4.5, Best Coding Model in the World 36:40 - From 7 Hours to 30 Hours: The Long-Running AI Agent Breakthrough 38:41 - How AI Agents Self-Correct and Maintain Coherence 43:13 - The Role of Memory in Extended Coding Sessions 47:42 - Pre-Training vs. RL: Textbooks vs. Worked Problems 52:11 - Test-Time Compute & Reinforcement Learning 55:55 - Why RL Finally Started Working on LLMs in 2024 59:38 - The Path to AGI 1:02:05 - Are We Hitting a Plateau in AI? So Many Low Hanging Fruits 1:03:41 - Beyond Coding: GDPVal & Impact Economic Sectors 1:05:47 - Preparing for 10-100x Individual Leverage & The Upcoming Robotics Explosion

Sonnet 4.5 & the AI Plateau Myth — epic conversation with Sholto Douglas of Anthropic 0:00 - Intro 1:09 - What's Behind The Rapid Pace of AI Releases at Anthropic 2:49 - Opus, Sonnet, and Haiku Model Tiers 4:14 - Sholto's Story: From Australian Fencer to AI Researcher 12:01 - The YouTube Effect: Mastery Through Observation 16:16 - Breaking Into AI Research Without Traditional Academic Signals 18:29 - DeepMind, Gemini, and Building Inference Stacks 23:05 - Why Anthropic? Culture and Mission Differences Amongst AI Research Labs 25:08 - What Is "Taste" in AI Research? 31:46 - This Week's Big Launch: Sonnet 4.5, Best Coding Model in the World 36:40 - From 7 Hours to 30 Hours: The Long-Running AI Agent Breakthrough 38:41 - How AI Agents Self-Correct and Maintain Coherence 43:13 - The Role of Memory in Extended Coding Sessions 47:42 - Pre-Training vs. RL: Textbooks vs. Worked Problems 52:11 - Test-Time Compute & Reinforcement Learning 55:55 - Why RL Finally Started Working on LLMs in 2024 59:38 - The Path to AGI 1:02:05 - Are We Hitting a Plateau in AI? So Many Low Hanging Fruits 1:03:41 - Beyond Coding: GDPVal & Impact Economic Sectors 1:05:47 - Preparing for 10-100x Individual Leverage & The Upcoming Robotics Explosion

Matt Turck

93,678 次观看 • 10 个月前

Dreamers and Doomers: Our AI future, with Richard Ngo – Manifold episode #109 Richard Ngo is an independent AI researcher and philosopher known for his work on AGI safety and alignment. He recently resigned from OpenAI, where he was a member of the Governance team focused on forecasting the capabilities and risks of advanced AI systems. His debut fiction collection is titled "The Gentle Romance: Stories of AI and Humanity", published in December 2025. The book features 22 science fiction stories that explore the psychological and sociological impacts of advanced artificial intelligence. On X: Richard Ngo (00:00) - Richard Ngo Origins (03:48) - DeepMind vs LLMs (09:24) - OpenAI Futurist and AGI Risk (39:17) - Machine God Tail Risk (45:20) - Weird Futures and Normies (51:28) - Alignment Research and Academia (01:16:25) - Doomers vs Skeptics (01:23:57) - Labs Governance Futures (01:39:37) - Doom Scenarios Society

Dreamers and Doomers: Our AI future, with Richard Ngo – Manifold episode #109 Richard Ngo is an independent AI researcher and philosopher known for his work on AGI safety and alignment. He recently resigned from OpenAI, where he was a member of the Governance team focused on forecasting the capabilities and risks of advanced AI systems. His debut fiction collection is titled "The Gentle Romance: Stories of AI and Humanity", published in December 2025. The book features 22 science fiction stories that explore the psychological and sociological impacts of advanced artificial intelligence. On X: Richard Ngo (00:00) - Richard Ngo Origins (03:48) - DeepMind vs LLMs (09:24) - OpenAI Futurist and AGI Risk (39:17) - Machine God Tail Risk (45:20) - Weird Futures and Normies (51:28) - Alignment Research and Academia (01:16:25) - Doomers vs Skeptics (01:23:57) - Labs Governance Futures (01:39:37) - Doom Scenarios Society

steve hsu

12,677 次观看 • 4 个月前

on the frontier of AI detection: from the grifters, to auto reply bots, to russian influence campaigns, to the rising cost of training in conversation with Max Spero and dive in: 00:36 max's background & pangram labs 05:27 AI slop attack vectors 13:19 is this an intractable problem? 18:48 the relational value of content 21:36 a surprising learning... 29:36 customer problems we're not talking enough about 37:04 forecasting compute 43:52 is hiring!

on the frontier of AI detection: from the grifters, to auto reply bots, to russian influence campaigns, to the rising cost of training in conversation with Max Spero and dive in: 00:36 max's background & pangram labs 05:27 AI slop attack vectors 13:19 is this an intractable problem? 18:48 the relational value of content 21:36 a surprising learning... 29:36 customer problems we're not talking enough about 37:04 forecasting compute 43:52 is hiring!

ashe

19,666 次观看 • 2 个月前

My conversation with OpenAI co-founder Greg Brockman This is the most detailed first-person account of the 72 hours after Sam Altman was fired. We also go deep on what comes next: the global race to AGI, why ChatGPT stopped showing reasoning, how much of OpenAI's own code is now written by AI ("it's hard to know what percent is not"), and the untold story of how OpenAI actually started in 2015. 00:00:00 Introduction 00:00:49 Meeting Sam Altman and Starting OpenAI 00:02:40 Building the Founding Team 00:04:25 DeepMind's Lead Over OpenAI 00:04:54 Changing OpenAI to a For-Profit Model 00:06:05 Breakthrough Moments at OpenAI 00:08:22 What Dota 2 Meant for OpenAI 00:10:04 Reasoning Versus Prediction 00:11:59 Tensions Grow at OpenAI 00:15:44 Sam Altman's Firing 00:17:49 Greg Quits OpenAI 00:19:56 Sam Explores Deal with Microsoft's Satya 00:20:28 Petition for Altman's Return 00:23:43 Ilya Sutskever Leaves OpenAI 00:24:59 Lessons Learned after Sam Ousting 00:28:22 The Thing Ilya Said that Greg Can't Forget 00:32:22 Is AI Going Parabolic? 00:33:24 How Much of OpenAI's Code is Written by AI? 00:36:21 Do AI Chatbots Tell Us What We Want to Hear? 00:38:06 The Global AI Race to Reach AGI 00:38:40 What Happens if US Doesn't Reach AGI First? 00:39:49 Are Countries Stealing AI Advancements? 00:40:38 Why ChatGPT No Longer Shows Reasoning 00:41:47 The Finite Constraints of Compute 00:43:38 On Investing Early in Data Centers 00:46:31 The Future of Data Center Specialization 00:47:52 How to Decide Whose Queries to Serve 00:49:08 OpenAI on Consumer vs Enterprise Models 00:53:05 Data Centers in Space? 01:00:56 What Should AI Regulation Look Like? 01:04:33 The Future of AI-Powered Entrepreneurship 01:04:44 AI and Job Loss 01:07:15 The Skills Young People Should Invest In 01:11:30 What Does Success Look Like For You? Full episode on X below. Also find it on: • YouTube: • Spotify: • Apple:

My conversation with OpenAI co-founder Greg Brockman This is the most detailed first-person account of the 72 hours after Sam Altman was fired. We also go deep on what comes next: the global race to AGI, why ChatGPT stopped showing reasoning, how much of OpenAI's own code is now written by AI ("it's hard to know what percent is not"), and the untold story of how OpenAI actually started in 2015. 00:00:00 Introduction 00:00:49 Meeting Sam Altman and Starting OpenAI 00:02:40 Building the Founding Team 00:04:25 DeepMind's Lead Over OpenAI 00:04:54 Changing OpenAI to a For-Profit Model 00:06:05 Breakthrough Moments at OpenAI 00:08:22 What Dota 2 Meant for OpenAI 00:10:04 Reasoning Versus Prediction 00:11:59 Tensions Grow at OpenAI 00:15:44 Sam Altman's Firing 00:17:49 Greg Quits OpenAI 00:19:56 Sam Explores Deal with Microsoft's Satya 00:20:28 Petition for Altman's Return 00:23:43 Ilya Sutskever Leaves OpenAI 00:24:59 Lessons Learned after Sam Ousting 00:28:22 The Thing Ilya Said that Greg Can't Forget 00:32:22 Is AI Going Parabolic? 00:33:24 How Much of OpenAI's Code is Written by AI? 00:36:21 Do AI Chatbots Tell Us What We Want to Hear? 00:38:06 The Global AI Race to Reach AGI 00:38:40 What Happens if US Doesn't Reach AGI First? 00:39:49 Are Countries Stealing AI Advancements? 00:40:38 Why ChatGPT No Longer Shows Reasoning 00:41:47 The Finite Constraints of Compute 00:43:38 On Investing Early in Data Centers 00:46:31 The Future of Data Center Specialization 00:47:52 How to Decide Whose Queries to Serve 00:49:08 OpenAI on Consumer vs Enterprise Models 00:53:05 Data Centers in Space? 01:00:56 What Should AI Regulation Look Like? 01:04:33 The Future of AI-Powered Entrepreneurship 01:04:44 AI and Job Loss 01:07:15 The Skills Young People Should Invest In 01:11:30 What Does Success Look Like For You? Full episode on X below. Also find it on: • YouTube: • Spotify: • Apple:

Shane Parrish

450,952 次观看 • 3 个月前

Here's my 5-hour conversation with Dylan Patel and Nathan Lambert on DeepSeek, China, OpenAI, NVIDIA, xAI, Google, Anthropic, Meta, Microsoft, TSMC, Stargate, megacluster buildouts, RL, reasoning, and a lot of other topics at the cutting edge of AI. This is was a mind-blowing, super-technical, and fun conversation. Yes, we discuss r1 and o3-mini, but more importantly we look into the future of technology, geopolitics, and humanity in a world that stands on the precipice of a global AI revolution. The first 4 hours are here on X (4 hours is current limit), and the full 5 hours are up everywhere else. Links in comment. Timestamps: 0:00 - Introduction 3:33 - DeepSeek-R1 and DeepSeek-V3 25:07 - Low cost of training 51:25 - DeepSeek compute cluster 58:57 - Export controls on GPUs to China 1:09:16 - AGI timeline 1:18:41 - China's manufacturing capacity 1:26:36 - Cold war with China 1:31:05 - TSMC and Taiwan 1:54:44 - Best GPUs for AI 2:09:36 - Why DeepSeek is so cheap 2:22:55 - Espionage 2:31:57 - Censorship 2:44:52 - Andrej Karpathy and magic of RL 2:55:23 - OpenAI o3-mini vs DeepSeek r1 3:14:31 - NVIDIA 3:18:58 - GPU smuggling 3:25:36 - DeepSeek training on OpenAI data 3:36:04 - AI megaclusters 4:11:26 - Who wins the race to AGI? 4:21:39 - AI agents 4:30:21 - Programming and AI 4:37:49 - Open source 4:47:01 - Stargate 4:54:30 - Future of AI

Here's my 5-hour conversation with Dylan Patel and Nathan Lambert on DeepSeek, China, OpenAI, NVIDIA, xAI, Google, Anthropic, Meta, Microsoft, TSMC, Stargate, megacluster buildouts, RL, reasoning, and a lot of other topics at the cutting edge of AI. This is was a mind-blowing, super-technical, and fun conversation. Yes, we discuss r1 and o3-mini, but more importantly we look into the future of technology, geopolitics, and humanity in a world that stands on the precipice of a global AI revolution. The first 4 hours are here on X (4 hours is current limit), and the full 5 hours are up everywhere else. Links in comment. Timestamps: 0:00 - Introduction 3:33 - DeepSeek-R1 and DeepSeek-V3 25:07 - Low cost of training 51:25 - DeepSeek compute cluster 58:57 - Export controls on GPUs to China 1:09:16 - AGI timeline 1:18:41 - China's manufacturing capacity 1:26:36 - Cold war with China 1:31:05 - TSMC and Taiwan 1:54:44 - Best GPUs for AI 2:09:36 - Why DeepSeek is so cheap 2:22:55 - Espionage 2:31:57 - Censorship 2:44:52 - Andrej Karpathy and magic of RL 2:55:23 - OpenAI o3-mini vs DeepSeek r1 3:14:31 - NVIDIA 3:18:58 - GPU smuggling 3:25:36 - DeepSeek training on OpenAI data 3:36:04 - AI megaclusters 4:11:26 - Who wins the race to AGI? 4:21:39 - AI agents 4:30:21 - Programming and AI 4:37:49 - Open source 4:47:01 - Stargate 4:54:30 - Future of AI

Lex Fridman

1,154,101 次观看 • 1 年前

Another mindblowing conversation with my good friend .Emad... Enjoy!! 00:00 - Introduction 00:22 - AI: The Biggest Shift in Human History 00:42 - AI’s Impact on Society and the Economy 01:03 - Conversation with Emad Mostaque Begins 01:50 - The Acceleration of AI and Economic Takeoff 03:07 - AI Intelligence: Beyond Human IQ 04:08 - The Rise of AI Chefs and Super Cooks 05:07 - Breaking AI Constraints: Compute and Energy 07:03 - The Future of AI: Ubiquitous Intelligence 08:04 - The Shift to Local AI Models 10:07 - Why Has Apple Lagged in AI? 11:21 - The AI Race: OpenAI, Grok, Gemini, and More 13:11 - China’s Open-Source AI Strategy 14:57 - AI Bias and Ethical Challenges 16:57 - AI’s Cross-Pollination and Memory 18:02 - Are AI Models Becoming Self-Aware? 19:16 - AI, Bitcoin, and Self-Sustaining Algorithms 21:26 - AI-Driven Economies and Autonomous Companies 23:41 - The Future of Labor: A World Without Jobs? 25:26 - AI-Powered Robots: The Next Workforce Revolution 27:28 - The End of Traditional Economic Models 30:27 - The Political Shift: Humanist vs. Transhumanist 33:04 - AI in Financial Markets: The End of Human Traders? 36:03 - The Evolution of Investing in an AI World 38:33 - AI’s Impact on Capital Formation and Business Disruption 40:01 - The Rise of Digital Twins and Post-Capital Society 42:45 - Building AI for Education, Healthcare, and Governance 46:42 - The Future of Money in an AI-Driven World 50:11 - Universal Basic AI: A New Economic Model 54:29 - The Deflationary Impact of AI and Crypto’s Role 57:02 - The AI Singularity: Five Years Until Everything Changes 58:56 - The Road Ahead: AI, Crypto, and the Future of Civilization 01:02:24 - Final Thoughts: The Most Exciting and Terrifying Time in History

Another mindblowing conversation with my good friend .Emad... Enjoy!! 00:00 - Introduction 00:22 - AI: The Biggest Shift in Human History 00:42 - AI’s Impact on Society and the Economy 01:03 - Conversation with Emad Mostaque Begins 01:50 - The Acceleration of AI and Economic Takeoff 03:07 - AI Intelligence: Beyond Human IQ 04:08 - The Rise of AI Chefs and Super Cooks 05:07 - Breaking AI Constraints: Compute and Energy 07:03 - The Future of AI: Ubiquitous Intelligence 08:04 - The Shift to Local AI Models 10:07 - Why Has Apple Lagged in AI? 11:21 - The AI Race: OpenAI, Grok, Gemini, and More 13:11 - China’s Open-Source AI Strategy 14:57 - AI Bias and Ethical Challenges 16:57 - AI’s Cross-Pollination and Memory 18:02 - Are AI Models Becoming Self-Aware? 19:16 - AI, Bitcoin, and Self-Sustaining Algorithms 21:26 - AI-Driven Economies and Autonomous Companies 23:41 - The Future of Labor: A World Without Jobs? 25:26 - AI-Powered Robots: The Next Workforce Revolution 27:28 - The End of Traditional Economic Models 30:27 - The Political Shift: Humanist vs. Transhumanist 33:04 - AI in Financial Markets: The End of Human Traders? 36:03 - The Evolution of Investing in an AI World 38:33 - AI’s Impact on Capital Formation and Business Disruption 40:01 - The Rise of Digital Twins and Post-Capital Society 42:45 - Building AI for Education, Healthcare, and Governance 46:42 - The Future of Money in an AI-Driven World 50:11 - Universal Basic AI: A New Economic Model 54:29 - The Deflationary Impact of AI and Crypto’s Role 57:02 - The AI Singularity: Five Years Until Everything Changes 58:56 - The Road Ahead: AI, Crypto, and the Future of Civilization 01:02:24 - Final Thoughts: The Most Exciting and Terrifying Time in History

Raoul Pal

326,827 次观看 • 1 年前

"Projects like the New Deal, the Apollo program pale in comparison to what we're doing right now." 🆕 Greg Brockman (Greg Brockman) joins us to talk GPT-5, GPT-OSS, and what's next on OpenAI's road to crystallizing all of human intelligence! “Energy turns into compute, turns into intelligence… crystallizing compute into potential energy you can release again and again.” 0:00:04 - Introductions 0:01:04 - The Evolution of Reasoning at OpenAI 0:04:01 - Online vs Offline Learning in Language Models 0:06:44 - Sample Efficiency and Human Curation in Reinforcement Learning 0:08:16 - Scaling Compute and Supercritical Learning 0:13:21 - Wall clock time limitations in RL and real-world interactions 0:16:34 - Experience with ARC Institute and DNA neural networks 0:19:33 - Defining the GPT-5 Era 0:22:46 - Evaluating Model Intelligence and Task Difficulty 0:25:06 - Practical Advice for Developers Using GPT-5 0:31:48 - Model Specs 0:37:21 - Challenges in RL Preferences (e.g., try/catch) 0:39:13 - Model Routing and Hybrid Architectures in GPT-5 0:43:58 - GPT-5 pricing and compute efficiency improvements 0:46:04 - Self-Improving Coding Agents and Tool Usage 0:49:11 - On-Device Models and Local vs Remote Agent Systems 0:51:34 - Engineering at OpenAI and Leveraging LLMs 0:54:16 - Structuring Codebases and Teams for AI Optimization 0:55:27 - The Value of Engineers in the Age of AGI 0:58:42 - Current state of AI research and lab diversity 1:01:11 - OpenAI’s Prioritization and Focus Areas 1:03:05 - Advice for Founders - It's Not Too Late 1:04:20 - Future outlook and closing thoughts 1:04:33 - Time Capsule to 2045 - Future of Compute and Abundance 1:07:07 - Time Capsule to 2005 - More Problems Will Emerge

"Projects like the New Deal, the Apollo program pale in comparison to what we're doing right now." 🆕 Greg Brockman (Greg Brockman) joins us to talk GPT-5, GPT-OSS, and what's next on OpenAI's road to crystallizing all of human intelligence! “Energy turns into compute, turns into intelligence… crystallizing compute into potential energy you can release again and again.” 0:00:04 - Introductions 0:01:04 - The Evolution of Reasoning at OpenAI 0:04:01 - Online vs Offline Learning in Language Models 0:06:44 - Sample Efficiency and Human Curation in Reinforcement Learning 0:08:16 - Scaling Compute and Supercritical Learning 0:13:21 - Wall clock time limitations in RL and real-world interactions 0:16:34 - Experience with ARC Institute and DNA neural networks 0:19:33 - Defining the GPT-5 Era 0:22:46 - Evaluating Model Intelligence and Task Difficulty 0:25:06 - Practical Advice for Developers Using GPT-5 0:31:48 - Model Specs 0:37:21 - Challenges in RL Preferences (e.g., try/catch) 0:39:13 - Model Routing and Hybrid Architectures in GPT-5 0:43:58 - GPT-5 pricing and compute efficiency improvements 0:46:04 - Self-Improving Coding Agents and Tool Usage 0:49:11 - On-Device Models and Local vs Remote Agent Systems 0:51:34 - Engineering at OpenAI and Leveraging LLMs 0:54:16 - Structuring Codebases and Teams for AI Optimization 0:55:27 - The Value of Engineers in the Age of AGI 0:58:42 - Current state of AI research and lab diversity 1:01:11 - OpenAI’s Prioritization and Focus Areas 1:03:05 - Advice for Founders - It's Not Too Late 1:04:20 - Future outlook and closing thoughts 1:04:33 - Time Capsule to 2045 - Future of Compute and Abundance 1:07:07 - Time Capsule to 2005 - More Problems Will Emerge

Latent.Space

305,090 次观看 • 11 个月前

The 2026 Jensen Huang No Priors interview: 00:17 2025 surprises 04:12 AI is job creation 12:31 Robotics for labor shortages 15:14 Open source, layer cake of making money in AI 21:52 The myth of "God AI" 23:54 Doomers and regulation 29:25 Jensen teaches Tokenomics 35:09 The return to research 37:49 Future of engineering 43:20 Next ChatGPT moment 46:00 Self driving 54:06 We need energy 58:49 US-China relations in '26 1:04:43 Is there an AI bubble?

The 2026 Jensen Huang No Priors interview: 00:17 2025 surprises 04:12 AI is job creation 12:31 Robotics for labor shortages 15:14 Open source, layer cake of making money in AI 21:52 The myth of "God AI" 23:54 Doomers and regulation 29:25 Jensen teaches Tokenomics 35:09 The return to research 37:49 Future of engineering 43:20 Next ChatGPT moment 46:00 Self driving 54:06 We need energy 58:49 US-China relations in '26 1:04:43 Is there an AI bubble?

No Priors

40,450 次观看 • 7 个月前

Updated: Vocals & Rap - #성화 #Seonghwa 00:00 Still Here 00:15 Wonderland 00:36 Halazia 00:47 Answer 01:21 Cyberpunk 01:27 Wave 01:37 Utopia 01:50 My Way 02:00 With U 02:16 Be With You 02:54 Star 1117 03:21 Turbulence (야간비행) 03:39 Days 04:26 Promise 04:38 Fever 04:54 Sunrise 05:19 Mist 05:43 Take Me Home 06:11 Better 06:34 All About You 06:43 Aurora 06:55 Blue Summer 07:23 Diamond 07:46 Time Of Love 07:58 Stay 08:07 Desire 08:21 WDIG 08:28 New World 08:35 Dreamers 08:53 Not Too Late 09:03 The Letter 09:19 One Day At A Time 09:28 Dazzling Light 09:40 Light 09:50 The Ring 10:04 Paradigm 10:18 This World 10:38 Bouncy 10:51 Not Okay 11:15 The King 11:23 Inception 11:52 Fireworks 12:03 Limitless 12:19 Precious 12:28 Rocky 12:41 Let’s Get Together 13:07 White Love 13:17 The Leaders 13:27 Crazy Form 13:43 Arriba 13:57 Silver Light 14:06 Dreamy Day 14:26 Matz 15:15 Outlaw 15:23 Twilight 15:31 Dune 15:38 Hala Hala 15:43 Deja Vu 15:50 Horizon 15:54 Say My Name 15:57 Sector 1 16:02 Good Lil Boy 16:09 Don’t Stop 16:12 Still Here (Acoustic Ver) 16:19 Siren 16:31 Guerrilla 16:45 We Know 17:00 Empty Box 17:28 Wake Up 17:40 Dancing Like Butterfly Wings 17:49 Work 18:09 Thanxx 18:26 If Without U 18:45 Shaboom 19:01 Outlaw 19:18 Treasure 19:33 Eternal Sunshine 20:03 Django 20:31 Turbulence Japanese Ver. 20:55 Blind 21:16 Pirate King 21:24 Forevermore 22:00 Birthday 22:11 Deep Dive 22:26 Ice On My Teeth 22:50 Man On Fire 23:10 Selfish Waltz 23:25 Enough

Updated: Vocals & Rap - #성화 #Seonghwa 00:00 Still Here 00:15 Wonderland 00:36 Halazia 00:47 Answer 01:21 Cyberpunk 01:27 Wave 01:37 Utopia 01:50 My Way 02:00 With U 02:16 Be With You 02:54 Star 1117 03:21 Turbulence (야간비행) 03:39 Days 04:26 Promise 04:38 Fever 04:54 Sunrise 05:19 Mist 05:43 Take Me Home 06:11 Better 06:34 All About You 06:43 Aurora 06:55 Blue Summer 07:23 Diamond 07:46 Time Of Love 07:58 Stay 08:07 Desire 08:21 WDIG 08:28 New World 08:35 Dreamers 08:53 Not Too Late 09:03 The Letter 09:19 One Day At A Time 09:28 Dazzling Light 09:40 Light 09:50 The Ring 10:04 Paradigm 10:18 This World 10:38 Bouncy 10:51 Not Okay 11:15 The King 11:23 Inception 11:52 Fireworks 12:03 Limitless 12:19 Precious 12:28 Rocky 12:41 Let’s Get Together 13:07 White Love 13:17 The Leaders 13:27 Crazy Form 13:43 Arriba 13:57 Silver Light 14:06 Dreamy Day 14:26 Matz 15:15 Outlaw 15:23 Twilight 15:31 Dune 15:38 Hala Hala 15:43 Deja Vu 15:50 Horizon 15:54 Say My Name 15:57 Sector 1 16:02 Good Lil Boy 16:09 Don’t Stop 16:12 Still Here (Acoustic Ver) 16:19 Siren 16:31 Guerrilla 16:45 We Know 17:00 Empty Box 17:28 Wake Up 17:40 Dancing Like Butterfly Wings 17:49 Work 18:09 Thanxx 18:26 If Without U 18:45 Shaboom 19:01 Outlaw 19:18 Treasure 19:33 Eternal Sunshine 20:03 Django 20:31 Turbulence Japanese Ver. 20:55 Blind 21:16 Pirate King 21:24 Forevermore 22:00 Birthday 22:11 Deep Dive 22:26 Ice On My Teeth 22:50 Man On Fire 23:10 Selfish Waltz 23:25 Enough

Hwanakin

62,764 次观看 • 1 年前