Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

The models that will accelerate drug discovery, chip design, and energy are limited by the data they learn from. We led Proximal’s $15M seed as they build the data engine for the next generation of frontier AI and treat training data with the same rigor as model architecture. Watch... show more

General Catalyst

96,889 subscribers

13,212 views • 7 days ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

6 Comments

Calvin Chen7 days ago

@ProximalHQ thank you for all the support and believing in us, just the start!

Kristina Shen7 days ago

@ProximalHQ 🚀🚀🚀

Rohan Mukherjee6 days ago

@ProximalHQ not the 6-7 joke @calvinchen 😭

Saad Gul7 days ago

@ProximalHQ 🚀

Osmond7 days ago

@ProximalHQ nice pants @calvinchen

Realove7 days ago

@ProximalHQ Model demos are cheap. Useful feedback loops are hard. In dating, a click says almost nothing about intent or whether a conversation felt safe. The data you choose to learn from becomes the product you build.

Related Videos

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?

Pat Grady

66,691 views • 1 month ago

Much of the AI narrative revolves around architecture research, compute scaling & buying human data. Very few understand the deep technical discipline of "data research," which has driven many of the gains in model capabilities. Vivek Gopalan sits down with Mahesh Sathiamoorthy @ COLM2026 & Alex Dimakis, founders of Bespoke Labs, a company defining the category of data research. (00:00) Introducing Mahesh and Alex (03:40) Teaching a 1000 person ML class at Berkeley / changes in CS education in the age of AI (06:10) Open source data for frontier model training, OpenThoughts & training models for data curation (12:00) Why multiple-answer yields more performant models, benefits of keeping unverifiable examples in datasets (17:20) RL scaling laws / introduction to Bespoke (19:45) "Environment-driven Development" (28:35) New capabilities in frontier models & coding agents (34:30) Market outlook for RL environments (42:30) Exciting recent research and how we arrived at today's state of RL (50:00) Bespoke's Series A

Much of the AI narrative revolves around architecture research, compute scaling & buying human data. Very few understand the deep technical discipline of "data research," which has driven many of the gains in model capabilities. Vivek Gopalan sits down with Mahesh Sathiamoorthy @ COLM2026 & Alex Dimakis, founders of Bespoke Labs, a company defining the category of data research. (00:00) Introducing Mahesh and Alex (03:40) Teaching a 1000 person ML class at Berkeley / changes in CS education in the age of AI (06:10) Open source data for frontier model training, OpenThoughts & training models for data curation (12:00) Why multiple-answer yields more performant models, benefits of keeping unverifiable examples in datasets (17:20) RL scaling laws / introduction to Bespoke (19:45) "Environment-driven Development" (28:35) New capabilities in frontier models & coding agents (34:30) Market outlook for RL environments (42:30) Exciting recent research and how we arrived at today's state of RL (50:00) Bespoke's Series A

8VC

48,451 views • 3 months ago

BREAKING: AI has eaten the Internet. Data labeling is so over. & $30 trillion of human work is on the verge of automation. Inside The $2.2B AI Research Accelerator, Turing Founder & CEO, Jonathan Siddharth (), joins Sourcery to break down the severe power shift in AI training: from commodity data labeling → expert research Positioning Turing apart from AI data providers like Scale AI, Mercor, & Surge. (00:00) AI Ate The Internet (00:49) Training Superintelligence: the race to AGI (02:31) Viral tweet (03:24) What Turing actually does (04:43) The internet data is “used up” — where will new data come from? (05:34) Four pillars of superintelligence: multimodality, reasoning, tool use, coding (06:07) Automating $30T of global knowledge work (09:18) The $1B revenue opportunity (10:59) Why Turing is a research-first accelerator, not a data labeler (13:45) Jonathan’s Stanford AI Lab roots & founding DNA (17:57) How models are built: pre-training vs. post-training (20:14) RLHF, reinforcement learning, & “breaking the models” (25:19) GPT-5 and the myth of rapid takeoff (30:46) Safety debates and human-in-the-loop systems (34:53) Closing Enterprise Gap: finance, insurance, & pharma (39:23) Why proprietary enterprise data is the next moat in AI

BREAKING: AI has eaten the Internet. Data labeling is so over. & $30 trillion of human work is on the verge of automation. Inside The $2.2B AI Research Accelerator, Turing Founder & CEO, Jonathan Siddharth (), joins Sourcery to break down the severe power shift in AI training: from commodity data labeling → expert research Positioning Turing apart from AI data providers like Scale AI, Mercor, & Surge. (00:00) AI Ate The Internet (00:49) Training Superintelligence: the race to AGI (02:31) Viral tweet (03:24) What Turing actually does (04:43) The internet data is “used up” — where will new data come from? (05:34) Four pillars of superintelligence: multimodality, reasoning, tool use, coding (06:07) Automating $30T of global knowledge work (09:18) The $1B revenue opportunity (10:59) Why Turing is a research-first accelerator, not a data labeler (13:45) Jonathan’s Stanford AI Lab roots & founding DNA (17:57) How models are built: pre-training vs. post-training (20:14) RLHF, reinforcement learning, & “breaking the models” (25:19) GPT-5 and the myth of rapid takeoff (30:46) Safety debates and human-in-the-loop systems (34:53) Closing Enterprise Gap: finance, insurance, & pharma (39:23) Why proprietary enterprise data is the next moat in AI

Molly O’Shea

70,094 views • 1 year ago

AI world models & why they matter... in 20 minutes. The holodeck is closer than you think, and the implications for robotics, AR/VR and content creation are staggering. In this video, I'll breakdown everything from Google Genie 3 and NVIDIA Cosmos to startups powering synthetic training data (Parallel Domain, Bifrost etc). Chapters / Time Stamps: 00:00 Introduction 00:39 Dream Worlds at 24 FPS 01:46 Painting the Third Dimension 03:03 The World Model Wars 05:27 Robot Jungle Gyms (Hybrid Approach) 08:23 Synthetic Data Revolution 11:06 Cities That Think 14:07 The Holodeck Approaches 17:49 The Rendering Stack of Reality

AI world models & why they matter... in 20 minutes. The holodeck is closer than you think, and the implications for robotics, AR/VR and content creation are staggering. In this video, I'll breakdown everything from Google Genie 3 and NVIDIA Cosmos to startups powering synthetic training data (Parallel Domain, Bifrost etc). Chapters / Time Stamps: 00:00 Introduction 00:39 Dream Worlds at 24 FPS 01:46 Painting the Third Dimension 03:03 The World Model Wars 05:27 Robot Jungle Gyms (Hybrid Approach) 08:23 Synthetic Data Revolution 11:06 Cities That Think 14:07 The Holodeck Approaches 17:49 The Rendering Stack of Reality

Bilawal Sidhu

111,703 views • 1 year ago

Want world class research capabilities, but don’t have the resources of a big lab? At our recent Sovereign AI event, Gabe Pereyra shared Harvey ’s “moneyball” approach. Here’s the playbook: 00:00 Introduction 00:37 Building a research lab on a budget 02:28 Legal Agent Bench, contracting, and the diligence dataset 03:57 Domain experts guiding synthetic data generation 05:23 Why Harvey open sourced its datasets 06:55 Working with the neo labs – and why more than one 08:20 Post-training in-house: building "Associate 1" 09:44 The model serving matrix: 60 countries, fallbacks, SLAs 11:05 Deciding what stays in production 12:29 Simple open source switches and model routing 13:55 Moneyball: "If we win on this budget, we change the game" 14:53 Q&A: Training with sensitive data 17:16 Q&A: Competing for research talent 18:46 Q&A: Designing rubrics that actually challenge frontier models 20:19 Q&A: Where the pipeline breaks — data, research, or infra 22:59 Q&A: The tension in open sourcing a benchmark 25:02 Q&A: Biggest remaining open problems 27:10 Q&A: Competing with horizontal products

Want world class research capabilities, but don’t have the resources of a big lab? At our recent Sovereign AI event, Gabe Pereyra shared Harvey ’s “moneyball” approach. Here’s the playbook: 00:00 Introduction 00:37 Building a research lab on a budget 02:28 Legal Agent Bench, contracting, and the diligence dataset 03:57 Domain experts guiding synthetic data generation 05:23 Why Harvey open sourced its datasets 06:55 Working with the neo labs – and why more than one 08:20 Post-training in-house: building "Associate 1" 09:44 The model serving matrix: 60 countries, fallbacks, SLAs 11:05 Deciding what stays in production 12:29 Simple open source switches and model routing 13:55 Moneyball: "If we win on this budget, we change the game" 14:53 Q&A: Training with sensitive data 17:16 Q&A: Competing for research talent 18:46 Q&A: Designing rubrics that actually challenge frontier models 20:19 Q&A: Where the pipeline breaks — data, research, or infra 22:59 Q&A: The tension in open sourcing a benchmark 25:02 Q&A: Biggest remaining open problems 27:10 Q&A: Competing with horizontal products

Pat Grady

179,308 views • 1 month ago

The founder of a $4B inference company says that if you're building agents, foundational models could become your IP. According to Lin Qiao, 90% of the world's data is still private and locked inside applications and enterprises. Foundation models are trained on public internet + labeling company data, which is barely 10% of all the data. And this is why your application and foundation models are misaligned by definition. Companies building agents don't treat models as APIs. They opt for a product-model co-design. - Models continuously learn from your private data - Pick up domain-specific intelligence - Run faster - Cost less - Scale to millions of users

The founder of a $4B inference company says that if you're building agents, foundational models could become your IP. According to Lin Qiao, 90% of the world's data is still private and locked inside applications and enterprises. Foundation models are trained on public internet + labeling company data, which is barely 10% of all the data. And this is why your application and foundation models are misaligned by definition. Companies building agents don't treat models as APIs. They opt for a product-model co-design. - Models continuously learn from your private data - Pick up domain-specific intelligence - Run faster - Cost less - Scale to millions of users

Ivan Burazin

55,344 views • 6 months ago

To date, finding a drug has been a process of guess & check… screening millions of molecules hoping one binds. Chai Discovery is changing the paradigm… describe the molecule you want, and the model designs it. Joshua Meier and Matt McPartlon took antibody hit rates from roughly 1 in 1,000 to 1 in 7. That's the jump from search to engineering. On this episode of Training Data, they get into where the field actually is, why 2024 was the moment to start, what drug discovery looks like when the computer does the design, and more. 00:00 Introduction 01:52 From Discovery to Design 03:25 Protein AI Breakthroughs Timeline 06:04 Why Start in 2024 10:13 Diffusion Models Intuition 11:41 Building the Avengers Team 15:22 Hit Rates and Scaling Laws 25:01 Molecular CAD Vision 25:24 Faster Design Loops 26:32 Future Drug Discovery 28:37 Platform Business Model 31:14 Partnering Reality Check 33:44 Data Flywheel Explained 37:16 Staying Ahead at Scale 39:44 Culture and What's Next

To date, finding a drug has been a process of guess & check… screening millions of molecules hoping one binds. Chai Discovery is changing the paradigm… describe the molecule you want, and the model designs it. Joshua Meier and Matt McPartlon took antibody hit rates from roughly 1 in 1,000 to 1 in 7. That's the jump from search to engineering. On this episode of Training Data, they get into where the field actually is, why 2024 was the moment to start, what drug discovery looks like when the computer does the design, and more. 00:00 Introduction 01:52 From Discovery to Design 03:25 Protein AI Breakthroughs Timeline 06:04 Why Start in 2024 10:13 Diffusion Models Intuition 11:41 Building the Avengers Team 15:22 Hit Rates and Scaling Laws 25:01 Molecular CAD Vision 25:24 Faster Design Loops 26:32 Future Drug Discovery 28:37 Platform Business Model 31:14 Partnering Reality Check 33:44 Data Flywheel Explained 37:16 Staying Ahead at Scale 39:44 Culture and What's Next

Pat Grady

35,085 views • 2 months ago

A lot of people are calling Hermes Agent the end of OpenClaw. BRUH! It's not... Nous Research trains actual models and they built an agent around that expertise. The local model routing is solid, but the part that matters for your business is that your conversations become fine-tuning data. You can train a model on how you actually work. 00:00 The Problem with Local AI Models 00:25 Introduction to Nous Research 01:04 Cross-Platform Agent Capabilities 01:44 Deep Local Model Integration 02:30 Routing Tasks to Different Models 03:06 Conversations as Training Data 03:50 Hermes Agent vs. OpenClaw 04:15 Future Plans and Series Overview

A lot of people are calling Hermes Agent the end of OpenClaw. BRUH! It's not... Nous Research trains actual models and they built an agent around that expertise. The local model routing is solid, but the part that matters for your business is that your conversations become fine-tuning data. You can train a model on how you actually work. 00:00 The Problem with Local AI Models 00:25 Introduction to Nous Research 01:04 Cross-Platform Agent Capabilities 01:44 Deep Local Model Integration 02:30 Routing Tasks to Different Models 03:06 Conversations as Training Data 03:50 Hermes Agent vs. OpenClaw 04:15 Future Plans and Series Overview

Ray Fernando

42,398 views • 6 months ago

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Matt Turck

101,314 views • 4 months ago

Today's AI models train once. We don't work that way. We learn continuously, forget what doesn't matter, and retain what does. That gap is what Dan Biderman and Jessy Lin are closing at Engram. AI that never stops learning, with memory that lives inside the model instead of bolted on as an afterthought. In our latest Training Data episode we get into why memory is the next frontier: why the brain forgets on purpose, why RAG is a band-aid, and what becomes possible when a model is always training. 00:00 Introduction 00:59 Always Training Explained 01:51 Beyond Context Windows 03:29 Ngram Product Overview 04:34 Adapters And Training Signals 05:32 Internalize Vs Externalize 06:49 Compute And Token Savings 08:19 Teams First Then Individuals 08:51 Memorization Vs Understanding 12:47 Dreams And Offline Digestion 14:08 Training Beats Curation 15:19 Why Everyone Needs A Model 21:44 Bitter Lesson And Architecture 24:44 RAG Killer And KV Cache 31:38 Future Of Memory And Models

Today's AI models train once. We don't work that way. We learn continuously, forget what doesn't matter, and retain what does. That gap is what Dan Biderman and Jessy Lin are closing at Engram. AI that never stops learning, with memory that lives inside the model instead of bolted on as an afterthought. In our latest Training Data episode we get into why memory is the next frontier: why the brain forgets on purpose, why RAG is a band-aid, and what becomes possible when a model is always training. 00:00 Introduction 00:59 Always Training Explained 01:51 Beyond Context Windows 03:29 Ngram Product Overview 04:34 Adapters And Training Signals 05:32 Internalize Vs Externalize 06:49 Compute And Token Savings 08:19 Teams First Then Individuals 08:51 Memorization Vs Understanding 12:47 Dreams And Offline Digestion 14:08 Training Beats Curation 15:19 Why Everyone Needs A Model 21:44 Bitter Lesson And Architecture 24:44 RAG Killer And KV Cache 31:38 Future Of Memory And Models

Sequoia Capital

84,809 views • 3 months ago

Training robot foundation models faces two key hurdles: how to get enough data to train an effective model, and how to make sure that new skills can be acquired quickly. The team at Rhoda AI believes that the answer is training Direct Video Action models from web data. Web data is plentiful, to the point where Rhoda can train their base model on hundreds of years of video data. And then, with the addition of robot data, they can quickly adapt it to new tasks with as little as 20 hours of in-domain data, performing complex, multi-step manipulation tasks with their purpose-built video foundation model. Tongzhou Mu 🤖🦾🦿 Eric Chan and Changan Chen joined us to talk more about their approach. Watch Episode #79 of RoboPapers, with Michael Cho - Rbt/Acc, Chris Paxton, and Jiafei Duan, to learn more!

Training robot foundation models faces two key hurdles: how to get enough data to train an effective model, and how to make sure that new skills can be acquired quickly. The team at Rhoda AI believes that the answer is training Direct Video Action models from web data. Web data is plentiful, to the point where Rhoda can train their base model on hundreds of years of video data. And then, with the addition of robot data, they can quickly adapt it to new tasks with as little as 20 hours of in-domain data, performing complex, multi-step manipulation tasks with their purpose-built video foundation model. Tongzhou Mu 🤖🦾🦿 Eric Chan and Changan Chen joined us to talk more about their approach. Watch Episode #79 of RoboPapers, with Michael Cho - Rbt/Acc, Chris Paxton, and Jiafei Duan, to learn more!

RoboPapers

24,728 views • 5 months ago

On frontier science: stepping into the golden age of energy tech In conversation with Danielle Fong Danielle Fong 🔆 00:45 Danielle’s background, starting with college at 12 04:16 The global energy crisis 11:15 Productizing: from drones to data centers 14:00 Powering your future openclaw with propane 14:34 US gov vs consumer applications 19:30 AI, data centers, and new energy sources 23:25 Agentic tools at Lightcell 27:54 Leveraging models across providers 29:54 Iterating on frontier science 43:22 Hyperscalers and the golden age of energy tech

On frontier science: stepping into the golden age of energy tech In conversation with Danielle Fong Danielle Fong 🔆 00:45 Danielle’s background, starting with college at 12 04:16 The global energy crisis 11:15 Productizing: from drones to data centers 14:00 Powering your future openclaw with propane 14:34 US gov vs consumer applications 19:30 AI, data centers, and new energy sources 23:25 Agentic tools at Lightcell 27:54 Leveraging models across providers 29:54 Iterating on frontier science 43:22 Hyperscalers and the golden age of energy tech

ashe

61,597 views • 6 months ago

Here's my conversation with Lucas Atkins and the team at Arcee.ai on their path to training and releasing Trinity Large today. From going all in on open models built end to end in the US 6 months ago to having the model in hand is no easy feet. I loved this conversation on how to design a startup around open models and take a bold step to scale it up. I'm openly an Arcee fan, watching them take risk and pull it off. We discuss: - The state (and future) of open vs. closed models, - The business of selling open models for on-prem deployments, - The story of Arcee AI & going “all-in” on this training run, - The ATOM project, - Building frontier model training teams in 6 months, - and other great topics. I really loved this one, and think you well too. Chapters: 00:00:00 Intro: Arcee AI, Trinity Models & Trinity Large 00:08:26 Transitioning a Company to Pre-training 00:13:00 Technical Decisions: Muon and MoE 00:18:41 Scaling and MoE Training Pain 00:23:14 Post-training and RL Strategies 00:28:09 Team Structure and Data Scaling 00:31:31 The Trinity Manifesto: US Open Weights 00:42:31 Specialized Models and Distillation 00:47:12 Infrastructure and Hosting 400B 00:50:53 Open Source as a Business Moat 00:56:31 Predictions: Best Model in 2026 01:02:29 Lightning Round & Conclusions More great open model builder podcasts coming soon!

Here's my conversation with Lucas Atkins and the team at Arcee.ai on their path to training and releasing Trinity Large today. From going all in on open models built end to end in the US 6 months ago to having the model in hand is no easy feet. I loved this conversation on how to design a startup around open models and take a bold step to scale it up. I'm openly an Arcee fan, watching them take risk and pull it off. We discuss: - The state (and future) of open vs. closed models, - The business of selling open models for on-prem deployments, - The story of Arcee AI & going “all-in” on this training run, - The ATOM project, - Building frontier model training teams in 6 months, - and other great topics. I really loved this one, and think you well too. Chapters: 00:00:00 Intro: Arcee AI, Trinity Models & Trinity Large 00:08:26 Transitioning a Company to Pre-training 00:13:00 Technical Decisions: Muon and MoE 00:18:41 Scaling and MoE Training Pain 00:23:14 Post-training and RL Strategies 00:28:09 Team Structure and Data Scaling 00:31:31 The Trinity Manifesto: US Open Weights 00:42:31 Specialized Models and Distillation 00:47:12 Infrastructure and Hosting 400B 00:50:53 Open Source as a Business Moat 00:56:31 Predictions: Best Model in 2026 01:02:29 Lightning Round & Conclusions More great open model builder podcasts coming soon!

Nathan Lambert

26,872 views • 8 months ago

With enough data, robots and AI can learn “world models” that let them predict the results of their actions. These models are a way to learn how embodied AI agents can perform a wide variety of useful tasks — but they require a huge amount of data. The team at General Intuition General Intuition has a solution: use data from video games! Games teach movement, problem solving, and complex spatial reasoning, and they come in a staggering diversity of forms, covering a wide variety of problems. What’s more, the captured data is high-quality, without the noise or annotation error that can come from We sat down with Pim de Witte and Adam Jelley from the General Intuition team to learn more about their history, their plans, and their philosophy.

With enough data, robots and AI can learn “world models” that let them predict the results of their actions. These models are a way to learn how embodied AI agents can perform a wide variety of useful tasks — but they require a huge amount of data. The team at General Intuition General Intuition has a solution: use data from video games! Games teach movement, problem solving, and complex spatial reasoning, and they come in a staggering diversity of forms, covering a wide variety of problems. What’s more, the captured data is high-quality, without the noise or annotation error that can come from We sat down with Pim de Witte and Adam Jelley from the General Intuition team to learn more about their history, their plans, and their philosophy.

RoboPapers

85,927 views • 10 months ago

Chelsea Finn (Chelsea Finn) on building general-purpose robotics, and bringing intelligence into the physical world. At AI Startup School in San Francisco. 00:00 - General Purpose Robots 00:11 - Challenges in Robotics Applications 00:57 - Physical Intelligence: A New Approach 01:47 - Learning from Language Models 02:08 - Data Sources for Training Robots 03:32 - Training with Real-World Data 04:39 - Initial Successes and Challenges 09:10 - Breakthrough in Robot Training 11:03 - Improving Performance 15:43 - Expanding Capabilities 17:34 - Robots in Unseen Environments 25:54 - Handling Open-Ended Prompts 29:36 - Evaluating Robot Performance 30:03 - Future Directions and Challenges 31:27 - Audience Q&A

Chelsea Finn (Chelsea Finn) on building general-purpose robotics, and bringing intelligence into the physical world. At AI Startup School in San Francisco. 00:00 - General Purpose Robots 00:11 - Challenges in Robotics Applications 00:57 - Physical Intelligence: A New Approach 01:47 - Learning from Language Models 02:08 - Data Sources for Training Robots 03:32 - Training with Real-World Data 04:39 - Initial Successes and Challenges 09:10 - Breakthrough in Robot Training 11:03 - Improving Performance 15:43 - Expanding Capabilities 17:34 - Robots in Unseen Environments 25:54 - Handling Open-Ended Prompts 29:36 - Evaluating Robot Performance 30:03 - Future Directions and Challenges 31:27 - Audience Q&A

Y Combinator

129,834 views • 1 year ago

When AI builds AI: my conversation with Richard Socher about RSI and scientific progress. 00:00 Intro: AI That Improves Itself 00:55 Why Scientific Progress Is Slowing 03:08 The Labyrinth of Human Knowledge 05:59 Can AI Put Science Back Together? 07:57 How LLMs Learn Biology and Proteins 10:56 Next-Token Prediction as a World Model 16:44 Can AI Generate Truly Original Ideas? 17:32 Simulations, Verifiers and Superhuman AI 22:18 The Path to Recursive Self-Improvement 24:49 Why AI Hallucinations Can Drive Discovery 27:42 From Reading Biology to Writing It 31:31 Can AI Accelerate Drug Discovery? 33:31 Will AI Help Cure Cancer? 38:03 AI Breakthroughs in Biology, Energy and Materials 40:19 Will Some Societies Reject AI? 45:07 Building the AI Economist 52:22 The Scientific Data Bottleneck 53:41 The Four Pillars of the Eureka Machine 55:01 Teaching AI the Rules of Reality 57:44 Simulations and Virtual Cells 1:00:40 Self-Driving Robotic Laboratories 1:02:51 Agent Swarms and Open-Ended Discovery 1:04:30 The Compute Bottleneck 1:05:44 Inside Recursive 1:07:33 What Recursive Will Build First 1:10:10 How Do We Define Intelligence? 1:11:32 How Far Can Intelligence Go?

When AI builds AI: my conversation with Richard Socher about RSI and scientific progress. 00:00 Intro: AI That Improves Itself 00:55 Why Scientific Progress Is Slowing 03:08 The Labyrinth of Human Knowledge 05:59 Can AI Put Science Back Together? 07:57 How LLMs Learn Biology and Proteins 10:56 Next-Token Prediction as a World Model 16:44 Can AI Generate Truly Original Ideas? 17:32 Simulations, Verifiers and Superhuman AI 22:18 The Path to Recursive Self-Improvement 24:49 Why AI Hallucinations Can Drive Discovery 27:42 From Reading Biology to Writing It 31:31 Can AI Accelerate Drug Discovery? 33:31 Will AI Help Cure Cancer? 38:03 AI Breakthroughs in Biology, Energy and Materials 40:19 Will Some Societies Reject AI? 45:07 Building the AI Economist 52:22 The Scientific Data Bottleneck 53:41 The Four Pillars of the Eureka Machine 55:01 Teaching AI the Rules of Reality 57:44 Simulations and Virtual Cells 1:00:40 Self-Driving Robotic Laboratories 1:02:51 Agent Swarms and Open-Ended Discovery 1:04:30 The Compute Bottleneck 1:05:44 Inside Recursive 1:07:33 What Recursive Will Build First 1:10:10 How Do We Define Intelligence? 1:11:32 How Far Can Intelligence Go?

Matt Turck

10,849 views • 26 days ago

Today, we're joined by Aakanksha Chowdhery, member of technical staff at Reflection, to explore the fundamental shifts required to build true agentic AI. While the industry has largely focused on post-training techniques to improve reasoning, Aakanksha draws on her experience leading pre-training efforts for Google’s PaLM and early Gemini models to argue that pre-training itself must be rethought to move beyond static benchmarks. We explore the limitations of next-token prediction for multi-step workflows and examine how attention mechanisms, loss objectives, and training data must evolve to support long-form reasoning and planning. Aakanksha shares insights on the difference between context retrieval and actual reasoning, the importance of "trajectory" training data, and why scaling remains essential for discovering emergent agentic capabilities like error recovery and dynamic tool learning. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 02:26 - Reflection 04:54 - Limitations of post-training for building agents 07:31 - Rethinking pre-training in agents 10:51 - Scaling 11:27 - Evolving attention mechanisms for agentic capabilities 12:39 - Memory as a tool 14:13 - Loss objectives and training data 15:50 - Fine-tuning loss in agent performance 19:37 - Training data 21:29 - Augmenting dominant training data source 24:11 - Overcoming challenges in training on synthetic data 25:47 - Benchmarks 30:44 - Scaling laws in large models versus small models 33:20 - Long-form versus short-form reasoning 37:57 - Agent’s ability to recover from failure 40:15 - Hallucinations and failure recovery 43:53 - Tool use in agents 46:38 - Coding agents 48:37 - How researchers can contribute to agentic AI

Today, we're joined by Aakanksha Chowdhery, member of technical staff at Reflection, to explore the fundamental shifts required to build true agentic AI. While the industry has largely focused on post-training techniques to improve reasoning, Aakanksha draws on her experience leading pre-training efforts for Google’s PaLM and early Gemini models to argue that pre-training itself must be rethought to move beyond static benchmarks. We explore the limitations of next-token prediction for multi-step workflows and examine how attention mechanisms, loss objectives, and training data must evolve to support long-form reasoning and planning. Aakanksha shares insights on the difference between context retrieval and actual reasoning, the importance of "trajectory" training data, and why scaling remains essential for discovering emergent agentic capabilities like error recovery and dynamic tool learning. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 02:26 - Reflection 04:54 - Limitations of post-training for building agents 07:31 - Rethinking pre-training in agents 10:51 - Scaling 11:27 - Evolving attention mechanisms for agentic capabilities 12:39 - Memory as a tool 14:13 - Loss objectives and training data 15:50 - Fine-tuning loss in agent performance 19:37 - Training data 21:29 - Augmenting dominant training data source 24:11 - Overcoming challenges in training on synthetic data 25:47 - Benchmarks 30:44 - Scaling laws in large models versus small models 33:20 - Long-form versus short-form reasoning 37:57 - Agent’s ability to recover from failure 40:15 - Hallucinations and failure recovery 43:53 - Tool use in agents 46:38 - Coding agents 48:37 - How researchers can contribute to agentic AI

The TWIML AI Podcast

45,911 views • 9 months ago

Christine (郡主Christine (✱,✱)), co-founder of Axis Robotics spent eight years ago studying mechanical engineering and working with ABB and KUKA robots before pivoting through stablecoin payments and landing on physical AI data. Axis Robotics has raised $12M to build a distributed training engine where anyone with a browser can teach robots. The network already has 200,000+ contributors and a dataset of 50,000+ robot trajectories across 207 tasks. On today's episode: why noisy human data beats "perfect" AI data, why simulation might be the key to physical AI's GPT moment, and the uncomfortable truth about people getting paid to train the robots that'll eventually replace them. Timestamps: 0:00 Intro: Building the Data Layer Behind Physical AI 1:34 Hot Take: Noisy Data vs. Perfect Data 3:16 Why Simulation Data Will Bring the GPT Moment for Robotics 7:25 From Stablecoin Payments to Robotics Data 10:08 Why Axis Chose Data Over Building Robots 16:10 Live Demo: Training a Robot Arm Like Playing FIFA 24:02 How Contributors Get Paid (Tokens + Stablecoin) 26:42 Inside the $12M Seed Round Pitch 32:08 200K+ Contributors & Viral Growth via Base 38:38 Sim-to-Real: The Living Data Engine 41:34 Token & Web3 Plans for Axis Robotics 43:00 Rapid Fire Questions

Christine (郡主Christine (✱,✱)), co-founder of Axis Robotics spent eight years ago studying mechanical engineering and working with ABB and KUKA robots before pivoting through stablecoin payments and landing on physical AI data. Axis Robotics has raised $12M to build a distributed training engine where anyone with a browser can teach robots. The network already has 200,000+ contributors and a dataset of 50,000+ robot trajectories across 207 tasks. On today's episode: why noisy human data beats "perfect" AI data, why simulation might be the key to physical AI's GPT moment, and the uncomfortable truth about people getting paid to train the robots that'll eventually replace them. Timestamps: 0:00 Intro: Building the Data Layer Behind Physical AI 1:34 Hot Take: Noisy Data vs. Perfect Data 3:16 Why Simulation Data Will Bring the GPT Moment for Robotics 7:25 From Stablecoin Payments to Robotics Data 10:08 Why Axis Chose Data Over Building Robots 16:10 Live Demo: Training a Robot Arm Like Playing FIFA 24:02 How Contributors Get Paid (Tokens + Stablecoin) 26:42 Inside the $12M Seed Round Pitch 32:08 200K+ Contributors & Viral Growth via Base 38:38 Sim-to-Real: The Living Data Engine 41:34 Token & Web3 Plans for Axis Robotics 43:00 Rapid Fire Questions

Pukerainbow 🤮🌈

24,329 views • 10 days ago

Enrollment is now open for the Data Engineering Professional Certificate! Data engineers are the architects of modern organizations, ensuring data is reliable, accessible, and ready for analytics and machine learning. This professional certificate is tailored to equip you with the critical skills, through frameworks and hands-on practice, to excel in this role. Taught by industry expert Joe Reis, co-author of the best-selling book "Fundamentals of Data Engineering," along with 17 guest instructors from the data field, you will gain expertise to start and further your career in the high-demand field of data engineering. Key focus areas: 🗂️ Data Engineering Lifecycle: Learn the important stages of building an efficient data pipeline that creates business value. 📥 Data Ingestion: Learn how to efficiently gather data from various sources. 💾 Data Storage: Master the techniques for storing data securely and cost-effectively. 🔄 Data Transformation: Understand how to clean, organize, and prepare data for analysis and machine learning. 🏗️ Data Architecture Design: Build robust architectures that support scalable, efficient data workflows. 📊 Serving Data: Ensure that data is available to stakeholders when and where they need it to drive business decisions. Enroll now!

Enrollment is now open for the Data Engineering Professional Certificate! Data engineers are the architects of modern organizations, ensuring data is reliable, accessible, and ready for analytics and machine learning. This professional certificate is tailored to equip you with the critical skills, through frameworks and hands-on practice, to excel in this role. Taught by industry expert Joe Reis, co-author of the best-selling book "Fundamentals of Data Engineering," along with 17 guest instructors from the data field, you will gain expertise to start and further your career in the high-demand field of data engineering. Key focus areas: 🗂️ Data Engineering Lifecycle: Learn the important stages of building an efficient data pipeline that creates business value. 📥 Data Ingestion: Learn how to efficiently gather data from various sources. 💾 Data Storage: Master the techniques for storing data securely and cost-effectively. 🔄 Data Transformation: Understand how to clean, organize, and prepare data for analysis and machine learning. 🏗️ Data Architecture Design: Build robust architectures that support scalable, efficient data workflows. 📊 Serving Data: Ensure that data is available to stakeholders when and where they need it to drive business decisions. Enroll now!

DeepLearning.AI

20,833 views • 2 years ago