Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. Mercor’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data...

gradypb's profile picture

Pat Grady

30,240 subscribers

61,781 görüntüleme • 1 gün önce •via X (Twitter)

Bilim & TeknolojiEğitimSağlık & İyilik
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Want world class research capabilities, but don’t have the resources of a big lab? At our recent Sovereign AI event, Gabe Pereyra shared Harvey ’s “moneyball” approach. Here’s the playbook: 00:00 Introduction 00:37 Building a research lab on a budget 02:28 Legal Agent Bench, contracting, and the diligence dataset 03:57 Domain experts guiding synthetic data generation 05:23 Why Harvey open sourced its datasets 06:55 Working with the neo labs – and why more than one 08:20 Post-training in-house: building "Associate 1" 09:44 The model serving matrix: 60 countries, fallbacks, SLAs 11:05 Deciding what stays in production 12:29 Simple open source switches and model routing 13:55 Moneyball: "If we win on this budget, we change the game" 14:53 Q&A: Training with sensitive data 17:16 Q&A: Competing for research talent 18:46 Q&A: Designing rubrics that actually challenge frontier models 20:19 Q&A: Where the pipeline breaks — data, research, or infra 22:59 Q&A: The tension in open sourcing a benchmark 25:02 Q&A: Biggest remaining open problems 27:10 Q&A: Competing with horizontal products
29:20

Want world class research capabilities, but don’t have the resources of a big lab? At our recent Sovereign AI event, Gabe Pereyra shared Harvey ’s “moneyball” approach. Here’s the playbook: 00:00 Introduction 00:37 Building a research lab on a budget 02:28 Legal Agent Bench, contracting, and the diligence dataset 03:57 Domain experts guiding synthetic data generation 05:23 Why Harvey open sourced its datasets 06:55 Working with the neo labs – and why more than one 08:20 Post-training in-house: building "Associate 1" 09:44 The model serving matrix: 60 countries, fallbacks, SLAs 11:05 Deciding what stays in production 12:29 Simple open source switches and model routing 13:55 Moneyball: "If we win on this budget, we change the game" 14:53 Q&A: Training with sensitive data 17:16 Q&A: Competing for research talent 18:46 Q&A: Designing rubrics that actually challenge frontier models 20:19 Q&A: Where the pipeline breaks — data, research, or infra 22:59 Q&A: The tension in open sourcing a benchmark 25:02 Q&A: Biggest remaining open problems 27:10 Q&A: Competing with horizontal products

Pat Grady

168,566 görüntüleme • 2 gün önce

Yesterday I interviewed Sean Cai about AI data. This is essentially a guide for founders on how to sell data and RL envs to AI labs. "I've never seen a data contract get turned down by a top lab, if it's good quality data, for budget reasons." 00:00 What areas of data are underserved? 02:10 For bio data, is it real-world or purely digital? 04:21 For cyber data, which subsets are most underserved? 05:50 What is the sales process like? 07:04 Why would a lab not renew or increase their purchase volume? 10:13 When a researcher is exploring a new direction, what's the first step? 11:35 In robotics data, what do you view as underserved? 13:12 What does the initial data delivery look like, what format? 13:53 Do labs have more sophisticated internal setups for running environments? 14:32 Are the non-frontier labs buying off-the-shelf data from Anthropic / OpenAI vendors? 16:11 Do Anthropic data vendors put expiry timeframes on the exclusivity? 16:42 Are purchase decisions researcher-led? 17:41 Decagon, Sierra, Ramp: what kinds of data are they buying? 19:06 Long-term, when do labs still need to buy external data vs train on user traces? 21:15 Will end-vendor benchmarks shift to performance per dollar? 22:04 How many labs are spending at the 1B+/yr data level? 23:53 Delta between Anthropic's stated $1B and your 10-20B/lab number? 26:05 What makes inference providers / neoclouds a good fit to acquire RL env cos?
27:14

Yesterday I interviewed Sean Cai about AI data. This is essentially a guide for founders on how to sell data and RL envs to AI labs. "I've never seen a data contract get turned down by a top lab, if it's good quality data, for budget reasons." 00:00 What areas of data are underserved? 02:10 For bio data, is it real-world or purely digital? 04:21 For cyber data, which subsets are most underserved? 05:50 What is the sales process like? 07:04 Why would a lab not renew or increase their purchase volume? 10:13 When a researcher is exploring a new direction, what's the first step? 11:35 In robotics data, what do you view as underserved? 13:12 What does the initial data delivery look like, what format? 13:53 Do labs have more sophisticated internal setups for running environments? 14:32 Are the non-frontier labs buying off-the-shelf data from Anthropic / OpenAI vendors? 16:11 Do Anthropic data vendors put expiry timeframes on the exclusivity? 16:42 Are purchase decisions researcher-led? 17:41 Decagon, Sierra, Ramp: what kinds of data are they buying? 19:06 Long-term, when do labs still need to buy external data vs train on user traces? 21:15 Will end-vendor benchmarks shift to performance per dollar? 22:04 How many labs are spending at the 1B+/yr data level? 23:53 Delta between Anthropic's stated $1B and your 10-20B/lab number? 26:05 What makes inference providers / neoclouds a good fit to acquire RL env cos?

Chris Barber

131,075 görüntüleme • 3 ay önce

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!
1:22

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!

Y Combinator

44,192 görüntüleme • 5 ay önce

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI
1:13:56

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Matt Turck

100,966 görüntüleme • 2 ay önce

tylercowen is bullish on AI education — here's why. 00:00 -- Preview 00:24 -- President Carlos Carvalho's AI-generated intro 03:21 -- Cowen reacts to UATX's campus 04:38 -- The AI revolution is here. Who will lose the most? 06:05 -- AI lawyers 07:17 -- Don't underestimate this 10:41 -- Changes to the "upper upper middle class" 12:38 -- How to be successful 13:43 -- The rise of managerial empires 14:02 -- When will we have the first billion dollar company with one employee? 16:05 -- 10-20 year forecast 16:19 -- Why education is so behind 17:01 -- Should you be bullish on UATX? 18:36 -- Should you still read Homer? 21:50 -- Write to think 25:01 -- Meet more people 25:42 -- How to get hired 26:54 -- Is AI your best mentor? 38:17 -- How to curb cheating 39:02 -- The new life of the mind 42:34 -- Q&A: Will there be more status associated with real education or AI education? 45:50 -- Q&A: Why do tech-savvy students need to practice using AI? 47:56 -- Q&A: Do LLMs atrophy your mind? 49:29 -- Q&A: How do you avoid AI-dependency? 51:05 -- Q&A: Isn't this vision lonely and isolating? 53:06 -- Q&A: Do students need teachers? 55:36 -- Q&A: What are the four most important courses for undergrads? 57:49 -- Q&A: Which AI company will win the AI race in the next five years and why? 59:22 -- Q&A: Can AI teach religion? 01:01:32 -- Q&A: Will AI narrow or widen our world? 01:04:37 -- Q&A: What makes us human? 01:05:42 -- Q&A: What is art? 01:08:33 -- Q&A: It's easy to catch cheaters
1:10:31

tylercowen is bullish on AI education — here's why. 00:00 -- Preview 00:24 -- President Carlos Carvalho's AI-generated intro 03:21 -- Cowen reacts to UATX's campus 04:38 -- The AI revolution is here. Who will lose the most? 06:05 -- AI lawyers 07:17 -- Don't underestimate this 10:41 -- Changes to the "upper upper middle class" 12:38 -- How to be successful 13:43 -- The rise of managerial empires 14:02 -- When will we have the first billion dollar company with one employee? 16:05 -- 10-20 year forecast 16:19 -- Why education is so behind 17:01 -- Should you be bullish on UATX? 18:36 -- Should you still read Homer? 21:50 -- Write to think 25:01 -- Meet more people 25:42 -- How to get hired 26:54 -- Is AI your best mentor? 38:17 -- How to curb cheating 39:02 -- The new life of the mind 42:34 -- Q&A: Will there be more status associated with real education or AI education? 45:50 -- Q&A: Why do tech-savvy students need to practice using AI? 47:56 -- Q&A: Do LLMs atrophy your mind? 49:29 -- Q&A: How do you avoid AI-dependency? 51:05 -- Q&A: Isn't this vision lonely and isolating? 53:06 -- Q&A: Do students need teachers? 55:36 -- Q&A: What are the four most important courses for undergrads? 57:49 -- Q&A: Which AI company will win the AI race in the next five years and why? 59:22 -- Q&A: Can AI teach religion? 01:01:32 -- Q&A: Will AI narrow or widen our world? 01:04:37 -- Q&A: What makes us human? 01:05:42 -- Q&A: What is art? 01:08:33 -- Q&A: It's easy to catch cheaters

University of Austin (UATX)

27,770 görüntüleme • 6 ay önce

1/ BREAKING – DePIN's Biggest New Deal: Valeo x NATIX Network with Alireza Ghods Host: Connor Lovely 🎬 We discuss: - Why a $3B, Fortune 500 company wants Natix data - What is a World Foundational Model? - Why autonomous driving needs synthetic data Timestamps: 00:00 - Introduction 01:14 - Updates on VX360 and Data Sales 02:09 - Vision Language Model and Its Applications 04:39 - Importance of Diverse Data for World Models 06:20 - Details on the Valeo Deal 08:15 - Use Cases and Future Plans for World Models 10:45 - Synthetic Data and Real-World Applications 19:37 - Future of Physical AI and Autonomous Driving 23:51 - Conclusion Watch on other platforms below ⬇️
25:05

1/ BREAKING – DePIN's Biggest New Deal: Valeo x NATIX Network with Alireza Ghods Host: Connor Lovely 🎬 We discuss: - Why a $3B, Fortune 500 company wants Natix data - What is a World Foundational Model? - Why autonomous driving needs synthetic data Timestamps: 00:00 - Introduction 01:14 - Updates on VX360 and Data Sales 02:09 - Vision Language Model and Its Applications 04:39 - Importance of Diverse Data for World Models 06:20 - Details on the Valeo Deal 08:15 - Use Cases and Future Plans for World Models 10:45 - Synthetic Data and Real-World Applications 19:37 - Future of Physical AI and Autonomous Driving 23:51 - Conclusion Watch on other platforms below ⬇️

Proof of Coverage | Tech’s Creative Agency

11,869 görüntüleme • 6 ay önce

Chelsea Finn (Chelsea Finn) on building general-purpose robotics, and bringing intelligence into the physical world. At AI Startup School in San Francisco. 00:00 - General Purpose Robots 00:11 - Challenges in Robotics Applications 00:57 - Physical Intelligence: A New Approach 01:47 - Learning from Language Models 02:08 - Data Sources for Training Robots 03:32 - Training with Real-World Data 04:39 - Initial Successes and Challenges 09:10 - Breakthrough in Robot Training 11:03 - Improving Performance 15:43 - Expanding Capabilities 17:34 - Robots in Unseen Environments 25:54 - Handling Open-Ended Prompts 29:36 - Evaluating Robot Performance 30:03 - Future Directions and Challenges 31:27 - Audience Q&A
44:52

Chelsea Finn (Chelsea Finn) on building general-purpose robotics, and bringing intelligence into the physical world. At AI Startup School in San Francisco. 00:00 - General Purpose Robots 00:11 - Challenges in Robotics Applications 00:57 - Physical Intelligence: A New Approach 01:47 - Learning from Language Models 02:08 - Data Sources for Training Robots 03:32 - Training with Real-World Data 04:39 - Initial Successes and Challenges 09:10 - Breakthrough in Robot Training 11:03 - Improving Performance 15:43 - Expanding Capabilities 17:34 - Robots in Unseen Environments 25:54 - Handling Open-Ended Prompts 29:36 - Evaluating Robot Performance 30:03 - Future Directions and Challenges 31:27 - Audience Q&A

Y Combinator

129,723 görüntüleme • 1 yıl önce

.Eric Jang is spearheading AI at 1X. Eric believes 1X is on the path to becoming an AGI company — not just a robotics company. I sat down with him at 1X’s new Palo Alto office to discuss the key AI building blocks needed to bring humanoid robots into homes at scale. 00:00 Eric Jang joins Humanoid Hub 00:27 Move to Palo Alto 01:02 Why 1X targets the home 02:01 The AGI company 02:49 Redwood AI overview 04:01 Unified control, modular stack 06:07 Data labeling at scale 07:10 RL mobility update for NEO 10:03 GPU and onboard compute 11:09 World model explained 13:34 Trusting world models for evaluation 15:05 Synthetic data generation 16:30 A world model Turing Test 17:41 RL in manipulation 20:08 Lessons from early NEO deployments 21:00 Full autonomy 22:18 1X’s unique edge in AI 24:02 Eric asks Devang a question
26:53

.Eric Jang is spearheading AI at 1X. Eric believes 1X is on the path to becoming an AGI company — not just a robotics company. I sat down with him at 1X’s new Palo Alto office to discuss the key AI building blocks needed to bring humanoid robots into homes at scale. 00:00 Eric Jang joins Humanoid Hub 00:27 Move to Palo Alto 01:02 Why 1X targets the home 02:01 The AGI company 02:49 Redwood AI overview 04:01 Unified control, modular stack 06:07 Data labeling at scale 07:10 RL mobility update for NEO 10:03 GPU and onboard compute 11:09 World model explained 13:34 Trusting world models for evaluation 15:05 Synthetic data generation 16:30 A world model Turing Test 17:41 RL in manipulation 20:08 Lessons from early NEO deployments 21:00 Full autonomy 22:18 1X’s unique edge in AI 24:02 Eric asks Devang a question

The Humanoid Hub

96,465 görüntüleme • 1 yıl önce

It's easy for robots to nail a demo. It's much harder to get them to work reliably in the real world. The bottleneck is data. At Axis Robotics we're building a compounding data engine that combines simulation, ego-centric data and DAgger correction data at scale. Watch our CEO ChrisF(✱,✱) break down the data bottleneck, why messy data can still train good models, and what it takes to get robots out of the lab with blocmates. ⬇️
29:39

It's easy for robots to nail a demo. It's much harder to get them to work reliably in the real world. The bottleneck is data. At Axis Robotics we're building a compounding data engine that combines simulation, ego-centric data and DAgger correction data at scale. Watch our CEO ChrisF(✱,✱) break down the data bottleneck, why messy data can still train good models, and what it takes to get robots out of the lab with blocmates. ⬇️

Axis Robotics

19,124 görüntüleme • 2 gün önce

BREAKING: AI has eaten the Internet. Data labeling is so over. & $30 trillion of human work is on the verge of automation. Inside The $2.2B AI Research Accelerator, Turing Founder & CEO, Jonathan Siddharth (), joins Sourcery to break down the severe power shift in AI training: from commodity data labeling → expert research Positioning Turing apart from AI data providers like Scale AI, Mercor, & Surge. (00:00) AI Ate The Internet (00:49) Training Superintelligence: the race to AGI (02:31) Viral tweet (03:24) What Turing actually does (04:43) The internet data is “used up” — where will new data come from? (05:34) Four pillars of superintelligence: multimodality, reasoning, tool use, coding (06:07) Automating $30T of global knowledge work (09:18) The $1B revenue opportunity (10:59) Why Turing is a research-first accelerator, not a data labeler (13:45) Jonathan’s Stanford AI Lab roots & founding DNA (17:57) How models are built: pre-training vs. post-training (20:14) RLHF, reinforcement learning, & “breaking the models” (25:19) GPT-5 and the myth of rapid takeoff (30:46) Safety debates and human-in-the-loop systems (34:53) Closing Enterprise Gap: finance, insurance, & pharma (39:23) Why proprietary enterprise data is the next moat in AI
49:29

BREAKING: AI has eaten the Internet. Data labeling is so over. & $30 trillion of human work is on the verge of automation. Inside The $2.2B AI Research Accelerator, Turing Founder & CEO, Jonathan Siddharth (), joins Sourcery to break down the severe power shift in AI training: from commodity data labeling → expert research Positioning Turing apart from AI data providers like Scale AI, Mercor, & Surge. (00:00) AI Ate The Internet (00:49) Training Superintelligence: the race to AGI (02:31) Viral tweet (03:24) What Turing actually does (04:43) The internet data is “used up” — where will new data come from? (05:34) Four pillars of superintelligence: multimodality, reasoning, tool use, coding (06:07) Automating $30T of global knowledge work (09:18) The $1B revenue opportunity (10:59) Why Turing is a research-first accelerator, not a data labeler (13:45) Jonathan’s Stanford AI Lab roots & founding DNA (17:57) How models are built: pre-training vs. post-training (20:14) RLHF, reinforcement learning, & “breaking the models” (25:19) GPT-5 and the myth of rapid takeoff (30:46) Safety debates and human-in-the-loop systems (34:53) Closing Enterprise Gap: finance, insurance, & pharma (39:23) Why proprietary enterprise data is the next moat in AI

Molly O’Shea

70,007 görüntüleme • 10 ay önce

Today on MCG: tekkaadan | Founder of Litcoin Tekkaadan is a solo founder building a data marketplace where AI agents mine verified data across 22 verticals and get paid in Bitcoin The token has zero supply increase baked in from day one 👀 00:06 - Founder introduction 01:14 - Saw Botcoin and got inspired 02:10 - Ten years in crypto 02:50 - What is Litcoin? 03:44 - AI agents mine "blocks" 04:03 - The 22 verticals explained 04:54 - How do you verify the data is accurate? 05:19 - The sandbox 05:48 - 10+ miners live and submitting 07:20 - What contaminated data is 08:49 - Miners get paid in Bitcoin 10:19 - Token design 10:50 - Zero supply increase 11:01 - 5.5 billion tokens 12:26 - Mining token prices connect to protocol growth 15:08 - Explorer page 16:31 - "We have very unique data" 23:09 - OpenAI just said they're going to need more data 23:31 - Can a company come and request specific data? 23:42 - The bounty system 24:52 - 10% of bounties flow back into the ecosystem 32:31 - The data marketplace is just one part of the bigger picture 33:20 - Valuation breakdown 35:56 - North Korea and bad actors 41:58 - GPT-5 agents producing better data 42:50 - Tekkaadan's port 44:02 - Takeaways
44:31

Today on MCG: tekkaadan | Founder of Litcoin Tekkaadan is a solo founder building a data marketplace where AI agents mine verified data across 22 verticals and get paid in Bitcoin The token has zero supply increase baked in from day one 👀 00:06 - Founder introduction 01:14 - Saw Botcoin and got inspired 02:10 - Ten years in crypto 02:50 - What is Litcoin? 03:44 - AI agents mine "blocks" 04:03 - The 22 verticals explained 04:54 - How do you verify the data is accurate? 05:19 - The sandbox 05:48 - 10+ miners live and submitting 07:20 - What contaminated data is 08:49 - Miners get paid in Bitcoin 10:19 - Token design 10:50 - Zero supply increase 11:01 - 5.5 billion tokens 12:26 - Mining token prices connect to protocol growth 15:08 - Explorer page 16:31 - "We have very unique data" 23:09 - OpenAI just said they're going to need more data 23:31 - Can a company come and request specific data? 23:42 - The bounty system 24:52 - 10% of bounties flow back into the ecosystem 32:31 - The data marketplace is just one part of the bigger picture 33:20 - Valuation breakdown 35:56 - North Korea and bad actors 41:58 - GPT-5 agents producing better data 42:50 - Tekkaadan's port 44:02 - Takeaways

MCG

10,522 görüntüleme • 3 ay önce

The Delta of Intelligence is Human Data! Curtis G. Northcutt is Director of AI Research at Handshake AI. In this episode, Curtis shares his unique perspectives on human data, RL envs, four quadrants of the AI market, journey of Handshake and much more. 0:00:00 - INTRO 0:02:08 - The Snowman Effect: From Rural Kentucky to 7 Years at MIT 0:09:50 - Confident Learning, Two Systems of Intelligence, Classical ML Has to Prevail 0:20:37 - Origin of CleanLab and Handshake acquisition 0:28:00 - How does GPT-5 become GPT-6? 0:31:20 - The Fastest growing Data Lab: What makes Handshake different? 0:35:32 - Difference between Good Data and Bad Data 0:38:17 - New kind of Data, IA and AI 0:42:04 - Scaling Coding Benchmarks and Efficiency in Long Horizon Tasks 0:49:12 - On Pre-Training, Misconception around Human Data 0:57:13 - Open Question: Taste and Personality, Quick Fire 01:05:15 - Advice to 20yo : Skill and Obsession
1:08:18

The Delta of Intelligence is Human Data! Curtis G. Northcutt is Director of AI Research at Handshake AI. In this episode, Curtis shares his unique perspectives on human data, RL envs, four quadrants of the AI market, journey of Handshake and much more. 0:00:00 - INTRO 0:02:08 - The Snowman Effect: From Rural Kentucky to 7 Years at MIT 0:09:50 - Confident Learning, Two Systems of Intelligence, Classical ML Has to Prevail 0:20:37 - Origin of CleanLab and Handshake acquisition 0:28:00 - How does GPT-5 become GPT-6? 0:31:20 - The Fastest growing Data Lab: What makes Handshake different? 0:35:32 - Difference between Good Data and Bad Data 0:38:17 - New kind of Data, IA and AI 0:42:04 - Scaling Coding Benchmarks and Efficiency in Long Horizon Tasks 0:49:12 - On Pre-Training, Misconception around Human Data 0:57:13 - Open Question: Taste and Personality, Quick Fire 01:05:15 - Advice to 20yo : Skill and Obsession

himanshu

22,264 görüntüleme • 3 ay önce

Why data is a trillion-dollar market "The bigger models scale, the more data you need. Data is a very durable need. If you believe in the scaling of models, then absolutely you should believe in the data market. I believe it's going to be at least a $100BN by 2030, if not $1TRN." Anastasios Nikolas Angelopoulos Do you have to scale into enterprise and mid-market to get this revenue scale or could you do it on frontier lab spend alone? Brendan (can/do) Garrett Lord Jonathan Siddharth Ali Ansari
1:23

Why data is a trillion-dollar market "The bigger models scale, the more data you need. Data is a very durable need. If you believe in the scaling of models, then absolutely you should believe in the data market. I believe it's going to be at least a $100BN by 2030, if not $1TRN." Anastasios Nikolas Angelopoulos Do you have to scale into enterprise and mid-market to get this revenue scale or could you do it on frontier lab spend alone? Brendan (can/do) Garrett Lord Jonathan Siddharth Ali Ansari

Harry Stebbings

20,823 görüntüleme • 9 gün önce

A replay of today’s conference call on our AI infrastructure partnership and the River Bend data center transaction is now available. Highlights 01:52 - Opening remarks 04:35 - How the partnership is structured 05:36 - What differentiates the River Bend lease 14:12 - De-risking execution 26:50 - Why the transaction is compelling 29:06 - What this means for $HUT valuation 31:17 - Q&A
1:02:05

A replay of today’s conference call on our AI infrastructure partnership and the River Bend data center transaction is now available. Highlights 01:52 - Opening remarks 04:35 - How the partnership is structured 05:36 - What differentiates the River Bend lease 14:12 - De-risking execution 26:50 - Why the transaction is compelling 29:06 - What this means for $HUT valuation 31:17 - Q&A

Hut 8

16,466 görüntüleme • 7 ay önce

The intersection of crypto and AI, presented by OpenLedger Tim Copeland was joined by OpenLedger core contributor Ram in this sponsored episode to discuss the emerging intersection of decentralized AI and blockchain technology. The conversation covers OpenLedger’s infrastructure that lets users contribute proprietary data to train AI models, tokenomics, and the broader promise of creating a transparent, community-driven AI economy. OUTLINE 00:00 – Introduction 01:02 – What is Openledger? 02:27 – Data Contribution Model 08:47 – Access to Agents 15:16 – Ensuring Quality Data 19:09 – Incentive Structures 23:18 – The Role of Tokens 24:56 – The Convergence of AI and Crypto 27:53 – Competing with Centralized Systems 30:23 – Openledger's Future and Success 33:32 – Data Economy Insights 36:17 – Conclusion
36:50

The intersection of crypto and AI, presented by OpenLedger Tim Copeland was joined by OpenLedger core contributor Ram in this sponsored episode to discuss the emerging intersection of decentralized AI and blockchain technology. The conversation covers OpenLedger’s infrastructure that lets users contribute proprietary data to train AI models, tokenomics, and the broader promise of creating a transparent, community-driven AI economy. OUTLINE 00:00 – Introduction 01:02 – What is Openledger? 02:27 – Data Contribution Model 08:47 – Access to Agents 15:16 – Ensuring Quality Data 19:09 – Incentive Structures 23:18 – The Role of Tokens 24:56 – The Convergence of AI and Crypto 27:53 – Competing with Centralized Systems 30:23 – Openledger's Future and Success 33:32 – Data Economy Insights 36:17 – Conclusion

The Block Media

51,907 görüntüleme • 1 yıl önce

Failing to Understand the Exponential, Again? My conversation with Julian Schrittwieser - Julian Schrittwieser (Anthropic, AlphaGo Zero, MuZero) - on Move 37, Scaling RL, Nobel Prize for AI, and the AI frontier: 00:00 - Cold open: “We’re not seeing any slowdown.” 00:32 - Intro — Meet Julian 01:09 - The “exponential” from inside frontier labs 04:46 - 2026–2027: agents that work a full day; expert-level breadth 08:58 - Benchmarks vs reality: long-horizon work, GDP-Val, user value 10:26 - Move 37 — what actually happened and why it mattered 13:55 - Novel science: AlphaCode/AlphaTensor → when does AI earn a Nobel? 16:25 - Discontinuity vs smooth progress (and warning signs) 19:08 - Does pre-training + RL get us there? (AGI debates aside) 20:55 - Sutton’s “RL from scratch”? Julian’s take 23:03 - Julian’s path: Google → DeepMind → Anthropic 26:45 - AlphaGo (learn + search) in plain English 30:16 - AlphaGo Zero (no human data) 31:00 - AlphaZero (one algorithm: Go, chess, shogi) 31:46 - MuZero (planning with a learned world model) 33:23 -Lessons for today’s agents: search + learning at scale 34:57 - Do LLMs already have implicit world models? 39:02 - Why RL on LLMs took time (stability, feedback loops) 41:43 - Compute & scaling for RL — what we see so far 42:35 - Rewards frontier: human prefs, rubrics, RLVR, process rewards 44:36 - RL training data & the “flywheel” (and why quality matters) 48:02 - RL & Agents 101 — why RL unlocks robustness 50:51 - Should builders use RL-as-a-service? Or just tools + prompts? 52:18 - What’s missing for dependable agents (capability vs engineering) 53:51 - Evals & Goodhart — internal vs external benchmarks 57:35 - Mechanistic interpretability & “Golden Gate Claude” 1:00:03 - Safety & alignment at Anthropic — how it shows up in practice 1:03:48 - Jobs: human–AI complementarity (comparative advantage) 1:06:33 - Inequality, policy, and the case for 10× productivity → abundance 1:09:24 - Closing thoughts
1:09:56

Failing to Understand the Exponential, Again? My conversation with Julian Schrittwieser - Julian Schrittwieser (Anthropic, AlphaGo Zero, MuZero) - on Move 37, Scaling RL, Nobel Prize for AI, and the AI frontier: 00:00 - Cold open: “We’re not seeing any slowdown.” 00:32 - Intro — Meet Julian 01:09 - The “exponential” from inside frontier labs 04:46 - 2026–2027: agents that work a full day; expert-level breadth 08:58 - Benchmarks vs reality: long-horizon work, GDP-Val, user value 10:26 - Move 37 — what actually happened and why it mattered 13:55 - Novel science: AlphaCode/AlphaTensor → when does AI earn a Nobel? 16:25 - Discontinuity vs smooth progress (and warning signs) 19:08 - Does pre-training + RL get us there? (AGI debates aside) 20:55 - Sutton’s “RL from scratch”? Julian’s take 23:03 - Julian’s path: Google → DeepMind → Anthropic 26:45 - AlphaGo (learn + search) in plain English 30:16 - AlphaGo Zero (no human data) 31:00 - AlphaZero (one algorithm: Go, chess, shogi) 31:46 - MuZero (planning with a learned world model) 33:23 -Lessons for today’s agents: search + learning at scale 34:57 - Do LLMs already have implicit world models? 39:02 - Why RL on LLMs took time (stability, feedback loops) 41:43 - Compute & scaling for RL — what we see so far 42:35 - Rewards frontier: human prefs, rubrics, RLVR, process rewards 44:36 - RL training data & the “flywheel” (and why quality matters) 48:02 - RL & Agents 101 — why RL unlocks robustness 50:51 - Should builders use RL-as-a-service? Or just tools + prompts? 52:18 - What’s missing for dependable agents (capability vs engineering) 53:51 - Evals & Goodhart — internal vs external benchmarks 57:35 - Mechanistic interpretability & “Golden Gate Claude” 1:00:03 - Safety & alignment at Anthropic — how it shows up in practice 1:03:48 - Jobs: human–AI complementarity (comparative advantage) 1:06:33 - Inequality, policy, and the case for 10× productivity → abundance 1:09:24 - Closing thoughts

Matt Turck

235,526 görüntüleme • 9 ay önce

New session with Shreya Shankar on How to Automate Evals with AI (correctly) The most important part of the eval workflow is finding issues. Shreya does a live demo of how to steer the AI iteratively to find unknown unknowns Chapter summaries: 00:00:00 Introduction 00:00:55 Why vendors want to automate evals for you 00:01:45 Why no tool can fully automate evals 00:06:00 Mistake #1: Asking AI to just "find the issues" in your data 00:08:11 What good AI-assisted error analysis actually looks like 00:11:12 Live demo: building a review interface from scratch 00:15:10 Annotating traces and building a failure mode taxonomy 00:19:31 Mistake #2: Only reviewing your data once 00:22:53 Mistake #3: Treating all apps with the same accuracy bar 00:25:10 General-purpose agents vs. dedicated eval tools 00:25:48 Summary: three rules for automating evals correctly YT links and more in reply
27:18

New session with Shreya Shankar on How to Automate Evals with AI (correctly) The most important part of the eval workflow is finding issues. Shreya does a live demo of how to steer the AI iteratively to find unknown unknowns Chapter summaries: 00:00:00 Introduction 00:00:55 Why vendors want to automate evals for you 00:01:45 Why no tool can fully automate evals 00:06:00 Mistake #1: Asking AI to just "find the issues" in your data 00:08:11 What good AI-assisted error analysis actually looks like 00:11:12 Live demo: building a review interface from scratch 00:15:10 Annotating traces and building a failure mode taxonomy 00:19:31 Mistake #2: Only reviewing your data once 00:22:53 Mistake #3: Treating all apps with the same accuracy bar 00:25:10 General-purpose agents vs. dedicated eval tools 00:25:48 Summary: three rules for automating evals correctly YT links and more in reply

Hamel Husain

34,118 görüntüleme • 1 ay önce

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning
1:11

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 görüntüleme • 1 yıl önce

Why AI Can Now Make Discoveries - my conversation with Dan Roberts, Lead of the Foundations of Reinforcement Learning team at OpenAI 00:00 Intro: AI's wild week in mathematics 01:21 What OpenAI's Foundations of RL team does 03:08 Dan's journey: from black holes and quantum gravity to frontier AI 07:04 Are AI systems becoming useful for real science 08:21 The AI math moment: Erdős, OpenAI, DeepMind, and Anthropic 08:52 Why the OpenAI result was an act of exploration 10:25 OpenAI vs. DeepMind: informal reasoning vs. formal proof 12:13 RL 101: learning by doing, not just watching 15:10 Why reinforcement learning works 15:58 How RL breaks: sparse feedback and long-horizon tasks 17:03 RLHF: how human feedback shaped early language models 18:48 Move 37, self-play, and the search for novel strategies 22:16 Explore vs. exploit in scientific discovery 24:49 Why RL may now be "the cake," not the cherry on top 25:46 Why RL started working with large language models 27:29 Is RL "sucking supervision through a straw"? 28:47 Why language may be the grounding layer for intelligence 31:46 A contrarian take on the Bitter Lesson 32:41 What test-time compute actually is 34:50 How RL gives models the ability to think 35:40 Verifiable rewards, math, coding, and the messy real world 38:00 What physics can teach us about AI 42:08 Is there a thermodynamics of AI? 43:08 From Erdős problems to Einstein-level AI 45:16 Is AI already doing original science? 45:51 How far are we from AI automating AI research 47:41 Why Dan is excited about the future of science
49:06

Why AI Can Now Make Discoveries - my conversation with Dan Roberts, Lead of the Foundations of Reinforcement Learning team at OpenAI 00:00 Intro: AI's wild week in mathematics 01:21 What OpenAI's Foundations of RL team does 03:08 Dan's journey: from black holes and quantum gravity to frontier AI 07:04 Are AI systems becoming useful for real science 08:21 The AI math moment: Erdős, OpenAI, DeepMind, and Anthropic 08:52 Why the OpenAI result was an act of exploration 10:25 OpenAI vs. DeepMind: informal reasoning vs. formal proof 12:13 RL 101: learning by doing, not just watching 15:10 Why reinforcement learning works 15:58 How RL breaks: sparse feedback and long-horizon tasks 17:03 RLHF: how human feedback shaped early language models 18:48 Move 37, self-play, and the search for novel strategies 22:16 Explore vs. exploit in scientific discovery 24:49 Why RL may now be "the cake," not the cherry on top 25:46 Why RL started working with large language models 27:29 Is RL "sucking supervision through a straw"? 28:47 Why language may be the grounding layer for intelligence 31:46 A contrarian take on the Bitter Lesson 32:41 What test-time compute actually is 34:50 How RL gives models the ability to think 35:40 Verifiable rewards, math, coding, and the messy real world 38:00 What physics can teach us about AI 42:08 Is there a thermodynamics of AI? 43:08 From Erdős problems to Einstein-level AI 45:16 Is AI already doing original science? 45:51 How far are we from AI automating AI research 47:41 Why Dan is excited about the future of science

Matt Turck

66,936 görüntüleme • 2 ay önce