Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Our new podcast on evals, with Max Niederman, Ege Erdil, and Stephen Yang. 0:00:00 – What's an eval, and how's it different from an RL environment? 0:19:33 – Why are models bad at building an emulator when the task is fully verifiable? 0:42:00 – How does training on bad... show more

Mechanize

14,509 subscribers

40,871 просмотров • 3 месяцев назад •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

Комментарии: 9

Фото профиля Mechanize

Mechanize3 месяцев назад

Youtube: Substack: Spotify:

Фото профиля Matthew Berman

Matthew Berman3 месяцев назад

@Mascobot How do I get in touch?

Фото профиля Mechanize

Mechanize3 месяцев назад

@Mascobot DM'd

Фото профиля Alessio Toniolo

Alessio Toniolo3 месяцев назад

Enjoyed the commentary on RL environment scaling and software engineering. Thanks guys!

Фото профиля Shman

Shman3 месяцев назад

Apple podcast link?

Фото профиля Ariel Lillie

Ariel Lillie3 месяцев назад

this sounds super intriguing, especially the bad data angle. can't wait to dive in!

Фото профиля Clemens Helmut Sageder

Clemens Helmut Sageder3 месяцев назад

@tamaybes interesting podcast

Фото профиля Seungju chae

Seungju chae3 месяцев назад

this is gold, thank you

Фото профиля Zarroc.BTC 🧠

Zarroc.BTC 🧠3 месяцев назад

let's be real, the bad data part is a game changer, can't wait to hear the full breakdown

Похожие видео

The Andrej Karpathy interview 0:00:00 – AGI is still a decade away 0:30:33 – LLM cognitive deficits 0:40:53 – RL is terrible 0:50:26 – How do humans learn? 1:07:13 – AGI will blend into 2% GDP growth 1:18:24 – ASI 1:33:38 – Evolution of intelligence & culture 1:43:43 - Why self driving took so long 1:57:08 - Future of education Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

The Andrej Karpathy interview 0:00:00 – AGI is still a decade away 0:30:33 – LLM cognitive deficits 0:40:53 – RL is terrible 0:50:26 – How do humans learn? 1:07:13 – AGI will blend into 2% GDP growth 1:18:24 – ASI 1:33:38 – Evolution of intelligence & culture 1:43:43 - Why self driving took so long 1:57:08 - Future of education Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

Dwarkesh Patel

10,781,536 просмотров • 11 месяцев назад

The Dario Amodei interview. 0:00:00 - What exactly are we scaling? 0:12:36 - Is diffusion cope? 0:29:42 - Is continual learning necessary? 0:46:20 - If AGI is imminent, why not buy more compute? 0:58:49 - How will AI labs actually make profit? 1:31:19 - Will regulations destroy the boons of AGI? 1:47:41 - Why can’t China and America both have a country of geniuses in a datacenter? Look up Dwarkesh Podcast on Youtube, Spotify, Apple Podcasts, etc.

The Dario Amodei interview. 0:00:00 - What exactly are we scaling? 0:12:36 - Is diffusion cope? 0:29:42 - Is continual learning necessary? 0:46:20 - If AGI is imminent, why not buy more compute? 0:58:49 - How will AI labs actually make profit? 1:31:19 - Will regulations destroy the boons of AGI? 1:47:41 - Why can’t China and America both have a country of geniuses in a datacenter? Look up Dwarkesh Podcast on Youtube, Spotify, Apple Podcasts, etc.

Dwarkesh Patel

2,065,136 просмотров • 7 месяцев назад

The Jensen Huang episode. 0:00:00 – Is Nvidia’s biggest moat its grip on scarce supply chains? 0:16:25 – Will TPUs break Nvidia’s hold on AI compute? 0:41:06 – Why doesn’t Nvidia become a hyperscaler? 0:57:36 – Should we be selling AI chips to China? 1:35:06 – Why doesn’t Nvidia make multiple different chip architectures? Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

The Jensen Huang episode. 0:00:00 – Is Nvidia’s biggest moat its grip on scarce supply chains? 0:16:25 – Will TPUs break Nvidia’s hold on AI compute? 0:41:06 – Why doesn’t Nvidia become a hyperscaler? 0:57:36 – Should we be selling AI chips to China? 1:35:06 – Why doesn’t Nvidia make multiple different chip architectures? Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

Dwarkesh Patel

6,283,359 просмотров • 5 месяцев назад

New session with Shreya Shankar on How to Automate Evals with AI (correctly) The most important part of the eval workflow is finding issues. Shreya does a live demo of how to steer the AI iteratively to find unknown unknowns Chapter summaries: 00:00:00 Introduction 00:00:55 Why vendors want to automate evals for you 00:01:45 Why no tool can fully automate evals 00:06:00 Mistake #1: Asking AI to just "find the issues" in your data 00:08:11 What good AI-assisted error analysis actually looks like 00:11:12 Live demo: building a review interface from scratch 00:15:10 Annotating traces and building a failure mode taxonomy 00:19:31 Mistake #2: Only reviewing your data once 00:22:53 Mistake #3: Treating all apps with the same accuracy bar 00:25:10 General-purpose agents vs. dedicated eval tools 00:25:48 Summary: three rules for automating evals correctly YT links and more in reply

New session with Shreya Shankar on How to Automate Evals with AI (correctly) The most important part of the eval workflow is finding issues. Shreya does a live demo of how to steer the AI iteratively to find unknown unknowns Chapter summaries: 00:00:00 Introduction 00:00:55 Why vendors want to automate evals for you 00:01:45 Why no tool can fully automate evals 00:06:00 Mistake #1: Asking AI to just "find the issues" in your data 00:08:11 What good AI-assisted error analysis actually looks like 00:11:12 Live demo: building a review interface from scratch 00:15:10 Annotating traces and building a failure mode taxonomy 00:19:31 Mistake #2: Only reviewing your data once 00:22:53 Mistake #3: Treating all apps with the same accuracy bar 00:25:10 General-purpose agents vs. dedicated eval tools 00:25:48 Summary: three rules for automating evals correctly YT links and more in reply

Hamel Husain

34,299 просмотров • 2 месяцев назад

The Ilya Sutskever episode 0:00:00 – Explaining model jaggedness 0:09:39 - Emotions and value functions 0:18:49 – What are we scaling? 0:25:13 – Why humans generalize better than models 0:35:45 – Straight-shotting superintelligence 0:46:47 – SSI’s model will learn from deployment 0:55:07 – Alignment 1:18:13 – “We are squarely an age of research company” 1:29:23 – Self-play and multi-agent 1:32:42 – Research taste Look up Dwarkesh Podcast on YouTube, Apple Podcasts, or Spotify. Enjoy!

The Ilya Sutskever episode 0:00:00 – Explaining model jaggedness 0:09:39 - Emotions and value functions 0:18:49 – What are we scaling? 0:25:13 – Why humans generalize better than models 0:35:45 – Straight-shotting superintelligence 0:46:47 – SSI’s model will learn from deployment 0:55:07 – Alignment 1:18:13 – “We are squarely an age of research company” 1:29:23 – Self-play and multi-agent 1:32:42 – Research taste Look up Dwarkesh Podcast on YouTube, Apple Podcasts, or Spotify. Enjoy!

Dwarkesh Patel

4,153,064 просмотров • 10 месяцев назад

She literally broke down how to run evals in Claude Code (built the whole thing live): 01:34 - What people get wrong with evals 04:35 - Why product taste is the alpha now 09:28 - Building a PM agent from one prompt 19:00 - Instrumentation without writing code 22:00 - Watching traces stream in live 28:00 - Getting Claude to write your first eval 33:58 - When vibe evals work and when they don't 48:50 - The self-improving loop (this part is wild) 01:03:00 - Same-day shipping is real 01:06:00 - The context graph unlock

She literally broke down how to run evals in Claude Code (built the whole thing live): 01:34 - What people get wrong with evals 04:35 - Why product taste is the alpha now 09:28 - Building a PM agent from one prompt 19:00 - Instrumentation without writing code 22:00 - Watching traces stream in live 28:00 - Getting Claude to write your first eval 33:58 - When vibe evals work and when they don't 48:50 - The self-improving loop (this part is wild) 01:03:00 - Same-day shipping is real 01:06:00 - The context graph unlock

Aakash Gupta

150,362 просмотров • 4 месяцев назад

New blackboard lecture w Reiner Pope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of data movement 0:25:59 – How systolic arrays work 0:39:00 – Clock cycles and pipeline registers 0:51:40 – FPGAs vs ASICs 1:03:14 – Cache vs scratchpad 1:07:16 – Why CPU cores are much bigger than GPU cores 1:11:49 – Brains vs chips 1:15:22 – A GPU is just a bunch of tiny TPUs Look up Dwarkesh Podcast on YouTube/Spotify/etc to watch. Enjoy!

New blackboard lecture w Reiner Pope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of data movement 0:25:59 – How systolic arrays work 0:39:00 – Clock cycles and pipeline registers 0:51:40 – FPGAs vs ASICs 1:03:14 – Cache vs scratchpad 1:07:16 – Why CPU cores are much bigger than GPU cores 1:11:49 – Brains vs chips 1:15:22 – A GPU is just a bunch of tiny TPUs Look up Dwarkesh Podcast on YouTube/Spotify/etc to watch. Enjoy!

Dwarkesh Patel

938,867 просмотров • 4 месяцев назад

New episode w Adam Marblestone on what the brain's secret sauce is: how do we learn so much from so little? Also, the answer to Ilya’s question: how does the genome encode desires for high level concepts that are only seen during lifetime? Turns out, they’re deeply connected questions. Timestamps 0:00:00 – The brain’s secret sauce is the reward functions, not the architecture 0:22:20 – What the genome actually encodes 0:42:42 – What kind of RL is the brain doing? 0:50:31 – Is biological hardware a limitation or an advantage? 1:03:59 – Why we need to map the human brain 1:23:28 – What value will automating math have? 1:38:18 – Architecture of the brain Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

New episode w Adam Marblestone on what the brain's secret sauce is: how do we learn so much from so little? Also, the answer to Ilya’s question: how does the genome encode desires for high level concepts that are only seen during lifetime? Turns out, they’re deeply connected questions. Timestamps 0:00:00 – The brain’s secret sauce is the reward functions, not the architecture 0:22:20 – What the genome actually encodes 0:42:42 – What kind of RL is the brain doing? 0:50:31 – Is biological hardware a limitation or an advantage? 1:03:59 – Why we need to map the human brain 1:23:28 – What value will automating math have? 1:38:18 – Architecture of the brain Look up Dwarkesh Podcast on YouTube, Apple Podcasts, Spotify, etc. Enjoy!

Dwarkesh Patel

747,536 просмотров • 9 месяцев назад

The Arcee AI Podcast is here! In this episode, Lucas Atkins and stochasm join us to discuss the story of Trinity models and everything frontier. I can say, this talk has been one of the most amazing and technical conversations we've had on Ground Zero. 0:00:00 - Intro 0:00:59 - Varun's transition from SWE to Pre-Training Lead 0:04:20 - Trinity Manifesto, Openclaw Ecosystem 0:12:15 - Arcee's Post-Training to Pre-Training Pivot 0:23:45 - Varun's first Pre-Training run (you can just do things!) 0:27:33 - Saturation in Pre-Training?, Mid-Training 0:37:00 - Tweaking the Training Architecture, Adam vs Muon, Evals 01:09:07 - Inference Engineering, Quick Fire, Post-Training Recipe 01:18:02 - Alpha in RL Envs, Harness Design 01:23:00 - American Open Source is trailing Chinese Competitors, Trinity Adoption 01:29:25 - Hiring at Arcee, Advice to 20yo

The Arcee AI Podcast is here! In this episode, Lucas Atkins and stochasm join us to discuss the story of Trinity models and everything frontier. I can say, this talk has been one of the most amazing and technical conversations we've had on Ground Zero. 0:00:00 - Intro 0:00:59 - Varun's transition from SWE to Pre-Training Lead 0:04:20 - Trinity Manifesto, Openclaw Ecosystem 0:12:15 - Arcee's Post-Training to Pre-Training Pivot 0:23:45 - Varun's first Pre-Training run (you can just do things!) 0:27:33 - Saturation in Pre-Training?, Mid-Training 0:37:00 - Tweaking the Training Architecture, Adam vs Muon, Evals 01:09:07 - Inference Engineering, Quick Fire, Post-Training Recipe 01:18:02 - Alpha in RL Envs, Harness Design 01:23:00 - American Open Source is trailing Chinese Competitors, Trinity Adoption 01:29:25 - Hiring at Arcee, Advice to 20yo

himanshu

32,531 просмотров • 5 месяцев назад

.Casey Handmer on how to feed the AIs. 0:00:00 – Why doesn’t China win by default 0:08:28 – Why hyperscalers choose natural gas over solar 0:18:01 – Solar's astonishing learning rates 0:27:02 – How to build 50,000 acre solar-powered data centers 0:40:24 – Environmental regulations blocking clean energy 0:44:04 – Batteries replacing the grid 0:49:14 – GDP is broken, AGI's true value must be measured in total energy use 0:58:45 – Silicon wafers in space with one mind each Available on Apple Podcasts, Spotify, YouTube, etc. Enjoy!

.Casey Handmer on how to feed the AIs. 0:00:00 – Why doesn’t China win by default 0:08:28 – Why hyperscalers choose natural gas over solar 0:18:01 – Solar's astonishing learning rates 0:27:02 – How to build 50,000 acre solar-powered data centers 0:40:24 – Environmental regulations blocking clean energy 0:44:04 – Batteries replacing the grid 0:49:14 – GDP is broken, AGI's true value must be measured in total energy use 0:58:45 – Silicon wafers in space with one mind each Available on Apple Podcasts, Spotify, YouTube, etc. Enjoy!

Dwarkesh Patel

1,408,889 просмотров • 1 год назад

New episode with John Schulman, Charlie O'Neill and Beren Millidge. I got together with some of the most insightful AI researchers I know who are at the openish companies, because I wanted to hear the details of what's actually happening at the frontier and what comes next. 0:00:00 – Steelmanning the case against RSI 0:18:39 – What’s driving the Chinese labs’ progress 0:28:06 – How will automated AI researchers be trained 0:33:51 – Will long-horizon RL elicit AGI? 0:45:24 – The sim-to-real gap 1:00:33 – How much progress is explained by data? 1:18:03 – Why is RL working so well? 1:24:54 – Move 37 and entropy collapse 1:28:31 – Rapid-fire timelines

New episode with John Schulman, Charlie O'Neill and Beren Millidge. I got together with some of the most insightful AI researchers I know who are at the openish companies, because I wanted to hear the details of what's actually happening at the frontier and what comes next. 0:00:00 – Steelmanning the case against RSI 0:18:39 – What’s driving the Chinese labs’ progress 0:28:06 – How will automated AI researchers be trained 0:33:51 – Will long-horizon RL elicit AGI? 0:45:24 – The sim-to-real gap 1:00:33 – How much progress is explained by data? 1:18:03 – Why is RL working so well? 1:24:54 – Move 37 and entropy collapse 1:28:31 – Rapid-fire timelines

Dwarkesh Patel

953,648 просмотров • 20 дней назад

The Delta of Intelligence is Human Data! Curtis G. Northcutt is Director of AI Research at Handshake AI. In this episode, Curtis shares his unique perspectives on human data, RL envs, four quadrants of the AI market, journey of Handshake and much more. 0:00:00 - INTRO 0:02:08 - The Snowman Effect: From Rural Kentucky to 7 Years at MIT 0:09:50 - Confident Learning, Two Systems of Intelligence, Classical ML Has to Prevail 0:20:37 - Origin of CleanLab and Handshake acquisition 0:28:00 - How does GPT-5 become GPT-6? 0:31:20 - The Fastest growing Data Lab: What makes Handshake different? 0:35:32 - Difference between Good Data and Bad Data 0:38:17 - New kind of Data, IA and AI 0:42:04 - Scaling Coding Benchmarks and Efficiency in Long Horizon Tasks 0:49:12 - On Pre-Training, Misconception around Human Data 0:57:13 - Open Question: Taste and Personality, Quick Fire 01:05:15 - Advice to 20yo : Skill and Obsession

The Delta of Intelligence is Human Data! Curtis G. Northcutt is Director of AI Research at Handshake AI. In this episode, Curtis shares his unique perspectives on human data, RL envs, four quadrants of the AI market, journey of Handshake and much more. 0:00:00 - INTRO 0:02:08 - The Snowman Effect: From Rural Kentucky to 7 Years at MIT 0:09:50 - Confident Learning, Two Systems of Intelligence, Classical ML Has to Prevail 0:20:37 - Origin of CleanLab and Handshake acquisition 0:28:00 - How does GPT-5 become GPT-6? 0:31:20 - The Fastest growing Data Lab: What makes Handshake different? 0:35:32 - Difference between Good Data and Bad Data 0:38:17 - New kind of Data, IA and AI 0:42:04 - Scaling Coding Benchmarks and Efficiency in Long Horizon Tasks 0:49:12 - On Pre-Training, Misconception around Human Data 0:57:13 - Open Question: Taste and Personality, Quick Fire 01:05:15 - Advice to 20yo : Skill and Obsession

himanshu

22,264 просмотров • 4 месяцев назад

Jerry Tworek on path to AGI Jerry Tworek sits down with Francois Chaubard to talk about what's next on the path to AGI 0:00:19 – How to define intelligence 0:17:59 – Games are uniquely good for intelligence 0:21:27 – Why meta-learning is closest to right 0:25:31 – OAI vs. Ant

Jerry Tworek on path to AGI Jerry Tworek sits down with Francois Chaubard to talk about what's next on the path to AGI 0:00:19 – How to define intelligence 0:17:59 – Games are uniquely good for intelligence 0:21:27 – Why meta-learning is closest to right 0:25:31 – OAI vs. Ant

ARC Prize

41,846 просмотров • 4 месяцев назад

Episode w Dylan Patel and Asianometry out! A bonanza on how the semiconductor industry actually works. & what Xi could do if he becomes scaling pilled, how we can train models with 10,000x GPT-4's compute by end of decade, & much more. This one is very fun. Enjoy! Links below. 0:00:00 – Xi’s path to AGI 0:05:05 – Liang Mong Song 0:09:10 – How semiconductors get better 0:12:01 – China can centralize compute 0:19:35 – Export controls & sanctions 0:33:45 – Huawei’s intense culture 0:39:45 – Why the semiconductor industry is so stratified 0:41:50 – N2 should not exist 0:46:47 – Taiwan invasion hypothetical 0:50:15 – Mind-boggling complexity of semiconductors 1:00:06 – Chip architecture design 1:05:29 – Architectures lead to different AI models? China vs. US 1:11:06 – Being head of compute at an AI lab 1:17:17 – Scaling costs and power demand 1:37:59 – Are we financing an AI bubble?

Episode w Dylan Patel and Asianometry out! A bonanza on how the semiconductor industry actually works. & what Xi could do if he becomes scaling pilled, how we can train models with 10,000x GPT-4's compute by end of decade, & much more. This one is very fun. Enjoy! Links below. 0:00:00 – Xi’s path to AGI 0:05:05 – Liang Mong Song 0:09:10 – How semiconductors get better 0:12:01 – China can centralize compute 0:19:35 – Export controls & sanctions 0:33:45 – Huawei’s intense culture 0:39:45 – Why the semiconductor industry is so stratified 0:41:50 – N2 should not exist 0:46:47 – Taiwan invasion hypothetical 0:50:15 – Mind-boggling complexity of semiconductors 1:00:06 – Chip architecture design 1:05:29 – Architectures lead to different AI models? China vs. US 1:11:06 – Being head of compute at an AI lab 1:17:17 – Scaling costs and power demand 1:37:59 – Are we financing an AI bubble?

Dwarkesh Patel

261,054 просмотров • 2 лет назад

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?

Pat Grady

66,691 просмотров • 1 месяц назад

one thing that has saved my projects more time than I can count is evals boy was I excited when florian, quite literally an expert in benchmarks, agreed to hop into a ~2h interview to do a walkthrough of what the eval landscape looks like in 2026 (and also answer my personal business questions on the subject) given that now running frontier model through benchmarks is a vector for hacking other systems in order to avoid doing work (looking at you sol), I think it's more important than ever to educate folks on the evals situation. had a lot of fun throughout this session and I hope that you learn a thing or two! enjoy! 🌹 table of content: 0:00:00: are AI Benchmark broken? 0:05:45: Florian Brand background 0:09:00: what motivates florian to work on evaluation? 0:13:33: what is the mirrorcode benchmark about? 0:18:20: cheating in agent benchmark is insaneeeee 0:24:08: LLM benchmarks in era of agents 0:26:30: what’s up with the pelican man 0:28:27: evals are about capabilities 0:31:46: components of running evals 0:35:30: the volume of things to audit is huge!!! 0:40:20: expert answers are wrong hahahaha 0:46:00: api providers aren’t the same 0:48:00: benchmark narrow capabilities (synthetically) 0:50:56: link between eval and environment 0:53:45: small validated benchmark or massive bench? 0:56:11: what is your flow to review a benchmark? 0:58:30: tracking work capabilities with evaluation 1:00:20: slide deck in industry is all vibecoded 1:03:30: harness impact in the evaluation 1:07:39: hardware/sandboxes impact evaluation too! 1:11:00: “is it going to get worse?” 1:12:40: all components influence the final score 1:13:50: training models on different harnesses? 1:17:20: is the model just the weights or it’s all of it? 1:19:30: how to craft benchmark that prevent to cheating and undereliciting models in 2026 1:23:19: ways agents cheat and steal 1:26:00: correct elicitation of capabilities is important 1:36:00: building evaluation on prime intellect 1:45:10: how do you design interactivity benchmarks? 1:48:40: do you think evals are well set to reflect real world performance? 1:52:50: what will the benchmarking landscape will look like in 1 year

Yacine Mahdid

12,923 просмотров • 2 месяцев назад

I got an expert to give me a masterclass on AI evals: (63 mins of stuff most builders learn the hard way) 0:00 - Why your product is lying to you 22:03 - Full eval flow walkthrough 35:42 - Evals ARE your PRD (not QA) 57:52 - Failures at Grammarly, Copilot & Klarna

I got an expert to give me a masterclass on AI evals: (63 mins of stuff most builders learn the hard way) 0:00 - Why your product is lying to you 22:03 - Full eval flow walkthrough 35:42 - Evals ARE your PRD (not QA) 57:52 - Failures at Grammarly, Copilot & Klarna

Aakash Gupta

247,328 просмотров • 7 месяцев назад

🎙️ New The Edge Podcast 😱 Why ETH Is Destined To Go So Much Higher 0:00 - Intro 8:12 - Key factors changing sentiment on ETH 13:04 - Impact of Etherealize 15:28 - A new united front at Ethereum Foundation 20:30 - vitalik.eth's vision for low-risk DeFi 33:14 - To believe in somETHing 36:21 - Why is ETH still undervalued? 45:28 - Defensibility vs new alt L1 competitors 52:44 - Ethereum's uptime is an outlier feature 55:19 - Upcoming Fusaka upgrade 1:00:19 - Is the 4-year cycle still in play? 1:04:21 - ETH price in 2026 vs 2030 1:18:25 - Closing 🙏 Thanks to Ethereum community member and ETH investor ⟠ for joining us!

🎙️ New The Edge Podcast 😱 Why ETH Is Destined To Go So Much Higher 0:00 - Intro 8:12 - Key factors changing sentiment on ETH 13:04 - Impact of Etherealize 15:28 - A new united front at Ethereum Foundation 20:30 - vitalik.eth's vision for low-risk DeFi 33:14 - To believe in somETHing 36:21 - Why is ETH still undervalued? 45:28 - Defensibility vs new alt L1 competitors 52:44 - Ethereum's uptime is an outlier feature 55:19 - Upcoming Fusaka upgrade 1:00:19 - Is the 4-year cycle still in play? 1:04:21 - ETH price in 2026 vs 2030 1:18:25 - Closing 🙏 Thanks to Ethereum community member and ETH investor ⟠ for joining us!

DeFi Dad ⟠ defidad.eth

16,766 просмотров • 1 год назад

.funkii.sui put $100K of his own money in, shipped 5 protocols solo, and hit 8 figures in revenue. with no team, no grants, just conviction. The full conversation on why he's building on Sui 👇 Timestamps: 0:00 — Intro 0:55 — Funkii's background & going all-in on Sui 3:00 — How he discovered Sui 6:30 — Why Move is safer than Solidity 9:00 — Sui developer experience vs other chains 12:00 — Is Sui still early? 14:30 — Mission 69B: the company behind it all 17:00 — What’s Faith 20:00 — Tide: revenue-backed fundraising 25:00 — Why crypto is here to stay 27:30 — AI agents & crypto payments 33:00 — Walrus, Deep Book & the full Sui stack 36:00 — Cannibal: a permissionless Polymarket on Sui 40:30 — Distribution & growth strategy 42:00 — Sui's breakout moment 44:00 — Funkii's favorite Sui project

.funkii.sui put $100K of his own money in, shipped 5 protocols solo, and hit 8 figures in revenue. with no team, no grants, just conviction. The full conversation on why he's building on Sui 👇 Timestamps: 0:00 — Intro 0:55 — Funkii's background & going all-in on Sui 3:00 — How he discovered Sui 6:30 — Why Move is safer than Solidity 9:00 — Sui developer experience vs other chains 12:00 — Is Sui still early? 14:30 — Mission 69B: the company behind it all 17:00 — What’s Faith 20:00 — Tide: revenue-backed fundraising 25:00 — Why crypto is here to stay 27:30 — AI agents & crypto payments 33:00 — Walrus, Deep Book & the full Sui stack 36:00 — Cannibal: a permissionless Polymarket on Sui 40:30 — Distribution & growth strategy 42:00 — Sui's breakout moment 44:00 — Funkii's favorite Sui project

Sooraj

12,400 просмотров • 5 месяцев назад

.Satya Nadella gave me and Dylan Patel an exclusive tour of Fairwater 2, the most powerful AI datacenter in the world. We then chatted through Satya's vision for Microsoft in a world with AGI. 0:00:00 - Fairwater 2 0:04:15 - Business models for AGI 0:13:42 - Copilot 0:20:56 - Whose margins will expand most? 0:37:12 - MAI 0:48:42 - The hyperscale business 1:03:39 - In-house chip & OpenAI partnership 1:10:30 - The CAPEX explosion 1:16:01 - Will the world trust US companies to lead AI? Look up Dwarkesh Podcast on Youtube, Apple Podcasts or Spotify to tune in.

.Satya Nadella gave me and Dylan Patel an exclusive tour of Fairwater 2, the most powerful AI datacenter in the world. We then chatted through Satya's vision for Microsoft in a world with AGI. 0:00:00 - Fairwater 2 0:04:15 - Business models for AGI 0:13:42 - Copilot 0:20:56 - Whose margins will expand most? 0:37:12 - MAI 0:48:42 - The hyperscale business 1:03:39 - In-house chip & OpenAI partnership 1:10:30 - The CAPEX explosion 1:16:01 - Will the world trust US companies to lead AI? Look up Dwarkesh Podcast on Youtube, Apple Podcasts or Spotify to tune in.

Dwarkesh Patel

1,895,952 просмотров • 10 месяцев назад