
Epoch AI
@EpochAIResearch • 47,631 subscribers
Investigating the trajectory of AI for the benefit of society.
Videos

What are the largest software engineering tasks AI can perform? To answer this, we built MirrorCode, our long-horizon SWE benchmark that lets AI code autonomously for days at a time. The best models complete some tasks we estimate would take human engineers several weeks.
Epoch AI93,161 görüntüleme • 3 ay önce

How does math research change when the cost of trying your first dumb idea goes to zero? Daniel Litt joins Greg Burnham and Anson Ho to discuss what today’s models can and can’t do in math, and how far they are from doing high-quality research. 0:00:00 What's the hardest math problem AI can solve today? 00:16:08 How helpful are today’s AI models for math research? 00:23:36 Junk papers, LLM-generated proofs, and the refereeing crisis 00:27:21 AI enables searching through problems at scale 00:33:49 When will AI be good enough to publish in top math journals? 00:42:15 What are the returns to intelligence? 00:59:50 Will AI solve Millennium problems? 01:11:54 Is math full of low-hanging fruit? 01:18:47 How Daniel has adapted his professional life to AI progress 01:25:28 What do AI math benchmarks actually measure? 01:33:05 Designing the Open Problems benchmark 01:56:35 Do mathematicians believe heuristic arguments about conjectures? 02:01:24 What if FrontierMath: Open Problems gets solved? 02:06:53 Is AI on the cusp of accelerating math progress?
Epoch AI178,703 görüntüleme • 8 ay önce

Are AI benchmarks doomed? Greg Burnham and Tom Adamczewski join Anson Ho to push back on benchmark pessimism and dig into what the next generation of AI benchmarks could look like. (0:00:00) - Preview (0:00:36) - Intro: Are AI benchmarks doomed? (0:03:13) - The costs and benefits of benchmark development (0:11:48) - MirrorCode and scalable benchmarks (0:20:57) - AI speed-up in benchmark development (0:23:28) - The benchmark-reality gap (0:38:26) - Can an AGI benchmark exist? (0:43:18) - Beyond automated scoring (1:00:45) - How AI changes benchmark building in practice
Epoch AI22,037 görüntüleme • 4 ay önce

Will AI drive Europe towards a “high interest rates, no growth” future? How will automation impact entry-level workers and the structure of firms? What role does Europe play as the US and China continue to push AI progress? On this episode of Epoch After Hours, Luis Garicano 🇪🇺🇺🇦 joins Epoch AI researchers Anson Ho and Andrei Potlogea to discuss these questions. -- Timestamps -- 0:00:00 – Will AI trigger explosive growth? 0:06:26 – Short-run macroeconomic effects 0:11:29 – The decline of junior jobs 0:20:21 – The missing training ladder 0:39:31 – Europe’s AI regulation problem 0:52:46 – Who captures AI value? 01:08:17 – AI, interest rates & fiscal future
Epoch AI33,102 görüntüleme • 9 ay önce
Daha fazla içerik yok.