Loading video...

Video Failed to Load

Go Home

capability != learning new benchtalks with Parth Asawa on continual learning, where we discuss teaching models to learn from experience, measuring learning ability, the bet on parametric models, and more 01:06 What is continual learning? 04:10 Why capability and learning are different 06:13 Why build a benchmark? 08:07 Continual...

41,770 views • 4 months ago •via X (Twitter)

3 Comments

vincent sunn chen's profile picture
vincent sunn chen4 months ago

Kudos to the full Continual Learning Bench team for the work! + @chris_m_glaze @Gorlanski Benji Xu @RamyaRamakri @_asimbiswal @fredsala @matei_zaharia @profjoeyg

vincent sunn chen's profile picture
vincent sunn chen4 months ago

Youtube here:

James Alcorn's profile picture
James Alcorn4 months ago

@pgasawa @pgasawa a lad destined for greatness

Related Videos

Models have IQ but no experience. Frontier models show up on day one with superhuman intelligence but no expertise on the thousands of tasks your company actually does. Trajectory exists to close that gap through continual learning. Ronak Malde trained SWE-1 at Windsurf, then went to DeepMind. His cofounders Michael Elabd and Arjun Karanam worked on Gemini Robotics and multimodal models for Vision Pro. All three hit the same wall: big labs train one model for everyone, but nobody trains one for you. The conversation covers: — why today’s agents are “pseudo continual learning”: we are in the paper road map era, not Google Maps — “Group Size 1”, a GRPO variant that learns from one real-world rollout instead of replaying the same task eight times, so you don’t need a simulated environment — how Harvey trained a model 6x cheaper than frontier that took an open-source baseline up by over 4x on its own legal benchmark — Continual Grading, a meta-grader that turns rubrics on 100 traces into reward for 10,000 — continual learning vs. recursive self-improvement, and why only one keeps humans in the loop — why continual learning will make product-building more like tending a garden of products Chapters 0:00 – Introduction 0:45 – Pseudo continual learning: paper maps vs Google Maps 2:48 – Do we need new architectures? Rich Sutton, David Silver, and the missing layer 4:33 – From a $100M consulting model to a product: lessons from SWE-1 at Windsurf 7:36 – Harvey: 6x cheaper than frontier, 4% to 18% on its own benchmark 8:55 – Why "Trajectory": the unit of work is a task, not a token 10:13 – The primitives of continual learning: traces, replayable environments, reward 12:56 – Group Size 1 and the meta-grader: training without an environment or a labeled reward 16:16 – The platform: train, eval and deploy in one click, and who it's for 18:58 – Rogo and intelligence density 20:14 – What's next: curiosity, and why continual learning beats RSI on alignment 24:19 – Research and product under one roof, and the product builder as gardener 27:26 – Why work at Trajectory, and the optimistic case: from 1% to 99%

Lauren Reeder

36,750 views • 11 days ago