Loading video...

Video Failed to Load

Go Home

Gave a talk to Machine Learning @ Berkeley on benchmarking frontier models on spatial biology. Why understanding how assays work is important, what verifiability might look like with messy biology + infrastructure challenges running agentic evals at scale.

kenbwork's profile picture

Kenny Workman

7,266 subscribers

15,784 views • 2 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

$TAO is tackling the core challenges in machine learning, from optimizing data collection to faster inference, aiming to outperform giants like OpenAI and Microsoft. With a focus on computational efficiency and robust models, the race is on.
0:56

$TAO is tackling the core challenges in machine learning, from optimizing data collection to faster inference, aiming to outperform giants like OpenAI and Microsoft. With a focus on computational efficiency and robust models, the race is on.

Grayscale

88,595 views • 1 year ago

.CellType is building the agentic drug company. AI agents + foundation models that simulate human biology. They've already discovered and validated a novel cancer treatment signal and work with Top 10 pharma. Congrats on the launch David van Dijk and Ivan Vrkic!
1:11

.CellType is building the agentic drug company. AI agents + foundation models that simulate human biology. They've already discovered and validated a novel cancer treatment signal and work with Top 10 pharma. Congrats on the launch David van Dijk and Ivan Vrkic!

Y Combinator

46,752 views • 4 months ago

Today we're announcing that hybrid agentic inference is coming to Perplexity Computer. Computer can split tasks between a local model running on your machine and frontier models in the cloud. This keeps private data on your device and maximizes token efficiency. Coming soon.
0:59

Today we're announcing that hybrid agentic inference is coming to Perplexity Computer. Computer can split tasks between a local model running on your machine and frontier models in the cloud. This keeps private data on your device and maximizes token efficiency. Coming soon.

Perplexity

351,015 views • 1 month ago

During NeurIPS's 2025 conference, Ankit Gupta sat down with Ellen Zhong, an assistant professor of computer science at Princeton, to discuss how machine learning is reshaping structural biology. They explore how proteins aren’t static structures but dynamic molecular machines, and how techniques like cryo-electron microscopy combined with ML are revealing protein motion beyond traditional structure prediction. 00:11 — Introduction 00:55 — From Supercomputers to Cryo-EM 02:43 — The Rise of Cryo-EM 03:30 — Proteins as Dynamic Systems 04:30 — Inverse Problems in Biology 05:31 — Lessons from DeepMind, Industry and Academia 07:35 — Why Protein Dynamics Remain Unsolved 08:29 — Collaborating with Experimental Scientists 09:28 — What’s Overhyped and Underhyped in AI-Driven Biology 10:51 — The Future of AI-Driven Biology
11:52

During NeurIPS's 2025 conference, Ankit Gupta sat down with Ellen Zhong, an assistant professor of computer science at Princeton, to discuss how machine learning is reshaping structural biology. They explore how proteins aren’t static structures but dynamic molecular machines, and how techniques like cryo-electron microscopy combined with ML are revealing protein motion beyond traditional structure prediction. 00:11 — Introduction 00:55 — From Supercomputers to Cryo-EM 02:43 — The Rise of Cryo-EM 03:30 — Proteins as Dynamic Systems 04:30 — Inverse Problems in Biology 05:31 — Lessons from DeepMind, Industry and Academia 07:35 — Why Protein Dynamics Remain Unsolved 08:29 — Collaborating with Experimental Scientists 09:28 — What’s Overhyped and Underhyped in AI-Driven Biology 10:51 — The Future of AI-Driven Biology

Y Combinator

13,953 views • 5 months ago

Alexandr Wang (Alexandr Wang) started Scale AI to help machine learning teams label data faster. It started as a simple API for human labor, but behind the scenes, he was tackling a much bigger problem: how to turn messy, real-world data into something AI could learn from. Today, that early idea powers a multi-hundred-million-dollar engine behind America's AI infrastructure—fueling everything from Fortune 500 workflows to real-time military planning. Just last week, Meta agreed to invest over $14 billion in Scale, valuing the company at $29 billion. Alexandr joined us on Lightcone Podcast to share how Scale evolved from a scrappy YC startup into the backbone of some of the world's most advanced AI systems, how he thinks about competition with Chinese AI labs, and what it takes to build infrastructure that shapes the frontier. 01:15 - Alexandr’s early days at YC 07:25 - Dialing in on what worked 10:24 - Model improvements, evals 19:18 - The techno-optimist view of work 27:47 - The turning points for Scale AI 37:37 - Agentic workflows 41:55 - “Humanity’s Last Exam” 47:48 - U.S. vs China in AI and hard tech 56:57 - How to be hardcore
1:01:12

Alexandr Wang (Alexandr Wang) started Scale AI to help machine learning teams label data faster. It started as a simple API for human labor, but behind the scenes, he was tackling a much bigger problem: how to turn messy, real-world data into something AI could learn from. Today, that early idea powers a multi-hundred-million-dollar engine behind America's AI infrastructure—fueling everything from Fortune 500 workflows to real-time military planning. Just last week, Meta agreed to invest over $14 billion in Scale, valuing the company at $29 billion. Alexandr joined us on Lightcone Podcast to share how Scale evolved from a scrappy YC startup into the backbone of some of the world's most advanced AI systems, how he thinks about competition with Chinese AI labs, and what it takes to build infrastructure that shapes the frontier. 01:15 - Alexandr’s early days at YC 07:25 - Dialing in on what worked 10:24 - Model improvements, evals 19:18 - The techno-optimist view of work 27:47 - The turning points for Scale AI 37:37 - Agentic workflows 41:55 - “Humanity’s Last Exam” 47:48 - U.S. vs China in AI and hard tech 56:57 - How to be hardcore

Y Combinator

396,950 views • 1 year ago

Full footage from our systems x biology reading group with researchers from Arc Institute + FutureHouse. 2:33 LData: Building a distributed filesystem on Postgres and S3 (LatchBio) 26:10 BINSEQ: High-performance binary formats for DNA sequences (Noam Teyssier, Arc Institute) 49:00 Data Flywheels: Reinforcement learning algorithms for scientific AI (James Braza, FutureHouse) 1:08:07 Scaling Deep Learning to 1B+ Single Cells (Abhinav Adduri, Arc Institute) 1:36:30 Shreya Shekha, Greylock; Closing Biology is still a greenfield space for systems work. As molecular datasets continue to scale, engineering challenges will emerge at every layer of the stack, eg. file systems, storage + ML infra.
1:38:42

Full footage from our systems x biology reading group with researchers from Arc Institute + FutureHouse. 2:33 LData: Building a distributed filesystem on Postgres and S3 (LatchBio) 26:10 BINSEQ: High-performance binary formats for DNA sequences (Noam Teyssier, Arc Institute) 49:00 Data Flywheels: Reinforcement learning algorithms for scientific AI (James Braza, FutureHouse) 1:08:07 Scaling Deep Learning to 1B+ Single Cells (Abhinav Adduri, Arc Institute) 1:36:30 Shreya Shekha, Greylock; Closing Biology is still a greenfield space for systems work. As molecular datasets continue to scale, engineering challenges will emerge at every layer of the stack, eg. file systems, storage + ML infra.

Kenny Workman

27,575 views • 5 months ago

[1/16] The real world is large, and we want our AI models to operate on the scale of reality. Over the past two years, my colleagues and I have developed fVDB, a deep learning framework for large-scale, high performance spatial intelligence. We finally announced this work at SIGGRAPH and have released the framework in early access. Here’s a small tour of what fVDB is, and what we’ve used it to do.
3:19

[1/16] The real world is large, and we want our AI models to operate on the scale of reality. Over the past two years, my colleagues and I have developed fVDB, a deep learning framework for large-scale, high performance spatial intelligence. We finally announced this work at SIGGRAPH and have released the framework in early access. Here’s a small tour of what fVDB is, and what we’ve used it to do.

Francis Williams

33,898 views • 1 year ago

We all like to think we’re too smart to be brainwashed, but mind control isn’t about being 'weak'; it’s about how our biology is being hacked. I sat down with Steven Hassan to discuss how these systems actually work and why nobody is truly immune. Check out the full conversation on the WhatNow Podcast.
1:30

We all like to think we’re too smart to be brainwashed, but mind control isn’t about being 'weak'; it’s about how our biology is being hacked. I sat down with Steven Hassan to discuss how these systems actually work and why nobody is truly immune. Check out the full conversation on the WhatNow Podcast.

Trevor Noah

28,051 views • 3 months ago

Denis Noble: "I think it's been unfortunate that philosophy and science have diverged." Why reductionist analysis in biology is a philosophical mistake: Michael Levin to Denis Noble: What have you learned from eastern philosophy that has informed your interest in biology? Denis Noble: There is no philosophical basis for saying that the only way to look at living organisms is through reductionist analysis. It is also a philosophical point that you cannot have living organisms without levels of interactions. (paraphrased snippets) More in the clip. Link to full podcast below on What Biology Needs to Advance Longevity.
3:20

Denis Noble: "I think it's been unfortunate that philosophy and science have diverged." Why reductionist analysis in biology is a philosophical mistake: Michael Levin to Denis Noble: What have you learned from eastern philosophy that has informed your interest in biology? Denis Noble: There is no philosophical basis for saying that the only way to look at living organisms is through reductionist analysis. It is also a philosophical point that you cannot have living organisms without levels of interactions. (paraphrased snippets) More in the clip. Link to full podcast below on What Biology Needs to Advance Longevity.

Aastha JS

34,047 views • 1 year ago

What could scaling unlock for biology? Introducing ProGen3- our next AI foundation models for protein generation. We develop compute-optimal scaling laws up to 46B parameters on 1.5T tokens with real evidence in the wet lab. +we solve a new set of challenges for drug discovery
2:36

What could scaling unlock for biology? Introducing ProGen3- our next AI foundation models for protein generation. We develop compute-optimal scaling laws up to 46B parameters on 1.5T tokens with real evidence in the wet lab. +we solve a new set of challenges for drug discovery

Ali Madani

80,642 views • 1 year ago

capability != learning new benchtalks with Parth Asawa on continual learning, where we discuss teaching models to learn from experience, measuring learning ability, the bet on parametric models, and more 01:06 What is continual learning? 04:10 Why capability and learning are different 06:13 Why build a benchmark? 08:07 Continual Learning Bench launch and reception 09:13 Anthropic's Fable release and Continual Learning Bench 11:02 How to design tasks for continual learning 18:41 The gain metric 24:01 What good looks like on the leaderboard 29:13 Failure modes: why models can't update their beliefs 31:12 Parametric systems and future architectures 34:30 Open science and AI safety 45:42 Lightning round 49:08 How to contribute to Continual Learning Bench
50:35

capability != learning new benchtalks with Parth Asawa on continual learning, where we discuss teaching models to learn from experience, measuring learning ability, the bet on parametric models, and more 01:06 What is continual learning? 04:10 Why capability and learning are different 06:13 Why build a benchmark? 08:07 Continual Learning Bench launch and reception 09:13 Anthropic's Fable release and Continual Learning Bench 11:02 How to design tasks for continual learning 18:41 The gain metric 24:01 What good looks like on the leaderboard 29:13 Failure modes: why models can't update their beliefs 31:12 Parametric systems and future architectures 34:30 Open science and AI safety 45:42 Lightning round 49:08 How to contribute to Continual Learning Bench

vincent sunn chen

39,598 views • 18 days ago

“ My body parts are no longer female because my biology changed after taking testosterone” WHaT! You are so fake and gross! What you are saying is so insanely transphobic! You will actual hurt so many trans men by implying that our biology and our body parts change after one year of testosterone! You are so dangerous. I am thirty one years on T and I had vaginal atrophy almost take me out! If the doctor did not understand that I am a biological female with a uterus then they would have never been able to save me! I am so pissed after all the work we have done to educate our doctors about our bodies and understanding how biology matters, some young “ trans man” is going to completely destroy everything we have built to have healthy lives. Denying your biology is actually anti-trans on so many levels! Now you see why many of us are pushing back on this insane ideology 😡🤡 #transsexual #biology #female #male #transition #testosterone #mentalhealth #medical #truth #honesty
1:27

“ My body parts are no longer female because my biology changed after taking testosterone” WHaT! You are so fake and gross! What you are saying is so insanely transphobic! You will actual hurt so many trans men by implying that our biology and our body parts change after one year of testosterone! You are so dangerous. I am thirty one years on T and I had vaginal atrophy almost take me out! If the doctor did not understand that I am a biological female with a uterus then they would have never been able to save me! I am so pissed after all the work we have done to educate our doctors about our bodies and understanding how biology matters, some young “ trans man” is going to completely destroy everything we have built to have healthy lives. Denying your biology is actually anti-trans on so many levels! Now you see why many of us are pushing back on this insane ideology 😡🤡 #transsexual #biology #female #male #transition #testosterone #mentalhealth #medical #truth #honesty

Buck Angel Transsexual

38,994 views • 2 years ago

AI has solved software. Biology is the next frontier. We're hiring across every team at Adaptyv. We’ve built the best automated lab for protein designers to experimentally test their AI-designed proteins. Today, the most advanced protein design companies run their wet-lab work on Adaptyv, from the biggest biopharmas to frontier AI labs to dozens of virtual biotech startups. Demand has grown faster than we have, so we’re hiring across the board: • Bio: Research associates, scientists and lab technicians to develop and run new assays at scale. • Lab automation: Engineers and interns to onboard new lab instruments and scale our automation infrastructure. • Software: Product and backend engineers to scale LabOS, our internal lab orchestration platform, our API for agents and the data pipelines that turn messy physical-world data into clean results. • Partnerships, customer success and operations: Building partnerships with AI & pharma labs, making sure customers understand their data and can run more campaigns, making sure the company operations run smoothly
0:30

AI has solved software. Biology is the next frontier. We're hiring across every team at Adaptyv. We’ve built the best automated lab for protein designers to experimentally test their AI-designed proteins. Today, the most advanced protein design companies run their wet-lab work on Adaptyv, from the biggest biopharmas to frontier AI labs to dozens of virtual biotech startups. Demand has grown faster than we have, so we’re hiring across the board: • Bio: Research associates, scientists and lab technicians to develop and run new assays at scale. • Lab automation: Engineers and interns to onboard new lab instruments and scale our automation infrastructure. • Software: Product and backend engineers to scale LabOS, our internal lab orchestration platform, our API for agents and the data pipelines that turn messy physical-world data into clean results. • Partnerships, customer success and operations: Building partnerships with AI & pharma labs, making sure customers understand their data and can run more campaigns, making sure the company operations run smoothly

Adaptyv Bio

13,446 views • 1 month ago

"We have this long term vision of turning biology from something which is trial and error and experimental and make it something that looks more like an engineering discipline in the next century." New Episode with Jack Dent ! 0:00 Intro 02:28 Inside Stripe w/ Patrick Collison, at <100 People 08:45 Sam Altman role in Chai Discovery origin 16:20 Chai-2 Antibody Breakthrough 19:24 Approaching biology as an engineering problem 24:45 Using AI models to treat people on an individual scale 26:52 Robotics in labs 27:22 Pharma industry today 29:49 The clinical trial bottleneck 32:53 Personalized biology models & cancer vaccines 36:24 Longevity, peptides, and trillion-dollar drugs 39:02 Does it matter that the government cut exploratory science grants? 41:00 What next-gen Chai models will do 42:08 Can frontier AI labs build this themselves? 43:26 Biology is hard
46:45

"We have this long term vision of turning biology from something which is trial and error and experimental and make it something that looks more like an engineering discipline in the next century." New Episode with Jack Dent ! 0:00 Intro 02:28 Inside Stripe w/ Patrick Collison, at <100 People 08:45 Sam Altman role in Chai Discovery origin 16:20 Chai-2 Antibody Breakthrough 19:24 Approaching biology as an engineering problem 24:45 Using AI models to treat people on an individual scale 26:52 Robotics in labs 27:22 Pharma industry today 29:49 The clinical trial bottleneck 32:53 Personalized biology models & cancer vaccines 36:24 Longevity, peptides, and trillion-dollar drugs 39:02 Does it matter that the government cut exploratory science grants? 41:00 What next-gen Chai models will do 42:08 Can frontier AI labs build this themselves? 43:26 Biology is hard

Sabrina Halper

38,182 views • 1 month ago

Andon Labs' Real-World AI Evals: Claude calls the FBI, AI CEOs, price cartels, Butter-Bench, & Luna Andon Labs cofounders Lukas Petersson and Axel Backlund explain why dollar-denominated evals reveal what traditional benchmarks miss, how Claude ended up reporting a $2/day vending machine fee to the FBI, why long-horizon agents spiral in weird ways, what happens when agents lie, form price cartels, and compete with each other, and why the future of AI safety may depend on testing models in messy real-world environments instead of clean benchmark sandboxes.
0:23

Andon Labs' Real-World AI Evals: Claude calls the FBI, AI CEOs, price cartels, Butter-Bench, & Luna Andon Labs cofounders Lukas Petersson and Axel Backlund explain why dollar-denominated evals reveal what traditional benchmarks miss, how Claude ended up reporting a $2/day vending machine fee to the FBI, why long-horizon agents spiral in weird ways, what happens when agents lie, form price cartels, and compete with each other, and why the future of AI safety may depend on testing models in messy real-world environments instead of clean benchmark sandboxes.

Latent.Space

13,294 views • 1 month ago

🔥In Magma, we talked a lot about spatial/temporal intelligence beyond verbal intelligencen as advocated by Dr. Fei-Fei Li. So how to interpret it? Today I am happy to announce a new demo Magma-Gaming: 👉 Rather than asking LLMs to write game code, we further ask the model to PLAY the game. A simple game like moving to the target in a 2D grid still requires precise action grounding and planning capability, yet challenges the most advanced VLMs and even GPT-4o-mini model. Magma, born with stronger spatial understanding and reasoning ability, significantly outperforms the counterparts and achieves much higher scores in zero-shot manner. This result pinpoints the huge potential of building multimodal agentic models endowed with both verbal and spatial inteligence! Also, I believe this simple demo gives you a better hints to understand what is spatial intelligence, and why it is important!
1:05

🔥In Magma, we talked a lot about spatial/temporal intelligence beyond verbal intelligencen as advocated by Dr. Fei-Fei Li. So how to interpret it? Today I am happy to announce a new demo Magma-Gaming: 👉 Rather than asking LLMs to write game code, we further ask the model to PLAY the game. A simple game like moving to the target in a 2D grid still requires precise action grounding and planning capability, yet challenges the most advanced VLMs and even GPT-4o-mini model. Magma, born with stronger spatial understanding and reasoning ability, significantly outperforms the counterparts and achieves much higher scores in zero-shot manner. This result pinpoints the huge potential of building multimodal agentic models endowed with both verbal and spatial inteligence! Also, I believe this simple demo gives you a better hints to understand what is spatial intelligence, and why it is important!

Jianwei Yang

17,940 views • 1 year ago

🚀 We are hiring! 𝗣𝗵𝗗 𝗦𝘁𝘂𝗱𝗲𝗻𝘁 𝗶𝗻 𝗖𝗔𝗥-𝗧 𝗖𝗲𝗹𝗹𝘂𝗹𝗮𝗿 𝗧𝗵𝗲𝗿𝗮𝗽𝘆 𝗮𝗻𝗱 𝗖𝗮𝗻𝗰𝗲𝗿 𝗡𝗲𝘂𝗿𝗼𝗶𝗺𝗺𝘂𝗻𝗼𝗹𝗼𝗴𝘆 We are looking for a passionate and motivated PhD student to join an exciting project focused on how nerve, immune and cancer cell interactions shape metastatic tumor behavior and resistance to cellular therapies, especially CAR-T cells. The project combines: • Whole-body tissue clearing • Light-sheet microscopy • wildDISCO-based immunolabeling • CAR-T and immune cell tracking in metastatic cancer • Spatial proteomics and 3D spatial biology • AI-based analysis of large-scale imaging datasets This is a great opportunity for someone with a background in cancer biology, immunology, neuroscience, biomedical sciences, biomedical engineering or a related field who wants to work at the interface of experimental biology, advanced imaging and AI. Apply here: Please share with excellent candidates who may be interested. #Hiring #PhDPosition #CARTcells #CellularTherapy #CancerResearch #Neuroimmunology #Immunotherapy #Metastasis #SpatialBiology #AIinBiology #Microscopy #LMUMunich #HelmholtzMunich #ErturkLab
0:49

🚀 We are hiring! 𝗣𝗵𝗗 𝗦𝘁𝘂𝗱𝗲𝗻𝘁 𝗶𝗻 𝗖𝗔𝗥-𝗧 𝗖𝗲𝗹𝗹𝘂𝗹𝗮𝗿 𝗧𝗵𝗲𝗿𝗮𝗽𝘆 𝗮𝗻𝗱 𝗖𝗮𝗻𝗰𝗲𝗿 𝗡𝗲𝘂𝗿𝗼𝗶𝗺𝗺𝘂𝗻𝗼𝗹𝗼𝗴𝘆 We are looking for a passionate and motivated PhD student to join an exciting project focused on how nerve, immune and cancer cell interactions shape metastatic tumor behavior and resistance to cellular therapies, especially CAR-T cells. The project combines: • Whole-body tissue clearing • Light-sheet microscopy • wildDISCO-based immunolabeling • CAR-T and immune cell tracking in metastatic cancer • Spatial proteomics and 3D spatial biology • AI-based analysis of large-scale imaging datasets This is a great opportunity for someone with a background in cancer biology, immunology, neuroscience, biomedical sciences, biomedical engineering or a related field who wants to work at the interface of experimental biology, advanced imaging and AI. Apply here: Please share with excellent candidates who may be interested. #Hiring #PhDPosition #CARTcells #CellularTherapy #CancerResearch #Neuroimmunology #Immunotherapy #Metastasis #SpatialBiology #AIinBiology #Microscopy #LMUMunich #HelmholtzMunich #ErturkLab

Ali Max Erturk

14,750 views • 2 months ago

Agents are finally starting to work in biology. We’ve partnered with Anthropic and major biotech vendors - Vizgen, AtlasXOmics, Takara, 10x Genomics - to build a tool that allows scientists to steer their own analysis with natural language. Raw spatial data to publication quality figures. Our team believes this will soon be the standard way biologists interact with data. Spatial biology agents look a bit different from coding products: - tailored to the molecular details of each kit type - run in sandboxes on very large machines - orchestrate data infra, eg. bioinformatics workflows, with tool calls - build graphical analysis notebooks to communicate results Detailed breakdown of engineering decisions, product philosophy and concrete flows follows:
1:27

Agents are finally starting to work in biology. We’ve partnered with Anthropic and major biotech vendors - Vizgen, AtlasXOmics, Takara, 10x Genomics - to build a tool that allows scientists to steer their own analysis with natural language. Raw spatial data to publication quality figures. Our team believes this will soon be the standard way biologists interact with data. Spatial biology agents look a bit different from coding products: - tailored to the molecular details of each kit type - run in sandboxes on very large machines - orchestrate data infra, eg. bioinformatics workflows, with tool calls - build graphical analysis notebooks to communicate results Detailed breakdown of engineering decisions, product philosophy and concrete flows follows:

Kenny Workman

114,098 views • 8 months ago

From Solana to institutional asset managers like WisdomTree and Apollo Global Management, Inc., Plume is focused on making RWAs work onchain. Our CBO Teddy explains how infrastructure, distribution, and DeFi come together to support RWAs at scale on @FintechTvGlobal
8:40

From Solana to institutional asset managers like WisdomTree and Apollo Global Management, Inc., Plume is focused on making RWAs work onchain. Our CBO Teddy explains how infrastructure, distribution, and DeFi come together to support RWAs at scale on @FintechTvGlobal

Plume

17,082 views • 5 months ago