Loading video...

Video Failed to Load

Go Home

Robotics models often struggle outside controlled environments. Ours is built to work in real ones. Today we're launching MolmoAct 2, which can assist with a host of chores & lab tasks, plus the MolmoAct 2-Bimanual YAM dataset—the largest open robotics dataset of its kind. 🧵

416,222 views • 5 months ago •via X (Twitter)

20 Comments

Ai2's profile picture
Ai25 months ago

MolmoAct 2 builds on MolmoAct, our first Action Reasoning Model (ARM). Like its predecessor, MolmoAct 2 reasons about the world in 3D before taking actions. It now runs up to 37x faster & handles two-armed tasks out of the box without per-task fine-tuning.

Ai2's profile picture
Ai25 months ago

MolmoAct 2 is easier to guide in real-world settings. Prompt it in natural language, and it responds well to different phrasings thanks to language re-annotation across the robotics training data. MolmoAct 2-Think goes further with adaptive depth perception tokens for stronger spatial reasoning. 👇

Ai2's profile picture
Ai25 months ago

Some of MolmoAct 2’s gains come from an adapter linking the VLM & action expert. It’s built on Molmo 2-ER, an embodied-reasoning Molmo 2 variant trained on millions of examples in detection, spatial reasoning, & more. Molmo 2-ER beats GPT-5 on embodied-reasoning benchmarks.

Ai2's profile picture
Ai25 months ago

We're already testing MolmoAct 2 outside controlled setups. We've deployed it in our office café to make popcorn & drinks, even as people move around it. It handles practical tasks like wiping surfaces, lifting trays, & folding towels.

Ai2's profile picture
Ai25 months ago

We've also piloted MolmoAct 2 with research partners including a Stanford Medicine team using it for hands-on tasks in CRISPR gene-editing work. The model moves samples, uses lab equipment, & recovers from small mistakes during long experiments.

Ai2's profile picture
Ai25 months ago

In real-world zero-shot tests on a Franka robot, MolmoAct 2 outperforms strong proprietary models on every task we evaluated, including placing an apple on a plate, moving a pipette to a tray, and a longer multi-step task with several objects.

Ai2's profile picture
Ai25 months ago

MolmoAct 2 also sets a new state of the art on LIBERO, a standard benchmark that tests how well robots learn manipulation tasks across varied scenes & objects—improving meaningfully over the original MolmoAct.

Ai2's profile picture
Ai25 months ago

We retained @cortexairobot to run a third-party real-world fine-tuning benchmark. Across trials on a broad suite of tabletop, in-the-wild, and mobile tasks, MolmoAct 2 outperformed systems including OpenVLA-OFT, π0.5, X-VLA, & Cosmos Policy.

Ai2's profile picture
Ai25 months ago

To lower the barrier to getting started, we're sharing an affordable reference hardware setup: two YAM arms, overhead & close-up cameras, an extendable mount, and a tabletop workspace for bimanual manipulation.

Ai2's profile picture
Ai25 months ago

Robotics models are often closed. MolmoAct 2 isn't. We're releasing model weights, an updated VLA architecture, a fully open action tokenizer, & the MolmoAct 2-Bimanual YAM dataset—700+ hours of tabletop manipulation demonstrations.

Ai2's profile picture
Ai25 months ago

MolmoAct 2 is a foundation built for others to study, deploy, & customize. 📝 Learn more in our blog: 🤖 Models: 📊 Training dataset:

Ted Xiao's profile picture
Ted Xiao4 months ago

Nice work @hq_fang @DJiafei, very strong control and ER results!

Ritvik Singh's profile picture
Ritvik Singh4 months ago

Cool work, I was curious in Section 6.8, the reported inference speeds are "amortized"? Afaict, the whole chunk is generated together so even though it is reported to generate actions at 55.79Hz (17.92ms), the VLA can only generate actions at 179.2ms? Or am I missing something?

PublicAI's profile picture
PublicAI4 months ago

Allen AI dropped Molmo Act 2 cooking in real cafés with zero drama?! This is the most hyped I’ve been about robotics all year, who’s ready for robots that actually pull up and deliver?! 🔥

Trevor Sullivan's profile picture
Trevor Sullivan4 months ago

Super awesome research!!! Love it

Tanay's profile picture
Tanay4 months ago

This sounds interesting! Where can I read in depth how it works?

Ai2's profile picture
Ai24 months ago

Check out our blog!

Tanay's profile picture
Tanay4 months ago

Great to see this from a non-profit organisation! You released datasets & weights that no other company did. The one thing unique thing about this is - your models predicts in 3D depth Spatial even before acting while other models do in 2D. Really excited to try it on my LeRobot arm. #Ai2 #Robotic #PhysicalAI

Davis Aji's profile picture
Davis Aji4 months ago

Dunia sudah tergantikan

Om Kulkarni's profile picture
Om Kulkarni4 months ago

Finally, a dataset large enough to prove that my robot's bimanual coordination is still just two arms having a very expensive disagreement over a laundry basket. Huge win for the open-stack ecosystem!

Related Videos

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

40,583 views • 5 months ago