Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Robotics models often struggle outside controlled environments. Ours is built to work in real ones. Today we're launching MolmoAct 2, which can assist with a host of chores & lab tasks, plus the MolmoAct 2-Bimanual YAM dataset—the largest open robotics dataset of its kind. 🧵

allen_ai's profile picture

Ai2

85,882 subscribers

406,047 görüntüleme • 3 ay önce •via X (Twitter)

Haberler & PolitikaEğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Very excited to release the Open X-Embodiment Dataset today — the largest robot dataset to date with 1M+ trajectories! Robotics needs more data & this is a big step! There’s lots to unpack here, so let’s do a deep dive into the dataset! 🧵1/15
0:36

Very excited to release the Open X-Embodiment Dataset today — the largest robot dataset to date with 1M+ trajectories! Robotics needs more data & this is a big step! There’s lots to unpack here, so let’s do a deep dive into the dataset! 🧵1/15

Karl Pertsch

111,131 görüntüleme • 2 yıl önce

MolmoAct 2 artifacts have been downloaded 400K+ times in under 1 month. Today we're opening up the full code & training data: everything you need to fine-tune or build on our fully open robotics foundation model. 🧵
0:24

MolmoAct 2 artifacts have been downloaded 400K+ times in under 1 month. Today we're opening up the full code & training data: everything you need to fine-tune or build on our fully open robotics foundation model. 🧵

Ai2

17,870 görüntüleme • 2 ay önce

Most capable generalist robotics models today are closed or at best, open weights. But robotics won’t reach its ChatGPT moment without real openness. That GPT moment was built on years of open tools and datasets such as Python, PyTorch, ImageNet and more, that let researchers inspect, reproduce, and build. Today, we’re introducing MolmoAct 2: a fully open-source action reasoning model for real-world robotics. We rethought and reshaped everything! 🧵👇
2:28

Most capable generalist robotics models today are closed or at best, open weights. But robotics won’t reach its ChatGPT moment without real openness. That GPT moment was built on years of open tools and datasets such as Python, PyTorch, ImageNet and more, that let researchers inspect, reproduce, and build. Today, we’re introducing MolmoAct 2: a fully open-source action reasoning model for real-world robotics. We rethought and reshaped everything! 🧵👇

Jiafei Duan

110,330 görüntüleme • 3 ay önce

This giant free dataset could make helper robots way smarter, way faster: An open-source robotics stack from Berkeley AI researchers featuring the largest teleoperation dataset released to date with over 3,500 hours of bimanual manipulation data across 200 tasks. The video showcases autonomous bimanual robot performance on dexterous tasks including box folding, Lego sorting, AirPod insertion, t-shirt folding, backpack packing, and box unlocking using learned policies. Sim-to-real correlations, training insights like flow loss predicting real-world success, lightweight infrastructure for DAgger interventions Thank you for sharing, Ritvik Singh, and everyone else who contributed to this! Links to the paper plus dataset at under permissive licensing. ——- Weekly robotics and AI insights. Subscribe free:
0:38

This giant free dataset could make helper robots way smarter, way faster: An open-source robotics stack from Berkeley AI researchers featuring the largest teleoperation dataset released to date with over 3,500 hours of bimanual manipulation data across 200 tasks. The video showcases autonomous bimanual robot performance on dexterous tasks including box folding, Lego sorting, AirPod insertion, t-shirt folding, backpack packing, and box unlocking using learned policies. Sim-to-real correlations, training insights like flow loss predicting real-world success, lightweight infrastructure for DAgger interventions Thank you for sharing, Ritvik Singh, and everyone else who contributed to this! Links to the paper plus dataset at under permissive licensing. ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

13,264 görüntüleme • 2 ay önce

Austin-based robotics startup Apptronik has unveiled Apollo 2, the latest version of its humanoid robot. Apollo 2 comes in both bipedal and wheeled versions and performs real-world tasks while collecting training data. Apptronik is using this data with Google DeepMind to train Gemini Robotics AI models, making Apollo smarter and more capable.
0:28

Austin-based robotics startup Apptronik has unveiled Apollo 2, the latest version of its humanoid robot. Apollo 2 comes in both bipedal and wheeled versions and performs real-world tasks while collecting training data. Apptronik is using this data with Google DeepMind to train Gemini Robotics AI models, making Apollo smarter and more capable.

Space and Technology

11,540 görüntüleme • 1 ay önce

Sundar Pichai on the robotics opportunity: ⦿ He's impressed by recent humanoid progress - so much so that he sometimes has to look closely to tell if a robot video is real or fake. ⦿ Google initially moved too early into the application layer, but now sees the combination of AI and robotics as the “sweet spot.” ⦿ He believes we’re 2–3 years away from a “magical moment” in robotics. ⦿ Google is working on playing a role similar to Android in robotics - one of its internal bets is already focused on supporting robotics manufacturers. ⦿ Gemini robotics models will work very well - how to productize them is still an open question at the company.
2:43

Sundar Pichai on the robotics opportunity: ⦿ He's impressed by recent humanoid progress - so much so that he sometimes has to look closely to tell if a robot video is real or fake. ⦿ Google initially moved too early into the application layer, but now sees the combination of AI and robotics as the “sweet spot.” ⦿ He believes we’re 2–3 years away from a “magical moment” in robotics. ⦿ Google is working on playing a role similar to Android in robotics - one of its internal bets is already focused on supporting robotics manufacturers. ⦿ Gemini robotics models will work very well - how to productize them is still an open question at the company.

The Humanoid Hub

87,088 görüntüleme • 1 yıl önce

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:26

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

40,583 görüntüleme • 4 ay önce

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).
1:05

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).

Ali Ansari

208,233 görüntüleme • 5 ay önce

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.
4:31

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

CyberRobo

17,092 görüntüleme • 2 ay önce

Weave Robotics has opened pre-orders for Isaac 1, a home robot built from the ground up in San Francisco. - A wheeled humanoid with a collapsible torso that extends to 5'9" then folds away when idle - Weave built its own actuators and safety systems Current chores: - Laundry pickup and folding - Tidying the rooms - 8 hours of battery, 2 hours to recharge Chores are done autonomously, but tele-operation assistance is available when needed to complete the tasks. Price: $8k upfront or $449/month subscription Deliveries begin for California residents in fall of 2026.
0:53

Weave Robotics has opened pre-orders for Isaac 1, a home robot built from the ground up in San Francisco. - A wheeled humanoid with a collapsible torso that extends to 5'9" then folds away when idle - Weave built its own actuators and safety systems Current chores: - Laundry pickup and folding - Tidying the rooms - 8 hours of battery, 2 hours to recharge Chores are done autonomously, but tele-operation assistance is available when needed to complete the tasks. Price: $8k upfront or $449/month subscription Deliveries begin for California residents in fall of 2026.

The Humanoid Hub

30,232 görüntüleme • 1 ay önce

AI + lab robotics will change experimental science. 1. Data (both positive and negative results) shared daily among a team of AI agents pursuing different hypothesis 2. Lab robotics running 24/7 with lab experiments written in code that are easily reproducible Human scientists can shepherd the whole process with regular readouts of progress (sort of like every scientists getting to operate as principle investigator) -- these are real advantages over how we do this work today. Enjoyed chatting about it with Pat Grady and Sonya Huang 🐥 at Sequoia Capital!
1:47

AI + lab robotics will change experimental science. 1. Data (both positive and negative results) shared daily among a team of AI agents pursuing different hypothesis 2. Lab robotics running 24/7 with lab experiments written in code that are easily reproducible Human scientists can shepherd the whole process with regular readouts of progress (sort of like every scientists getting to operate as principle investigator) -- these are real advantages over how we do this work today. Enjoyed chatting about it with Pat Grady and Sonya Huang 🐥 at Sequoia Capital!

Jason Kelly

22,629 görüntüleme • 4 ay önce

Something must change in robotics! 😖 As more billion-dollar players enter the space, more systems are closing off. APIs move behind paywalls, platforms lock down, and robots turn into black boxes. Pollen Robotics is taking the opposite route. With Reachy 2, everything is open: the code, the CAD files, the ROS 2 interfaces, the communication stack. If you want to swap the camera, redesign the gripper, or fork the whole system, you can, and that’s the point. It creates a culture where universities can run real experiments without licensing drama, and startups can prototype without waiting for vendor permission. Clone it on GitHub. Add behaviors. Share datasets. Fork the models. Push improvements upstream. The Hugging Face influence is real. It’s two open ecosystems aligning around the same idea: robotics should be built by more than a handful of companies. It was so cool to meet the team behind Reachy 2 in Bordeaux! 🔥 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:16

Something must change in robotics! 😖 As more billion-dollar players enter the space, more systems are closing off. APIs move behind paywalls, platforms lock down, and robots turn into black boxes. Pollen Robotics is taking the opposite route. With Reachy 2, everything is open: the code, the CAD files, the ROS 2 interfaces, the communication stack. If you want to swap the camera, redesign the gripper, or fork the whole system, you can, and that’s the point. It creates a culture where universities can run real experiments without licensing drama, and startups can prototype without waiting for vendor permission. Clone it on GitHub. Add behaviors. Share datasets. Fork the models. Push improvements upstream. The Hugging Face influence is real. It’s two open ecosystems aligning around the same idea: robotics should be built by more than a handful of companies. It was so cool to meet the team behind Reachy 2 in Bordeaux! 🔥 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

21,046 görüntüleme • 8 ay önce

Additionally, looking towards the future, we’re releasing PARTNR: a benchmark for Planning And Reasoning Tasks in humaN-Robot collaboration. Built on Habitat 3.0, it’s the largest benchmark of its kind to study and evaluate human-robot collaboration in household activities By providing a standardized benchmark and dataset we hope to enable new research on robots that can not only operate in isolation, but in collaboration with people. Details and code ➡️
1:01

Additionally, looking towards the future, we’re releasing PARTNR: a benchmark for Planning And Reasoning Tasks in humaN-Robot collaboration. Built on Habitat 3.0, it’s the largest benchmark of its kind to study and evaluate human-robot collaboration in household activities By providing a standardized benchmark and dataset we hope to enable new research on robots that can not only operate in isolation, but in collaboration with people. Details and code ➡️

AI at Meta

20,244 görüntüleme • 1 yıl önce

1/ New episode – Enabling AI Models to Drive Robots with Michael Cho - Rbt/Acc from BitRobot 🦾 Hosts: Connor Lovely 🎬 EV3 Sal We discuss: - Building the world's largest robotic driving dataset - Working with researchers from Google DeepMind - Launching a memecoin ($SAM) pre-TGE Timestamps: 00:00 - Introduction 01:47 - Intersection of Robotics and AI 02:50 - Real-World Evaluation vs. Digital AI 06:00 - The Importance of Real-World Testing 07:07 - Mapping and Navigation in Robotics 08:12 - Value of Real-World Data for AI 09:38 - Differences in Data Utility 13:07 - Exploring Different Robotic Form Factors 14:04 - Cross-Embodiment in Robotics 16:35 - Introduction to BitRobot 17:30 - Transition from Frotobots to BitRobot 22:05 - Future Plans for BitRobot 24:27 - Meme Coins in Community Building 27:46 - Conclusion Watch on all platforms below ⬇️
29:16

1/ New episode – Enabling AI Models to Drive Robots with Michael Cho - Rbt/Acc from BitRobot 🦾 Hosts: Connor Lovely 🎬 EV3 Sal We discuss: - Building the world's largest robotic driving dataset - Working with researchers from Google DeepMind - Launching a memecoin ($SAM) pre-TGE Timestamps: 00:00 - Introduction 01:47 - Intersection of Robotics and AI 02:50 - Real-World Evaluation vs. Digital AI 06:00 - The Importance of Real-World Testing 07:07 - Mapping and Navigation in Robotics 08:12 - Value of Real-World Data for AI 09:38 - Differences in Data Utility 13:07 - Exploring Different Robotic Form Factors 14:04 - Cross-Embodiment in Robotics 16:35 - Introduction to BitRobot 17:30 - Transition from Frotobots to BitRobot 22:05 - Future Plans for BitRobot 24:27 - Meme Coins in Community Building 27:46 - Conclusion Watch on all platforms below ⬇️

Proof of Coverage | Tech’s Creative Agency

10,748 görüntüleme • 1 yıl önce

Super excited to share the last paper of my PhD: "Hallucination in World Models is Predictable and Preventable"✨ We train a 350M-param generative world model on a large dataset w/ 210 tasks and show that we can predict *when* hallucination happens and use that to fix it! 🧵1/n
0:40

Super excited to share the last paper of my PhD: "Hallucination in World Models is Predictable and Preventable"✨ We train a 350M-param generative world model on a large dataset w/ 210 tasks and show that we can predict *when* hallucination happens and use that to fix it! 🧵1/n

Nicklas Hansen

56,641 görüntüleme • 1 ay önce

Gemini Robotics 2 by Google DeepMind uses sim-only post-training on a mixed-data base model to handle automotive kitting. Contact-rich tasks like these have long been considered one of the hardest challenges in Sim2Real. Gemini Robotics 2 shows simulation can work even here. General robot intelligence needs much more data than real-robot collection alone can provide. Simulation has proven to be an effective way to fill that gap.
2:31

Gemini Robotics 2 by Google DeepMind uses sim-only post-training on a mixed-data base model to handle automotive kitting. Contact-rich tasks like these have long been considered one of the hardest challenges in Sim2Real. Gemini Robotics 2 shows simulation can work even here. General robot intelligence needs much more data than real-robot collection alone can provide. Simulation has proven to be an effective way to fill that gap.

Axis Robotics

14,454 görüntüleme • 9 gün önce

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado
1:49

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado

a16z

74,828 görüntüleme • 24 gün önce

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.
0:33

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

AK

122,560 görüntüleme • 3 yıl önce

Announcing Axol: a dual-arm robot designed for teams working with physical AI. Made in America. Axol is for builders who believe robots should work, in the real world, not just staged environments, and that the future of physical AI should be open, not closed. #robotics #automation #ai #hardware
2:22

Announcing Axol: a dual-arm robot designed for teams working with physical AI. Made in America. Axol is for builders who believe robots should work, in the real world, not just staged environments, and that the future of physical AI should be open, not closed. #robotics #automation #ai #hardware

Almond Robotics

62,722 görüntüleme • 2 ay önce