Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Can robots self-improve by collecting data autonomously🤖? Introducing SOAR: a system for large-scale autonomous data collection 🚀 and autonomous improvement📈of a multi-task language-conditioned policy in diverse scenes without human interventions .

Paul Zhou

1,371 subscribers

47,667 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Tired of collecting demonstrations all day to train your robot? Introducing MimicGen, an autonomous data generation system for robotics. Using just 200 human demos we generated a large multi-task dataset of 50K demos! #CoRL2023 #NVIDIAResearch 👇 🧵 1/

Tired of collecting demonstrations all day to train your robot? Introducing MimicGen, an autonomous data generation system for robotics. Using just 200 human demos we generated a large multi-task dataset of 50K demos! #CoRL2023 #NVIDIAResearch 👇 🧵 1/

Ajay Mandlekar

93,632 views • 2 years ago

The most frustrating part of imitation learning is collecting huge amounts of teleop data. But why teleop robots when robots can learn by watching us? Introducing Point Policy, a novel framework that enables robots to learn from human videos without any teleop, sim2real, or RL.

The most frustrating part of imitation learning is collecting huge amounts of teleop data. But why teleop robots when robots can learn by watching us? Introducing Point Policy, a novel framework that enables robots to learn from human videos without any teleop, sim2real, or RL.

Siddhant Haldar

69,056 views • 1 year ago

Can we collect robot data without any robots? Introducing Universal Manipulation Interface (UMI) An open-source $400 system from Stanford University designed to democratize robot data collection 0 teleop -> autonomously wash dishes (precise), toss (dynamic), and fold clothes (bimanual)

Can we collect robot data without any robots? Introducing Universal Manipulation Interface (UMI) An open-source $400 system from Stanford University designed to democratize robot data collection 0 teleop -> autonomously wash dishes (precise), toss (dynamic), and fold clothes (bimanual)

Cheng Chi

438,741 views • 2 years ago

Autonomous robots doing chemputation is happening 24/7 in the Croninlab & at Chemify collecting data for next generation AI & ML.

Autonomous robots doing chemputation is happening 24/7 in the Croninlab & at Chemify collecting data for next generation AI & ML.

Prof. Lee Cronin

10,816 views • 6 months ago

Training fully autonomous robots takes more data than the real world can easily provide. Simulation lets us train, test, and deploy autonomous software without being limited by robots, space, or cost. Here’s OM1 running in simulation side-by-side to the real world.

Training fully autonomous robots takes more data than the real world can easily provide. Simulation lets us train, test, and deploy autonomous software without being limited by robots, space, or cost. Here’s OM1 running in simulation side-by-side to the real world.

OpenMind

120,963 views • 6 months ago

As robotics teams scale, collecting real-world data can quickly become slow and expensive. 📉 Lightwheel is changing that with a simulation-first platform built on our technology, helping customers generate a 100:1 simulated-to-real data ratio for training autonomous systems. Together, we’re turning synthetic and real data into more capable, more reliable robots. Read the full success story 🔗

As robotics teams scale, collecting real-world data can quickly become slow and expensive. 📉 Lightwheel is changing that with a simulation-first platform built on our technology, helping customers generate a 100:1 simulated-to-real data ratio for training autonomous systems. Together, we’re turning synthetic and real data into more capable, more reliable robots. Read the full success story 🔗

NVIDIA Robotics

10,840 views • 2 months ago

Excited to announce RoboCasa, a large-scale simulation framework of everyday tasks! We use generative AI tools to create diverse objects, scenes, and tasks. Simulation plays a pivotal role in our Data Pyramid for training generalist robots. Open-source at

Excited to announce RoboCasa, a large-scale simulation framework of everyday tasks! We use generative AI tools to create diverse objects, scenes, and tasks. Simulation plays a pivotal role in our Data Pyramid for training generalist robots. Open-source at

Yuke Zhu

141,486 views • 2 years ago

1/ We are speed running industrial robotics. It took us just 19 days from the first day of data collection to filming a 2.5-hour continuous run of our model autonomously breaking down industrial containers — zero human intervention. The data efficiency of our DVA model is fundamentally changing how fast we bring robots out of the lab and into the factory. Autonomous operation with 3 hours of data collection at a customer factory.

1/ We are speed running industrial robotics. It took us just 19 days from the first day of data collection to filming a 2.5-hour continuous run of our model autonomously breaking down industrial containers — zero human intervention. The data efficiency of our DVA model is fundamentally changing how fast we bring robots out of the lab and into the factory. Autonomous operation with 3 hours of data collection at a customer factory.

Rhoda AI

25,439 views • 3 months ago

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai

Galaxea Dynamics

21,113 views • 3 months ago

Can we get robots to improve at long-horizon tasks without supervision? Our latest work tackles this problem by planning to practice! Here's a teaser showing initial task -> autonomous practice -> eval (+ interference by a gremlin👿)

Can we get robots to improve at long-horizon tasks without supervision? Our latest work tackles this problem by planning to practice! Here's a teaser showing initial task -> autonomous practice -> eval (+ interference by a gremlin👿)

Nishanth Kumar

18,704 views • 2 years ago

Robotics needs data. OVER delivers it. Robots aren’t just machines anymore, they’re becoming autonomous agents. The secret? A new generation of Physical AI Models. And the fuel? A global dataset built for scale. Let’s dive in 👇🧵

Robotics needs data. OVER delivers it. Robots aren’t just machines anymore, they’re becoming autonomous agents. The secret? A new generation of Physical AI Models. And the fuel? A global dataset built for scale. Let’s dive in 👇🧵

Over the Reality 🌐

24,934 views • 9 months ago

Introducing: AutoFAB (Autonomous Factory-in-a-Box) World's First Self-Replicating Robotic Factory. Using Robots to Build Robots Faster & Cheaper. AutoFAB

Introducing: AutoFAB (Autonomous Factory-in-a-Box) World's First Self-Replicating Robotic Factory. Using Robots to Build Robots Faster & Cheaper. AutoFAB

Ansel Dias

11,934 views • 3 months ago

Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced

Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced

Chen Wang

234,854 views • 2 years ago

Physical Intelligence's π₀, a general-purpose robot foundation model that combines Internet-scale vision-language pretraining with robot interaction data to execute tasks. They aim "to develop foundation models that can control any robot to perform any task" Autonomous demos:

Physical Intelligence's π₀, a general-purpose robot foundation model that combines Internet-scale vision-language pretraining with robot interaction data to execute tasks. They aim "to develop foundation models that can control any robot to perform any task" Autonomous demos:

The Humanoid Hub

196,055 views • 1 year ago

Robots enter data centers! 💽 SeRo developed by NAVER LABS, is built for one of the most overlooked but critical tasks in a data center: managing servers in the IT warehouse. It can autonomously load and unload servers, identify their asset numbers, and log their lifecycle data. Physically, SeRo is designed tall to handle racks up to three meters high, maximizing storage density. SeRo also works as part of a larger system. It hands assets to GaRo, an autonomous transport robot, for seamless movement between warehouse and server room. More AI ops, more data centers, more data centers ops... Perfect market for robotics! 🦾

Robots enter data centers! 💽 SeRo developed by NAVER LABS, is built for one of the most overlooked but critical tasks in a data center: managing servers in the IT warehouse. It can autonomously load and unload servers, identify their asset numbers, and log their lifecycle data. Physically, SeRo is designed tall to handle racks up to three meters high, maximizing storage density. SeRo also works as part of a larger system. It hands assets to GaRo, an autonomous transport robot, for seamless movement between warehouse and server room. More AI ops, more data centers, more data centers ops... Perfect market for robotics! 🦾

Lukas Ziegler

30,311 views • 10 months ago

NVIDIA has open-sourced SONIC, a humanoid behavior foundation model that gives robots a core set of motor skills learned from large-scale human motion data.

NVIDIA has open-sourced SONIC, a humanoid behavior foundation model that gives robots a core set of motor skills learned from large-scale human motion data.

The Humanoid Hub

33,542 views • 4 months ago

With the recent progress in large-scale multi-task robot training, how can we advance the real-world deployment of multi-task robot fleets? Introducing Sirius-Fleet✨, a multi-task interactive robot fleet learning framework with 𝗩𝗶𝘀𝘂𝗮𝗹 𝗪𝗼𝗿𝗹𝗱 𝗠𝗼𝗱𝗲𝗹𝘀! 🌍 #CoRL2024

With the recent progress in large-scale multi-task robot training, how can we advance the real-world deployment of multi-task robot fleets? Introducing Sirius-Fleet✨, a multi-task interactive robot fleet learning framework with 𝗩𝗶𝘀𝘂𝗮𝗹 𝗪𝗼𝗿𝗹𝗱 𝗠𝗼𝗱𝗲𝗹𝘀! 🌍 #CoRL2024

Huihan Liu

28,040 views • 1 year ago

Introducing Agent Playground — A terminal for AI agents to create, transact, and analyze data onchain 🪄 ⭐ + Agent wallet + Natural language → onchain actions + Autonomous onchain operations + Real-time block analysis Try now:

Introducing Agent Playground — A terminal for AI agents to create, transact, and analyze data onchain 🪄 ⭐ + Agent wallet + Natural language → onchain actions + Autonomous onchain operations + Real-time block analysis Try now:

OnchainKit

85,660 views • 1 year ago

What if robots could improve themselves by learning from their own failures in the real-world? Introducing 𝗣𝗟𝗗 (𝗣𝗿𝗼𝗯𝗲, 𝗟𝗲𝗮𝗿𝗻, 𝗗𝗶𝘀𝘁𝗶𝗹𝗹) — a recipe that enables Vision-Language-Action (VLA) models to self-improve for high-precision manipulation tasks. PLD couples real-world residual reinforcement learning with standard supervised fine-tuning — letting robots discover, recover, and distill their own data flywheel. Quick 🧵

What if robots could improve themselves by learning from their own failures in the real-world? Introducing 𝗣𝗟𝗗 (𝗣𝗿𝗼𝗯𝗲, 𝗟𝗲𝗮𝗿𝗻, 𝗗𝗶𝘀𝘁𝗶𝗹𝗹) — a recipe that enables Vision-Language-Action (VLA) models to self-improve for high-precision manipulation tasks. PLD couples real-world residual reinforcement learning with standard supervised fine-tuning — letting robots discover, recover, and distill their own data flywheel. Quick 🧵

Wenli Xiao

184,912 views • 8 months ago

Robotics is still data starved. Collecting high-quality robot demonstrations remains brutally slow and expensive. Introducing COBALT: A cloud-native teleoperation platform designed for large-scale robot learning. We are democratizing data collection by leveraging the hardware everyone already owns: the smartphone All you need is to download an app (today)! Read on for more!

Robotics is still data starved. Collecting high-quality robot demonstrations remains brutally slow and expensive. Introducing COBALT: A cloud-native teleoperation platform designed for large-scale robot learning. We are democratizing data collection by leveraging the hardware everyone already owns: the smartphone All you need is to download an app (today)! Read on for more!

Animesh Garg

102,743 views • 1 month ago