Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

32,000+ hours of open robot data 🤖 ANYONE can get started training their own robotics models!

Vai Viswanathan

1,974 subscribers

14,193 views • 3 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

9 Comments

Vai Viswanathan3 months ago

check it out here at

Jiafei Duan3 months ago

Cool stuff!

Vai Viswanathan3 months ago

Thanks!

Pushkar3 months ago

Insane man would love to give a try along with our datasets

Vai Viswanathan3 months ago

Feel free to submit datasets if you have any!

Vedant2 months ago

This is amazing

Dhruva3 months ago

neat!

Dima3 months ago

Who built this

Vai Viswanathan3 months ago

Me

Related Videos

We have nearly 40,000 hours of open robotics data on Check it out and train your own robotics policy or world model

We have nearly 40,000 hours of open robotics data on Check it out and train your own robotics policy or world model

Vai Viswanathan

32,320 views • 2 months ago

Xiaomi Robotics-1 🤖a new robot foundation model from Xiaomi Tech - 100K+ hours real world robot data - VLA architecture - Cross-embodiment generalization - Fast adaptation to new tasks

Xiaomi Robotics-1 🤖a new robot foundation model from Xiaomi Tech - 100K+ hours real world robot data - VLA architecture - Cross-embodiment generalization - Fast adaptation to new tasks

Adina Yakup

17,380 views • 2 months ago

Can robot foundation models scale? Xiaomi-Robotics-1 explores this question with over 100,000 hours of real-world manipulation data. Pre-trained on large-scale real-world trajectories and post-trained with cross-embodiment robot data, Xiaomi-Robotics-1 demonstrates consistent scaling across data and model size, strong generalization in unseen environments, and efficient adaptation to new tasks. 🔗 #Robotics #EmbodiedAI #FoundationModels #RobotLearning #XiaomiAI #XiaomiRobotics

Can robot foundation models scale? Xiaomi-Robotics-1 explores this question with over 100,000 hours of real-world manipulation data. Pre-trained on large-scale real-world trajectories and post-trained with cross-embodiment robot data, Xiaomi-Robotics-1 demonstrates consistent scaling across data and model size, strong generalization in unseen environments, and efficient adaptation to new tasks. 🔗 #Robotics #EmbodiedAI #FoundationModels #RobotLearning #XiaomiAI #XiaomiRobotics

Xiaomi Tech

23,600 views • 2 months ago

Training robot foundation models faces two key hurdles: how to get enough data to train an effective model, and how to make sure that new skills can be acquired quickly. The team at Rhoda AI believes that the answer is training Direct Video Action models from web data. Web data is plentiful, to the point where Rhoda can train their base model on hundreds of years of video data. And then, with the addition of robot data, they can quickly adapt it to new tasks with as little as 20 hours of in-domain data, performing complex, multi-step manipulation tasks with their purpose-built video foundation model. Tongzhou Mu 🤖🦾🦿 Eric Chan and Changan Chen joined us to talk more about their approach. Watch Episode #79 of RoboPapers, with Michael Cho - Rbt/Acc, Chris Paxton, and Jiafei Duan, to learn more!

Training robot foundation models faces two key hurdles: how to get enough data to train an effective model, and how to make sure that new skills can be acquired quickly. The team at Rhoda AI believes that the answer is training Direct Video Action models from web data. Web data is plentiful, to the point where Rhoda can train their base model on hundreds of years of video data. And then, with the addition of robot data, they can quickly adapt it to new tasks with as little as 20 hours of in-domain data, performing complex, multi-step manipulation tasks with their purpose-built video foundation model. Tongzhou Mu 🤖🦾🦿 Eric Chan and Changan Chen joined us to talk more about their approach. Watch Episode #79 of RoboPapers, with Michael Cho - Rbt/Acc, Chris Paxton, and Jiafei Duan, to learn more!

RoboPapers

24,728 views • 5 months ago

Jason Ma reveals the first true scaling law in robotics: robots trained on 1 million hours of first-person human video predictably get better without ever seeing robot data "Yesterday we announced our new flagship robot foundation model called Dyna-2. It's very significant for the entire field for many different reasons. First of all, it's the first robot foundation model trained on at least one million hours of data. That in itself is a very challenging infrastructure challenge." "What we demonstrated is that even if the one million hours of data is entirely first-person video of humans doing manipulation tasks, we actually see scaling law for transferring to robot embodiments that the model has never seen before." "By training on more human data, we actually see predictable performance improvement on robots. That's a big deal because the biggest challenge facing robot foundation models is that we don't have enough data." "Unlike language models, there are just not enough robotics data out there, and it's very difficult to collect these robot data. Only by passively observing humans doing things can we scale this kind of data, and this is the first time we showed there is a lot of improvement that can transfer." Jason Ma Dyna Robotics

Jason Ma reveals the first true scaling law in robotics: robots trained on 1 million hours of first-person human video predictably get better without ever seeing robot data "Yesterday we announced our new flagship robot foundation model called Dyna-2. It's very significant for the entire field for many different reasons. First of all, it's the first robot foundation model trained on at least one million hours of data. That in itself is a very challenging infrastructure challenge." "What we demonstrated is that even if the one million hours of data is entirely first-person video of humans doing manipulation tasks, we actually see scaling law for transferring to robot embodiments that the model has never seen before." "By training on more human data, we actually see predictable performance improvement on robots. That's a big deal because the biggest challenge facing robot foundation models is that we don't have enough data." "Unlike language models, there are just not enough robotics data out there, and it's very difficult to collect these robot data. Only by passively observing humans doing things can we scale this kind of data, and this is the first time we showed there is a lot of improvement that can transfer." Jason Ma Dyna Robotics

MTS

17,740 views • 1 month ago

.Sureform (YC X25) connects real-world workplaces with robotics labs to collect task-specific training data for robot foundation models. Congrats on the launch, Ananth Kashyap!

.Sureform (YC X25) connects real-world workplaces with robotics labs to collect task-specific training data for robot foundation models. Congrats on the launch, Ananth Kashyap!

Y Combinator

36,194 views • 7 months ago

The First 100 begins now. Verify Quality is live on PrismaX. For the first time, anyone can score the robot training data that models learn from, earn points, and compete to become one of The First 100. Better data. Better models. The standard starts with you.

The First 100 begins now. Verify Quality is live on PrismaX. For the first time, anyone can score the robot training data that models learn from, earn points, and compete to become one of The First 100. Better data. Better models. The standard starts with you.

PrismaX

232,859 views • 3 months ago

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

Jun Gao

105,082 views • 3 months ago

Today we’re launching Enact: post-training infrastructure that makes robotics models work in the real world. Robotics models fail when execution reaches states their training data never covered. A slip, an off-angle grasp, or an external disturbance can leave the policy without a learned recovery. Enact finds those failures and generates the targeted recovery data teams use to make their models reliable in production. Govind Chada Enact

Today we’re launching Enact: post-training infrastructure that makes robotics models work in the real world. Robotics models fail when execution reaches states their training data never covered. A slip, an off-angle grasp, or an external disturbance can leave the policy without a learned recovery. Enact finds those failures and generates the targeted recovery data teams use to make their models reliable in production. Govind Chada Enact

James Stevens

52,909 views • 1 month ago

꧁IP꧂ encompasses all data used to fuel AI models. On Story, anyone can register open source AI models, data sets, and fine tune their models. AI cannot exist without IP, and Story makes IP programmable.

꧁IP꧂ encompasses all data used to fuel AI models. On Story, anyone can register open source AI models, data sets, and fine tune their models. AI cannot exist without IP, and Story makes IP programmable.

The DATA Foundation

155,493 views • 1 year ago

Excitement about world-action models and robot learning has never been higher — they promise a way to use human egocentric data to train massive robotics models which can provide the “GPT” moment for robotics and unlock general-purpose embodied intelligence. And yet there’s been little concrete demonstration of scaling in robot learning. Dyna Robotics aims to change that, with an in-depth look at how scaling works as they approach 1 million hours of training data. Jason Ma Tianyu Li Anh-Quan Pham and Chet Bhateja joined us to tell us more. They show that as the amount of data they use in pretraining increased, they saw predictable, statistically significant gains on accuracy metrics on held-out data (data not seen during training). They go on to talk about what they learned, and show how this can be applied to many different problems. Watch Episode #99 of RoboPapers, with Michael Cho - Rbt/Acc Chris Paxton Jiafei Duan today to learn more!

Excitement about world-action models and robot learning has never been higher — they promise a way to use human egocentric data to train massive robotics models which can provide the “GPT” moment for robotics and unlock general-purpose embodied intelligence. And yet there’s been little concrete demonstration of scaling in robot learning. Dyna Robotics aims to change that, with an in-depth look at how scaling works as they approach 1 million hours of training data. Jason Ma Tianyu Li Anh-Quan Pham and Chet Bhateja joined us to tell us more. They show that as the amount of data they use in pretraining increased, they saw predictable, statistically significant gains on accuracy metrics on held-out data (data not seen during training). They go on to talk about what they learned, and show how this can be applied to many different problems. Watch Episode #99 of RoboPapers, with Michael Cho - Rbt/Acc Chris Paxton Jiafei Duan today to learn more!

RoboPapers

26,133 views • 1 month ago

Austin-based robotics startup Apptronik has unveiled Apollo 2, the latest version of its humanoid robot. Apollo 2 comes in both bipedal and wheeled versions and performs real-world tasks while collecting training data. Apptronik is using this data with Google DeepMind to train Gemini Robotics AI models, making Apollo smarter and more capable.

Austin-based robotics startup Apptronik has unveiled Apollo 2, the latest version of its humanoid robot. Apollo 2 comes in both bipedal and wheeled versions and performs real-world tasks while collecting training data. Apptronik is using this data with Google DeepMind to train Gemini Robotics AI models, making Apollo smarter and more capable.

Space and Technology

11,540 views • 2 months ago

Releasing the Unfolding Robotics blog! Time to unfold robotics: we trained a robot to fold clothes using 8 bimanual setups, 100+ hours of demonstrations, and 5k+ GPU hours. Flashy robot demos are everywhere. But you rarely see the real story: the data, the failures, the engineering. We’re sharing everything: code, data, and details in the blog →

Releasing the Unfolding Robotics blog! Time to unfold robotics: we trained a robot to fold clothes using 8 bimanual setups, 100+ hours of demonstrations, and 5k+ GPU hours. Flashy robot demos are everywhere. But you rarely see the real story: the data, the failures, the engineering. We’re sharing everything: code, data, and details in the blog →

LeRobot

283,064 views • 6 months ago

Argus: an open-source robotics data annotation and quality pipeline. With new frontier VLMs like GPT-6 Astra, we can generate rich, high-quality annotations for robotics data for both training and dataset analysis. Argus delivers detailed, timestamp-level annotations while catching issues like mislabeled instructions, sped-up recordings, swapped camera streams, and unflagged operator mistakes. To support better data quality for the robotics community, we’re open-sourcing Argus for anyone to use 🧵

Argus: an open-source robotics data annotation and quality pipeline. With new frontier VLMs like GPT-6 Astra, we can generate rich, high-quality annotations for robotics data for both training and dataset analysis. Argus delivers detailed, timestamp-level annotations while catching issues like mislabeled instructions, sped-up recordings, swapped camera streams, and unflagged operator mistakes. To support better data quality for the robotics community, we’re open-sourcing Argus for anyone to use 🧵

calix

77,603 views • 3 days ago

Training data collection is one of the biggest challenges in #Robotics. We're solving it with #NVIDIAIsaac GR00T-Dreams. By using #NVIDIACosmos world foundation models and generative AI, developers can create vast, realistic synthetic data at scale. Benefits: ✔️Cheaper & faster data collection ✔️Smarter robots in new environments ✔️ No more teleoperation bottlenecks ✔️ Small teams = massive impact Get Started 🔗 #GTCParis #VivaTech

Training data collection is one of the biggest challenges in #Robotics. We're solving it with #NVIDIAIsaac GR00T-Dreams. By using #NVIDIACosmos world foundation models and generative AI, developers can create vast, realistic synthetic data at scale. Benefits: ✔️Cheaper & faster data collection ✔️Smarter robots in new environments ✔️ No more teleoperation bottlenecks ✔️ Small teams = massive impact Get Started 🔗 #GTCParis #VivaTech

NVIDIA Robotics

17,040 views • 1 year ago

Co-training has become a key part of the recipe for training large robotics models; it means that you mix some proportion of real robot data with other data sources, like simulation or egocentric human video data. This is especially important because robotics data tends to lack diversity which can be somewhat compensated for by the inclusion of these other modalities. And yet there has not been a sizable study on what constitute good practices for cotraining until now! We talk to Fanqi Lin and Jose Barreiros about their new work, a massive study which evaluated 89 policies over thousands of rollouts to tell us which forms of co-training were most useful for robotics. Watch episode 70 of RoboPapers, with Michael Cho and Chris Paxton, now!

Co-training has become a key part of the recipe for training large robotics models; it means that you mix some proportion of real robot data with other data sources, like simulation or egocentric human video data. This is especially important because robotics data tends to lack diversity which can be somewhat compensated for by the inclusion of these other modalities. And yet there has not been a sizable study on what constitute good practices for cotraining until now! We talk to Fanqi Lin and Jose Barreiros about their new work, a massive study which evaluated 89 policies over thousands of rollouts to tell us which forms of co-training were most useful for robotics. Watch episode 70 of RoboPapers, with Michael Cho and Chris Paxton, now!

RoboPapers

19,357 views • 6 months ago

🤖 Robotics often faces a chicken and egg problem: no web-scale robot data for training (unlike CV or NLP) b/c robots aren't deployed yet & vice-versa. Introducing VRB: Use large-scale human videos to train a *general-purpose* affordance model to jumpstart any robotics paradigm!

🤖 Robotics often faces a chicken and egg problem: no web-scale robot data for training (unlike CV or NLP) b/c robots aren't deployed yet & vice-versa. Introducing VRB: Use large-scale human videos to train a general-purpose affordance model to jumpstart any robotics paradigm!

Deepak Pathak

70,743 views • 3 years ago

🚨Is it possible to devise an intuitive approach for crowdsourcing trainable data for robots without requiring a physical robot🤖? Can we democratize robot learning for all?🧑‍🤝‍🧑 Check out our latest #CoRL2023 paper-> AR2-D2: Training a Robot Without a Robot

🚨Is it possible to devise an intuitive approach for crowdsourcing trainable data for robots without requiring a physical robot🤖? Can we democratize robot learning for all?🧑‍🤝‍🧑 Check out our latest #CoRL2023 paper-> AR2-D2: Training a Robot Without a Robot

Jiafei Duan

38,926 views • 3 years ago

🤖WILD: This $399 robot duck is selling one unit every four seconds. Hugging Face just launched the "Microduck," an open-source robot anyone can teach new tricks. It can waddle, roller skate, pick things up with its beak, and get back up when it falls.

🤖WILD: This $399 robot duck is selling one unit every four seconds. Hugging Face just launched the "Microduck," an open-source robot anyone can teach new tricks. It can waddle, roller skate, pick things up with its beak, and get back up when it falls.

Coin Bureau

130,745 views • 1 month ago

Humanoid robot development is too fragmented to scale. 🤖 With NVIDIA Isaac GR00T, developers unify simulation, data, and training in one open platform, cutting setup time from days to hours. See how Isaac GR00T helps research teams move faster from robot bring-up to skill development and real-world validation. Watch now 📺

Humanoid robot development is too fragmented to scale. 🤖 With NVIDIA Isaac GR00T, developers unify simulation, data, and training in one open platform, cutting setup time from days to hours. See how Isaac GR00T helps research teams move faster from robot bring-up to skill development and real-world validation. Watch now 📺

NVIDIA Robotics

22,669 views • 3 months ago