Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Building robot intelligence requires high-quality robot data. But far too many tools to collect data are closed and custom-built. Open Teach is fully open-sourced and is: - Calibration-free - Supports multiple arms, hands, & mobile manipulators - Costs just $500

53,286 görüntüleme • 2 yıl önce •via X (Twitter)

10 Yorum

Lerrel Pinto profil fotoğrafı
Lerrel Pinto2 yıl önce

A few reasons why Open Teach works so well: 1. It is focused on low latency & high-frequency visual feedback. 2. Native passthrough from Quest 3 gives us exceptional visual clarity for 3D task perception. Here is a teleop of making a sandwich.

Lerrel Pinto profil fotoğrafı
Lerrel Pinto2 yıl önce

Open Teach is really versatile! We tried it on 38 tasks spanning 5 real robots and 2 simulated platforms!

Lerrel Pinto profil fotoğrafı
Lerrel Pinto2 yıl önce

And that's not all! Data from Open Teach is compatible with data-driven learning. On 10 tasks across platforms, we achieves a 87% success rate.

Lerrel Pinto profil fotoğrafı
Lerrel Pinto2 yıl önce

Open Teach is fully open sourced! Website: Paper: Code: By @AadhithyaIyer, Bobby Peng,  @wxdyl0915, @haldar_siddhant, @irmakkguzey, @soumithchintala

Tekmorrow profil fotoğrafı
Tekmorrow2 yıl önce

This is awesome. Congrats, and keep on pushing. I'm excited about the future of robots. This technology has so many use cases that will change our lives.

Weshawl profil fotoğrafı
Weshawl2 yıl önce

What happens when someone uses it to hurt other people? Will it be treated as an accident? Do we have any law that governs these types of cases?

Cryptonian profil fotoğrafı
Cryptonian2 yıl önce

What do you think of Figure 1, just released with openAI??

Sorun 🇰🇪🇨🇦 profil fotoğrafı
Sorun 🇰🇪🇨🇦2 yıl önce

@ylecun Moravec’s Paradox 😬 great work though

TheBlackHack profil fotoğrafı
TheBlackHack2 yıl önce

Does this use imitation learning? If I teach it to make a tuna sandwich in my mom's kitchen, can it then make a chicken sandwich in my dad's kitchen, or do I have to train it again for each sandwich, for each kitchen, etc?

Cristina Urdiales profil fotoğrafı
Cristina Urdiales2 yıl önce

@ylecun @Jesusgomez

Benzer Videolar

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

40,583 görüntüleme • 3 ay önce

Synthetic data will provide the next trillion tokens to fuel our hungry models. I'm excited to announce MimicGen: massively scaling up data pipeline for robot learning! We multiply high-quality human data in simulation with digital twins. Using 50,000 training episodes across 18 tasks, multiple simulators, and even in the real-world! The idea is simple: 1. Humans tele-operate the robot to complete a task. It is extremely high-quality but also very slow and expensive. 2. We create a digital twin of the robot and the scene in high-fidelity, GPU-accelerated simulation. 3. We can now move objects around, replace with new assets, and even change the robot hand - basically augment the training data with procedural generation. 4. Export the successful episodes, and feed that to a neural network! You now have an near-infinite stream of data. One of the key reasons that robotics lags far behind other AI fields is the lack of data: you cannot scrape control signals from the internet. They simply don't exist in-the-wild. MimicGen shows the power of synthetic data and simulation to keep our scaling laws alive. I believe this principle apply beyond robotics. We are quickly exhausting the high-quality, real tokens from the web. Artificial intelligence from artificial data will be the way forward. We are big fans of the OSS community. As usual, we open-source everything, including the generated dataset! - Website: - Paper: - Dataset is hosted on HuggingFace (thanks AK!!): - Code: MimicGen is led by Ajay Mandlekar, deep dive in the thread:

Jim Fan

332,199 görüntüleme • 2 yıl önce