Загрузка видео...

Не удалось загрузить видео

На главную

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

2,058,122 просмотров • 10 месяцев назад •via X (Twitter)

Комментарии: 67

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

Instead of teleoperation, we train solely on data from our Skill Capture Glove. The glove is co-designed with Memo's hand, meaning they share the exact same geometry and sensor suite. If you can do it wearing the glove, Memo can learn it.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

The Skill Capture Glove gives us two orders of magnitude higher capital efficiency compared to teleoperation ($200 vs $20,000) It also allows us to scale diversity faster. You can collect data anywhere without needing to move robots around.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

Skill Capture Glove aligns the hands, but what about the rest of the body? Human collectors vary in height and arm length, and are also visually different. We developed Skill Transform, a method that converts glove data into equivalent robot data with a 90%+ success rate.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

It took us over a year to engineer the core infrastructure. We then spent the past 3 months to produce all the autonomous results above. Below, I highlight some of my favorite parts of this release.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

The table-to-dishwasher task is the classic nightmare scenario for roboticists: Long-horizon, highly dexterous, precise, whole-body manipulation combined with delicate, transparent, reflective, and deformable objects. Yet Memo handles it so naturally and elegantly.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

Specifically, wine glass loading is the most delicate subtask: Push down with too much force? Shatter. Insert the wrong prong? Shatter. We broke many during development, but zero over 20+ live demo sessions.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

One less-known fact about glove-based data collection: it produces higher quality data than teleop on contact-rich tasks. Remote teleop can’t provide good force feedback, but gloves do naturally, making tasks like sock folding, which rely on feel, far easier to capture.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

It is even more fun to see how Memo reacts to unseen environments. We deploy it to 6 unseen Airbnbs and task the robot with fine-grained tasks such as picking up utensils from the plate. Because we train on data from over 500 homes, the new home is instantly familiar to Memo.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

If you want to learn more about ACT-1 and Memo, read our first research blog post: Follow @sundayrobotics for all future updates.

Фото профиля Ashok Elluswamy
Ashok Elluswamy10 месяцев назад

@sundayrobotics Congrats Tony and team!

Фото профиля B
B10 месяцев назад

@sundayrobotics Big flex from Sunday Robotics, hype's real, now show the messy real-world demos

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Zero-shot generalization to unseen homes!

Фото профиля Vincent ᗱƆᑌᑎϹᗴ🦾🔑
Vincent ᗱƆᑌᑎϹᗴ🦾🔑10 месяцев назад

@sundayrobotics 2000: Honda Asimo iPhone moment (programmed tasks). 2025: @sundayrobotics iPhone moment (full useful autonomous tasks). So sharp job @tonyzzhao ! 2050 will be wild.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics 2026 would be wild.

Фото профиля Vincent ᗱƆᑌᑎϹᗴ🦾🔑
Vincent ᗱƆᑌᑎϹᗴ🦾🔑10 месяцев назад

@sundayrobotics 💯 20 successful tries without breaking glasses is amazing! Do you use harmonic drives from Nabtesco?

Фото профиля Phil Duan
Phil Duan10 месяцев назад

@sundayrobotics Congrats @tonyzzhao @chichengcc and team! Would love to hear the internal conversation of ACT vs diffusion policy :)

Фото профиля Julian Ibarz
Julian Ibarz10 месяцев назад

@sundayrobotics Cool work @tonyzzhao !

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Julian!

Фото профиля Jie Wang
Jie Wang10 месяцев назад

@sundayrobotics Congrats!!! Training without data is so exciting. I have a small question: why do some videos look so simulation-like? Is it a specific lighting setup?

Фото профиля Vector Wang
Vector Wang10 месяцев назад

@sundayrobotics Congrats Tony on such elegant setup! I know it’s the best one two days ago but I’m still stunned by this video.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Building from the ground up offers us so much flexibility: from hardware design, data engine, to model architecture and training objectives. It's been an amazing journey to be learning from experts in my team @sundayrobotics - such a proud moment!

Фото профиля Vector Wang
Vector Wang10 месяцев назад

@sundayrobotics I am really excited about what you are building here. And I hope I could someday join you guys.

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics That means a lot to us - Thank you Vector!

Фото профиля Kamyar Ghasemipour
Kamyar Ghasemipour10 месяцев назад

@sundayrobotics Congratulations on the awesome release @tonyzzhao!! 🎉 Memo is so cute!!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Kamyar!!

Фото профиля Connor Hughes
Connor Hughes10 месяцев назад

@sundayrobotics LFG!! 🚀🚀 so stoked to be able to share the progress, this is only the beginning here @sundayrobotics 🦾

Фото профиля Ivan Kirigin
Ivan Kirigin10 месяцев назад

@sundayrobotics Your robot is cute as hell

Фото профиля Ayzaan Wahid
Ayzaan Wahid10 месяцев назад

@sundayrobotics looks amazing, congrats Tony!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Ayzaan! Still remember the night we shoot this video together. It's been a while!

Фото профиля Ayzaan Wahid
Ayzaan Wahid10 месяцев назад

@sundayrobotics that night was so fun, and so much progress on robotics since then!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Yes hard to believe!

Фото профиля Tyler Zhu
Tyler Zhu10 месяцев назад

@sundayrobotics wow incredible release tony, congrats!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Tyler!!

Фото профиля Kent Williams
Kent Williams10 месяцев назад

@sundayrobotics This is so cool Tony, congrats on the launch!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Kent!

Фото профиля Samuel Schmidgall
Samuel Schmidgall10 месяцев назад

@sundayrobotics Amazing work @tonyzzhao !! Excited to see more!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Samuel!

Фото профиля Arnav Gudibande
Arnav Gudibande10 месяцев назад

@sundayrobotics Super cool congrats Tony 🚀

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Arnav! It's been a while and still missed the days at ML@B!

Фото профиля Danijar Hafner
Danijar Hafner10 месяцев назад

@sundayrobotics Congrats Tony!! 🚀

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Danijar!

Фото профиля Holly Peck
Holly Peck10 месяцев назад

@sundayrobotics Dexterity looks impressive here - congrats @tonyzzhao & team!! 🥂

Фото профиля 𝓩*
𝓩*10 месяцев назад

@sundayrobotics Cool, you've come quite far since ALOHA, which was the last thing of yours I saw!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics We've come a long way as a field!

Фото профиля Lucy Shi
Lucy Shi10 месяцев назад

@sundayrobotics congrats!! @tonyzzhao @chichengcc the robot looks very nice 🖥️

Фото профиля Rika Antonova
Rika Antonova10 месяцев назад

@sundayrobotics Excellent design. Looking forward to seeing this robot in homes around the world!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Rika!

Фото профиля Anikait Singh
Anikait Singh10 месяцев назад

@sundayrobotics Congrats on the release!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Anikait!

Фото профиля Gokul Swamy
Gokul Swamy10 месяцев назад

@sundayrobotics Super impressive work, congrats @tonyzzhao and @chichengcc!!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics @chichengcc Thank you Gokul!

Фото профиля 𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀
𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀10 месяцев назад

@sundayrobotics That sock folding at 3:00 minutes is mind-blowing 🤯 he folded with ease ... Congratulations 👏

Фото профиля Cyril Zakka, MD
Cyril Zakka, MD10 месяцев назад

@sundayrobotics Great work - also love how the robot looks!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Cyril! Means a lot!

Фото профиля Huaxiu Yao
Huaxiu Yao10 месяцев назад

@sundayrobotics Cool, congrats, @tonyzzhao!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Huaxiu!

Фото профиля Adam Raudonis
Adam Raudonis10 месяцев назад

@sundayrobotics Congrats!!!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Adam!

Фото профиля lucas liao
lucas liao10 месяцев назад

@sundayrobotics it looks so good!!

Фото профиля Carlo Sferrazza
Carlo Sferrazza10 месяцев назад

@sundayrobotics Congrats Tony, very impressive!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thanks Carlo!

Фото профиля Kimin
Kimin10 месяцев назад

@sundayrobotics So impressive! Congrats!!

Фото профиля Tony Zhao
Tony Zhao10 месяцев назад

@sundayrobotics Thank you Kimin!

Фото профиля Nikunj Kothari
Nikunj Kothari10 месяцев назад

@sundayrobotics Congrats on the launch - for the nerds, this video was better than the launch video :)

Фото профиля sarah guo
sarah guo10 месяцев назад

@sundayrobotics I love @alpercanbe at the end

Фото профиля Nikhil Srinivasan
Nikhil Srinivasan10 месяцев назад

@sundayrobotics woah 🤯

Фото профиля Erdem Bıyık
Erdem Bıyık10 месяцев назад

@sundayrobotics Go easy data collection interfaces (and cute robots)! Congratulations :)

Похожие видео