Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

2,058,122 Aufrufe • vor 10 Monaten •via X (Twitter)

67 Kommentare

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

Instead of teleoperation, we train solely on data from our Skill Capture Glove. The glove is co-designed with Memo's hand, meaning they share the exact same geometry and sensor suite. If you can do it wearing the glove, Memo can learn it.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

The Skill Capture Glove gives us two orders of magnitude higher capital efficiency compared to teleoperation ($200 vs $20,000) It also allows us to scale diversity faster. You can collect data anywhere without needing to move robots around.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

Skill Capture Glove aligns the hands, but what about the rest of the body? Human collectors vary in height and arm length, and are also visually different. We developed Skill Transform, a method that converts glove data into equivalent robot data with a 90%+ success rate.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

It took us over a year to engineer the core infrastructure. We then spent the past 3 months to produce all the autonomous results above. Below, I highlight some of my favorite parts of this release.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

The table-to-dishwasher task is the classic nightmare scenario for roboticists: Long-horizon, highly dexterous, precise, whole-body manipulation combined with delicate, transparent, reflective, and deformable objects. Yet Memo handles it so naturally and elegantly.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

Specifically, wine glass loading is the most delicate subtask: Push down with too much force? Shatter. Insert the wrong prong? Shatter. We broke many during development, but zero over 20+ live demo sessions.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

One less-known fact about glove-based data collection: it produces higher quality data than teleop on contact-rich tasks. Remote teleop can’t provide good force feedback, but gloves do naturally, making tasks like sock folding, which rely on feel, far easier to capture.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

It is even more fun to see how Memo reacts to unseen environments. We deploy it to 6 unseen Airbnbs and task the robot with fine-grained tasks such as picking up utensils from the plate. Because we train on data from over 500 homes, the new home is instantly familiar to Memo.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

If you want to learn more about ACT-1 and Memo, read our first research blog post: Follow @sundayrobotics for all future updates.

Profilbild von Ashok Elluswamy
Ashok Elluswamyvor 10 Monaten

@sundayrobotics Congrats Tony and team!

Profilbild von B
Bvor 10 Monaten

@sundayrobotics Big flex from Sunday Robotics, hype's real, now show the messy real-world demos

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Zero-shot generalization to unseen homes!

Profilbild von Vincent ᗱƆᑌᑎϹᗴ🦾🔑
Vincent ᗱƆᑌᑎϹᗴ🦾🔑vor 10 Monaten

@sundayrobotics 2000: Honda Asimo iPhone moment (programmed tasks). 2025: @sundayrobotics iPhone moment (full useful autonomous tasks). So sharp job @tonyzzhao ! 2050 will be wild.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics 2026 would be wild.

Profilbild von Vincent ᗱƆᑌᑎϹᗴ🦾🔑
Vincent ᗱƆᑌᑎϹᗴ🦾🔑vor 10 Monaten

@sundayrobotics 💯 20 successful tries without breaking glasses is amazing! Do you use harmonic drives from Nabtesco?

Profilbild von Phil Duan
Phil Duanvor 10 Monaten

@sundayrobotics Congrats @tonyzzhao @chichengcc and team! Would love to hear the internal conversation of ACT vs diffusion policy :)

Profilbild von Julian Ibarz
Julian Ibarzvor 10 Monaten

@sundayrobotics Cool work @tonyzzhao !

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Julian!

Profilbild von Jie Wang
Jie Wangvor 10 Monaten

@sundayrobotics Congrats!!! Training without data is so exciting. I have a small question: why do some videos look so simulation-like? Is it a specific lighting setup?

Profilbild von Vector Wang
Vector Wangvor 10 Monaten

@sundayrobotics Congrats Tony on such elegant setup! I know it’s the best one two days ago but I’m still stunned by this video.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Building from the ground up offers us so much flexibility: from hardware design, data engine, to model architecture and training objectives. It's been an amazing journey to be learning from experts in my team @sundayrobotics - such a proud moment!

Profilbild von Vector Wang
Vector Wangvor 10 Monaten

@sundayrobotics I am really excited about what you are building here. And I hope I could someday join you guys.

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics That means a lot to us - Thank you Vector!

Profilbild von Kamyar Ghasemipour
Kamyar Ghasemipourvor 10 Monaten

@sundayrobotics Congratulations on the awesome release @tonyzzhao!! 🎉 Memo is so cute!!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Kamyar!!

Profilbild von Connor Hughes
Connor Hughesvor 10 Monaten

@sundayrobotics LFG!! 🚀🚀 so stoked to be able to share the progress, this is only the beginning here @sundayrobotics 🦾

Profilbild von Ivan Kirigin
Ivan Kiriginvor 10 Monaten

@sundayrobotics Your robot is cute as hell

Profilbild von Ayzaan Wahid
Ayzaan Wahidvor 10 Monaten

@sundayrobotics looks amazing, congrats Tony!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Ayzaan! Still remember the night we shoot this video together. It's been a while!

Profilbild von Ayzaan Wahid
Ayzaan Wahidvor 10 Monaten

@sundayrobotics that night was so fun, and so much progress on robotics since then!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Yes hard to believe!

Profilbild von Tyler Zhu
Tyler Zhuvor 10 Monaten

@sundayrobotics wow incredible release tony, congrats!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Tyler!!

Profilbild von Kent Williams
Kent Williamsvor 10 Monaten

@sundayrobotics This is so cool Tony, congrats on the launch!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Kent!

Profilbild von Samuel Schmidgall
Samuel Schmidgallvor 10 Monaten

@sundayrobotics Amazing work @tonyzzhao !! Excited to see more!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Samuel!

Profilbild von Arnav Gudibande
Arnav Gudibandevor 10 Monaten

@sundayrobotics Super cool congrats Tony 🚀

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Arnav! It's been a while and still missed the days at ML@B!

Profilbild von Danijar Hafner
Danijar Hafnervor 10 Monaten

@sundayrobotics Congrats Tony!! 🚀

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Danijar!

Profilbild von Holly Peck
Holly Peckvor 10 Monaten

@sundayrobotics Dexterity looks impressive here - congrats @tonyzzhao & team!! 🥂

Profilbild von 𝓩*
𝓩*vor 10 Monaten

@sundayrobotics Cool, you've come quite far since ALOHA, which was the last thing of yours I saw!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics We've come a long way as a field!

Profilbild von Lucy Shi
Lucy Shivor 10 Monaten

@sundayrobotics congrats!! @tonyzzhao @chichengcc the robot looks very nice 🖥️

Profilbild von Rika Antonova
Rika Antonovavor 10 Monaten

@sundayrobotics Excellent design. Looking forward to seeing this robot in homes around the world!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Rika!

Profilbild von Anikait Singh
Anikait Singhvor 10 Monaten

@sundayrobotics Congrats on the release!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Anikait!

Profilbild von Gokul Swamy
Gokul Swamyvor 10 Monaten

@sundayrobotics Super impressive work, congrats @tonyzzhao and @chichengcc!!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics @chichengcc Thank you Gokul!

Profilbild von 𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀
𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀vor 10 Monaten

@sundayrobotics That sock folding at 3:00 minutes is mind-blowing 🤯 he folded with ease ... Congratulations 👏

Profilbild von Cyril Zakka, MD
Cyril Zakka, MDvor 10 Monaten

@sundayrobotics Great work - also love how the robot looks!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Cyril! Means a lot!

Profilbild von Huaxiu Yao
Huaxiu Yaovor 10 Monaten

@sundayrobotics Cool, congrats, @tonyzzhao!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Huaxiu!

Profilbild von Adam Raudonis
Adam Raudonisvor 10 Monaten

@sundayrobotics Congrats!!!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Adam!

Profilbild von lucas liao
lucas liaovor 10 Monaten

@sundayrobotics it looks so good!!

Profilbild von Carlo Sferrazza
Carlo Sferrazzavor 10 Monaten

@sundayrobotics Congrats Tony, very impressive!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thanks Carlo!

Profilbild von Kimin
Kiminvor 10 Monaten

@sundayrobotics So impressive! Congrats!!

Profilbild von Tony Zhao
Tony Zhaovor 10 Monaten

@sundayrobotics Thank you Kimin!

Profilbild von Nikunj Kothari
Nikunj Kotharivor 10 Monaten

@sundayrobotics Congrats on the launch - for the nerds, this video was better than the launch video :)

Profilbild von sarah guo
sarah guovor 10 Monaten

@sundayrobotics I love @alpercanbe at the end

Profilbild von Nikhil Srinivasan
Nikhil Srinivasanvor 10 Monaten

@sundayrobotics woah 🤯

Profilbild von Erdem Bıyık
Erdem Bıyıkvor 10 Monaten

@sundayrobotics Go easy data collection interfaces (and cute robots)! Congratulations :)

Ähnliche Videos