Loading video...

Video Failed to Load

Go Home

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

2,058,122 views • 10 months ago •via X (Twitter)

67 Comments

Tony Zhao's profile picture
Tony Zhao10 months ago

Instead of teleoperation, we train solely on data from our Skill Capture Glove. The glove is co-designed with Memo's hand, meaning they share the exact same geometry and sensor suite. If you can do it wearing the glove, Memo can learn it.

Tony Zhao's profile picture
Tony Zhao10 months ago

The Skill Capture Glove gives us two orders of magnitude higher capital efficiency compared to teleoperation ($200 vs $20,000) It also allows us to scale diversity faster. You can collect data anywhere without needing to move robots around.

Tony Zhao's profile picture
Tony Zhao10 months ago

Skill Capture Glove aligns the hands, but what about the rest of the body? Human collectors vary in height and arm length, and are also visually different. We developed Skill Transform, a method that converts glove data into equivalent robot data with a 90%+ success rate.

Tony Zhao's profile picture
Tony Zhao10 months ago

It took us over a year to engineer the core infrastructure. We then spent the past 3 months to produce all the autonomous results above. Below, I highlight some of my favorite parts of this release.

Tony Zhao's profile picture
Tony Zhao10 months ago

The table-to-dishwasher task is the classic nightmare scenario for roboticists: Long-horizon, highly dexterous, precise, whole-body manipulation combined with delicate, transparent, reflective, and deformable objects. Yet Memo handles it so naturally and elegantly.

Tony Zhao's profile picture
Tony Zhao10 months ago

Specifically, wine glass loading is the most delicate subtask: Push down with too much force? Shatter. Insert the wrong prong? Shatter. We broke many during development, but zero over 20+ live demo sessions.

Tony Zhao's profile picture
Tony Zhao10 months ago

One less-known fact about glove-based data collection: it produces higher quality data than teleop on contact-rich tasks. Remote teleop can’t provide good force feedback, but gloves do naturally, making tasks like sock folding, which rely on feel, far easier to capture.

Tony Zhao's profile picture
Tony Zhao10 months ago

It is even more fun to see how Memo reacts to unseen environments. We deploy it to 6 unseen Airbnbs and task the robot with fine-grained tasks such as picking up utensils from the plate. Because we train on data from over 500 homes, the new home is instantly familiar to Memo.

Tony Zhao's profile picture
Tony Zhao10 months ago

If you want to learn more about ACT-1 and Memo, read our first research blog post: Follow @sundayrobotics for all future updates.

Ashok Elluswamy's profile picture
Ashok Elluswamy10 months ago

@sundayrobotics Congrats Tony and team!

B's profile picture
B10 months ago

@sundayrobotics Big flex from Sunday Robotics, hype's real, now show the messy real-world demos

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Zero-shot generalization to unseen homes!

Vincent ᗱƆᑌᑎϹᗴ🦾🔑's profile picture
Vincent ᗱƆᑌᑎϹᗴ🦾🔑10 months ago

@sundayrobotics 2000: Honda Asimo iPhone moment (programmed tasks). 2025: @sundayrobotics iPhone moment (full useful autonomous tasks). So sharp job @tonyzzhao ! 2050 will be wild.

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics 2026 would be wild.

Vincent ᗱƆᑌᑎϹᗴ🦾🔑's profile picture
Vincent ᗱƆᑌᑎϹᗴ🦾🔑10 months ago

@sundayrobotics 💯 20 successful tries without breaking glasses is amazing! Do you use harmonic drives from Nabtesco?

Phil Duan's profile picture
Phil Duan10 months ago

@sundayrobotics Congrats @tonyzzhao @chichengcc and team! Would love to hear the internal conversation of ACT vs diffusion policy :)

Julian Ibarz's profile picture
Julian Ibarz10 months ago

@sundayrobotics Cool work @tonyzzhao !

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Julian!

Jie Wang's profile picture
Jie Wang10 months ago

@sundayrobotics Congrats!!! Training without data is so exciting. I have a small question: why do some videos look so simulation-like? Is it a specific lighting setup?

Vector Wang's profile picture
Vector Wang10 months ago

@sundayrobotics Congrats Tony on such elegant setup! I know it’s the best one two days ago but I’m still stunned by this video.

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Building from the ground up offers us so much flexibility: from hardware design, data engine, to model architecture and training objectives. It's been an amazing journey to be learning from experts in my team @sundayrobotics - such a proud moment!

Vector Wang's profile picture
Vector Wang10 months ago

@sundayrobotics I am really excited about what you are building here. And I hope I could someday join you guys.

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics That means a lot to us - Thank you Vector!

Kamyar Ghasemipour's profile picture
Kamyar Ghasemipour10 months ago

@sundayrobotics Congratulations on the awesome release @tonyzzhao!! 🎉 Memo is so cute!!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Kamyar!!

Connor Hughes's profile picture
Connor Hughes10 months ago

@sundayrobotics LFG!! 🚀🚀 so stoked to be able to share the progress, this is only the beginning here @sundayrobotics 🦾

Ivan Kirigin's profile picture
Ivan Kirigin10 months ago

@sundayrobotics Your robot is cute as hell

Ayzaan Wahid's profile picture
Ayzaan Wahid10 months ago

@sundayrobotics looks amazing, congrats Tony!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Ayzaan! Still remember the night we shoot this video together. It's been a while!

Ayzaan Wahid's profile picture
Ayzaan Wahid10 months ago

@sundayrobotics that night was so fun, and so much progress on robotics since then!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Yes hard to believe!

Tyler Zhu's profile picture
Tyler Zhu10 months ago

@sundayrobotics wow incredible release tony, congrats!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Tyler!!

Kent Williams's profile picture
Kent Williams10 months ago

@sundayrobotics This is so cool Tony, congrats on the launch!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Kent!

Samuel Schmidgall's profile picture
Samuel Schmidgall10 months ago

@sundayrobotics Amazing work @tonyzzhao !! Excited to see more!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Samuel!

Arnav Gudibande's profile picture
Arnav Gudibande10 months ago

@sundayrobotics Super cool congrats Tony 🚀

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Arnav! It's been a while and still missed the days at ML@B!

Danijar Hafner's profile picture
Danijar Hafner10 months ago

@sundayrobotics Congrats Tony!! 🚀

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Danijar!

Holly Peck's profile picture
Holly Peck10 months ago

@sundayrobotics Dexterity looks impressive here - congrats @tonyzzhao & team!! 🥂

𝓩*'s profile picture
𝓩*10 months ago

@sundayrobotics Cool, you've come quite far since ALOHA, which was the last thing of yours I saw!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics We've come a long way as a field!

Lucy Shi's profile picture
Lucy Shi10 months ago

@sundayrobotics congrats!! @tonyzzhao @chichengcc the robot looks very nice 🖥️

Rika Antonova's profile picture
Rika Antonova10 months ago

@sundayrobotics Excellent design. Looking forward to seeing this robot in homes around the world!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Rika!

Anikait Singh's profile picture
Anikait Singh10 months ago

@sundayrobotics Congrats on the release!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Anikait!

Gokul Swamy's profile picture
Gokul Swamy10 months ago

@sundayrobotics Super impressive work, congrats @tonyzzhao and @chichengcc!!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics @chichengcc Thank you Gokul!

𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀's profile picture
𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀10 months ago

@sundayrobotics That sock folding at 3:00 minutes is mind-blowing 🤯 he folded with ease ... Congratulations 👏

Cyril Zakka, MD's profile picture
Cyril Zakka, MD10 months ago

@sundayrobotics Great work - also love how the robot looks!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Cyril! Means a lot!

Huaxiu Yao's profile picture
Huaxiu Yao10 months ago

@sundayrobotics Cool, congrats, @tonyzzhao!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Huaxiu!

Adam Raudonis's profile picture
Adam Raudonis10 months ago

@sundayrobotics Congrats!!!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Adam!

lucas liao's profile picture
lucas liao10 months ago

@sundayrobotics it looks so good!!

Carlo Sferrazza's profile picture
Carlo Sferrazza10 months ago

@sundayrobotics Congrats Tony, very impressive!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thanks Carlo!

Kimin's profile picture
Kimin10 months ago

@sundayrobotics So impressive! Congrats!!

Tony Zhao's profile picture
Tony Zhao10 months ago

@sundayrobotics Thank you Kimin!

Nikunj Kothari's profile picture
Nikunj Kothari10 months ago

@sundayrobotics Congrats on the launch - for the nerds, this video was better than the launch video :)

sarah guo's profile picture
sarah guo10 months ago

@sundayrobotics I love @alpercanbe at the end

Nikhil Srinivasan's profile picture
Nikhil Srinivasan10 months ago

@sundayrobotics woah 🤯

Erdem Bıyık's profile picture
Erdem Bıyık10 months ago

@sundayrobotics Go easy data collection interfaces (and cute robots)! Congratulations :)

Related Videos