Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

2,058,122 görüntüleme • 10 ay önce •via X (Twitter)

67 Yorum

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

Instead of teleoperation, we train solely on data from our Skill Capture Glove. The glove is co-designed with Memo's hand, meaning they share the exact same geometry and sensor suite. If you can do it wearing the glove, Memo can learn it.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

The Skill Capture Glove gives us two orders of magnitude higher capital efficiency compared to teleoperation ($200 vs $20,000) It also allows us to scale diversity faster. You can collect data anywhere without needing to move robots around.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

Skill Capture Glove aligns the hands, but what about the rest of the body? Human collectors vary in height and arm length, and are also visually different. We developed Skill Transform, a method that converts glove data into equivalent robot data with a 90%+ success rate.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

It took us over a year to engineer the core infrastructure. We then spent the past 3 months to produce all the autonomous results above. Below, I highlight some of my favorite parts of this release.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

The table-to-dishwasher task is the classic nightmare scenario for roboticists: Long-horizon, highly dexterous, precise, whole-body manipulation combined with delicate, transparent, reflective, and deformable objects. Yet Memo handles it so naturally and elegantly.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

Specifically, wine glass loading is the most delicate subtask: Push down with too much force? Shatter. Insert the wrong prong? Shatter. We broke many during development, but zero over 20+ live demo sessions.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

One less-known fact about glove-based data collection: it produces higher quality data than teleop on contact-rich tasks. Remote teleop can’t provide good force feedback, but gloves do naturally, making tasks like sock folding, which rely on feel, far easier to capture.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

It is even more fun to see how Memo reacts to unseen environments. We deploy it to 6 unseen Airbnbs and task the robot with fine-grained tasks such as picking up utensils from the plate. Because we train on data from over 500 homes, the new home is instantly familiar to Memo.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

If you want to learn more about ACT-1 and Memo, read our first research blog post: Follow @sundayrobotics for all future updates.

Ashok Elluswamy profil fotoğrafı
Ashok Elluswamy10 ay önce

@sundayrobotics Congrats Tony and team!

B profil fotoğrafı
B10 ay önce

@sundayrobotics Big flex from Sunday Robotics, hype's real, now show the messy real-world demos

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Zero-shot generalization to unseen homes!

Vincent ᗱƆᑌᑎϹᗴ🦾🔑 profil fotoğrafı
Vincent ᗱƆᑌᑎϹᗴ🦾🔑10 ay önce

@sundayrobotics 2000: Honda Asimo iPhone moment (programmed tasks). 2025: @sundayrobotics iPhone moment (full useful autonomous tasks). So sharp job @tonyzzhao ! 2050 will be wild.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics 2026 would be wild.

Vincent ᗱƆᑌᑎϹᗴ🦾🔑 profil fotoğrafı
Vincent ᗱƆᑌᑎϹᗴ🦾🔑10 ay önce

@sundayrobotics 💯 20 successful tries without breaking glasses is amazing! Do you use harmonic drives from Nabtesco?

Phil Duan profil fotoğrafı
Phil Duan10 ay önce

@sundayrobotics Congrats @tonyzzhao @chichengcc and team! Would love to hear the internal conversation of ACT vs diffusion policy :)

Julian Ibarz profil fotoğrafı
Julian Ibarz10 ay önce

@sundayrobotics Cool work @tonyzzhao !

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Julian!

Jie Wang profil fotoğrafı
Jie Wang10 ay önce

@sundayrobotics Congrats!!! Training without data is so exciting. I have a small question: why do some videos look so simulation-like? Is it a specific lighting setup?

Vector Wang profil fotoğrafı
Vector Wang10 ay önce

@sundayrobotics Congrats Tony on such elegant setup! I know it’s the best one two days ago but I’m still stunned by this video.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Building from the ground up offers us so much flexibility: from hardware design, data engine, to model architecture and training objectives. It's been an amazing journey to be learning from experts in my team @sundayrobotics - such a proud moment!

Vector Wang profil fotoğrafı
Vector Wang10 ay önce

@sundayrobotics I am really excited about what you are building here. And I hope I could someday join you guys.

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics That means a lot to us - Thank you Vector!

Kamyar Ghasemipour profil fotoğrafı
Kamyar Ghasemipour10 ay önce

@sundayrobotics Congratulations on the awesome release @tonyzzhao!! 🎉 Memo is so cute!!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Kamyar!!

Connor Hughes profil fotoğrafı
Connor Hughes10 ay önce

@sundayrobotics LFG!! 🚀🚀 so stoked to be able to share the progress, this is only the beginning here @sundayrobotics 🦾

Ivan Kirigin profil fotoğrafı
Ivan Kirigin10 ay önce

@sundayrobotics Your robot is cute as hell

Ayzaan Wahid profil fotoğrafı
Ayzaan Wahid10 ay önce

@sundayrobotics looks amazing, congrats Tony!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Ayzaan! Still remember the night we shoot this video together. It's been a while!

Ayzaan Wahid profil fotoğrafı
Ayzaan Wahid10 ay önce

@sundayrobotics that night was so fun, and so much progress on robotics since then!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Yes hard to believe!

Tyler Zhu profil fotoğrafı
Tyler Zhu10 ay önce

@sundayrobotics wow incredible release tony, congrats!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Tyler!!

Kent Williams profil fotoğrafı
Kent Williams10 ay önce

@sundayrobotics This is so cool Tony, congrats on the launch!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Kent!

Samuel Schmidgall profil fotoğrafı
Samuel Schmidgall10 ay önce

@sundayrobotics Amazing work @tonyzzhao !! Excited to see more!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Samuel!

Arnav Gudibande profil fotoğrafı
Arnav Gudibande10 ay önce

@sundayrobotics Super cool congrats Tony 🚀

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Arnav! It's been a while and still missed the days at ML@B!

Danijar Hafner profil fotoğrafı
Danijar Hafner10 ay önce

@sundayrobotics Congrats Tony!! 🚀

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Danijar!

Holly Peck profil fotoğrafı
Holly Peck10 ay önce

@sundayrobotics Dexterity looks impressive here - congrats @tonyzzhao & team!! 🥂

𝓩* profil fotoğrafı
𝓩*10 ay önce

@sundayrobotics Cool, you've come quite far since ALOHA, which was the last thing of yours I saw!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics We've come a long way as a field!

Lucy Shi profil fotoğrafı
Lucy Shi10 ay önce

@sundayrobotics congrats!! @tonyzzhao @chichengcc the robot looks very nice 🖥️

Rika Antonova profil fotoğrafı
Rika Antonova10 ay önce

@sundayrobotics Excellent design. Looking forward to seeing this robot in homes around the world!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Rika!

Anikait Singh profil fotoğrafı
Anikait Singh10 ay önce

@sundayrobotics Congrats on the release!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Anikait!

Gokul Swamy profil fotoğrafı
Gokul Swamy10 ay önce

@sundayrobotics Super impressive work, congrats @tonyzzhao and @chichengcc!!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics @chichengcc Thank you Gokul!

𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀 profil fotoğrafı
𝘚𝘸𝘦𝘵𝘩𝘢 𝘊𝘩𝘰𝘸𝘥𝘢𝘳𝘺 🎀10 ay önce

@sundayrobotics That sock folding at 3:00 minutes is mind-blowing 🤯 he folded with ease ... Congratulations 👏

Cyril Zakka, MD profil fotoğrafı
Cyril Zakka, MD10 ay önce

@sundayrobotics Great work - also love how the robot looks!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Cyril! Means a lot!

Huaxiu Yao profil fotoğrafı
Huaxiu Yao10 ay önce

@sundayrobotics Cool, congrats, @tonyzzhao!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Huaxiu!

Adam Raudonis profil fotoğrafı
Adam Raudonis10 ay önce

@sundayrobotics Congrats!!!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Adam!

lucas liao profil fotoğrafı
lucas liao10 ay önce

@sundayrobotics it looks so good!!

Carlo Sferrazza profil fotoğrafı
Carlo Sferrazza10 ay önce

@sundayrobotics Congrats Tony, very impressive!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thanks Carlo!

Kimin profil fotoğrafı
Kimin10 ay önce

@sundayrobotics So impressive! Congrats!!

Tony Zhao profil fotoğrafı
Tony Zhao10 ay önce

@sundayrobotics Thank you Kimin!

Nikunj Kothari profil fotoğrafı
Nikunj Kothari10 ay önce

@sundayrobotics Congrats on the launch - for the nerds, this video was better than the launch video :)

sarah guo profil fotoğrafı
sarah guo10 ay önce

@sundayrobotics I love @alpercanbe at the end

Nikhil Srinivasan profil fotoğrafı
Nikhil Srinivasan10 ay önce

@sundayrobotics woah 🤯

Erdem Bıyık profil fotoğrafı
Erdem Bıyık10 ay önce

@sundayrobotics Go easy data collection interfaces (and cute robots)! Congratulations :)

Benzer Videolar