Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Excited to share our latest progress on legged manipulation with humanoids. We created a VR interface to remote control the Draco-3 robot 🤖, which cooks ramen for hungry graduate students at night. We can't wait for the day it will help us at home in the real world! #humanoid

yukez's profile picture

Yuke Zhu

21,204 subscribers

68,245 Aufrufe • vor 3 Jahren •via X (Twitter)

Wissenschaft & TechnologieBildung#humanoid
LIVE

Anya Rossi• Live Now

Private livecam show

6 Kommentare

Profilbild von Yuke Zhu
Yuke Zhuvor 3 Jahren

Joint work w/ @stevehan_233 @kiwi_sherbet @lsentis at RPL & HCRL labs @texas_robotics (video credit: Steve Han)

Profilbild von Eric Rosen
Eric Rosenvor 3 Jahren

Very cool! Are there available details on the VR interface (curious about what VR hardware was used)

Profilbild von lisa.gerstman
lisa.gerstmanvor 3 Jahren

I despair when I see robots operating in the real world, the future was supposed to be much better.

Profilbild von Markus Wulfmeier
Markus Wulfmeiervor 3 Jahren

Great work, we definitely need more robot learning for humanoids!

Profilbild von Ravi Bhadeshiya
Ravi Bhadeshiyavor 3 Jahren

🤖🍳👍 Awesome to see a Draco using teleoperation! The possibilities for this technology are endless. #Robotics #Teleoperation

Profilbild von Annesya Banerjee (অন্বেষা ব্যানার্জী)
Annesya Banerjee (অন্বেষা ব্যানার্জী)vor 3 Jahren

Really cool! Was water added also by the robot? Trying to understand if it has the visual understanding of when water will spill over…

Ähnliche Videos

"There's a lot to see in our new building, we can't wait to share it with the world" 🌎 A progress update on our new home in Fishers, Indiana.
2:41

"There's a lot to see in our new building, we can't wait to share it with the world" 🌎 A progress update on our new home in Fishers, Indiana.

Andretti Global

16,067 Aufrufe • vor 2 Jahren

Humanoids need a single, generalist control policy for all of their physical tasks, not a new one for every new chore or demo. A policy for walking can't dance. A policy for dancing can't support mowing the lawn. We need to scale up humanoid control for diverse behaviors, just like we did with language and video models. Watch this humanoid, supported by a single control policy, to start its day, mow the lawn, jog, dance, and even hold the elevator for a colleague. This is the "System 1" for humanoids—a robust, natural humanoid controller that will support general-purpose autonomy. Project Page: #Robotics #AI #NVIDIA #SONIC #FoundationModel 🤖🔥
1:33

Humanoids need a single, generalist control policy for all of their physical tasks, not a new one for every new chore or demo. A policy for walking can't dance. A policy for dancing can't support mowing the lawn. We need to scale up humanoid control for diverse behaviors, just like we did with language and video models. Watch this humanoid, supported by a single control policy, to start its day, mow the lawn, jog, dance, and even hold the elevator for a colleague. This is the "System 1" for humanoids—a robust, natural humanoid controller that will support general-purpose autonomy. Project Page: #Robotics #AI #NVIDIA #SONIC #FoundationModel 🤖🔥

Zhengyi “Zen” Luo

15,876 Aufrufe • vor 8 Monaten

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.
0:49

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,436 Aufrufe • vor 2 Jahren

"We're a vassal state, we don't control our own security, we can't control our own economy.. we need to rethink our whole relationship with the US, the role it plays in the world & how we're complicit in it" James Schneider on our relationship with the US 🎯
1:41

"We're a vassal state, we don't control our own security, we can't control our own economy.. we need to rethink our whole relationship with the US, the role it plays in the world & how we're complicit in it" James Schneider on our relationship with the US 🎯

Saul Staniforth

74,401 Aufrufe • vor 3 Monaten

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: Paper link: Github:
3:55

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: Paper link: Github:

Haoran Geng

95,419 Aufrufe • vor 1 Jahr

Davido and I met for the first time at the listening party. Can't wait for the world to listen to the Magic we created Davido #five #davido
0:35

Davido and I met for the first time at the listening party. Can't wait for the world to listen to the Magic we created Davido #five #davido

Louddaaa

117,996 Aufrufe • vor 1 Jahr

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,040 Aufrufe • vor 8 Monaten

We are very proud to share the trailer for our feature documentary Bogart: Life Comes in Flashes. Our film will be released in select US theaters on November 15 and will be available to watch at home around the world starting on December 9!
1:35

We are very proud to share the trailer for our feature documentary Bogart: Life Comes in Flashes. Our film will be released in select US theaters on November 15 and will be available to watch at home around the world starting on December 9!

BogartEstate

93,575 Aufrufe • vor 1 Jahr

Good day, Governors! We can't wait to share some of our progress that we've built from concept art to a fully functioning city with our game engine! 🏰 As we're building cities for the Byzantines, which other civilizations do you wish to see in the future? 🙋‍♂️ Share your ideas in the comments below! #AoEMobile #AgeOfEmpiresMobile
0:30

Good day, Governors! We can't wait to share some of our progress that we've built from concept art to a fully functioning city with our game engine! 🏰 As we're building cities for the Byzantines, which other civilizations do you wish to see in the future? 🙋‍♂️ Share your ideas in the comments below! #AoEMobile #AgeOfEmpiresMobile

Age of Empires Mobile Official

12,949 Aufrufe • vor 2 Jahren

The throne speech is happening tomorrow, where you will get to hear our government's priorities for the year. We can't wait to share it with you.
0:24

The throne speech is happening tomorrow, where you will get to hear our government's priorities for the year. We can't wait to share it with you.

Wab Kinew

40,282 Aufrufe • vor 2 Jahren

Sam Altman says he’s excited about a future where signing up for ChatGPT’s highest tier gets you a free humanoid robot. ⦿ The mechanical engineering and AI for humanoids are quite hard but feel within grasp. ⦿ Making a billion humanoid robots will take a while; maybe the first million humanoid robots, built the old-fashioned way, will automate the entire robotics supply chain to enable faster scale. ⦿ The demand for humanoids will be far more than what we can handle with current supply chains. ⦿ Things we've tried to bring manufacturing back to the US have failed. AI & robotics is a potential solution.
2:07

Sam Altman says he’s excited about a future where signing up for ChatGPT’s highest tier gets you a free humanoid robot. ⦿ The mechanical engineering and AI for humanoids are quite hard but feel within grasp. ⦿ Making a billion humanoid robots will take a while; maybe the first million humanoid robots, built the old-fashioned way, will automate the entire robotics supply chain to enable faster scale. ⦿ The demand for humanoids will be far more than what we can handle with current supply chains. ⦿ Things we've tried to bring manufacturing back to the US have failed. AI & robotics is a potential solution.

The Humanoid Hub

82,099 Aufrufe • vor 1 Jahr

How to use simulation data for real-world robot manipulation? We present sim-and-real co-training, a simple recipe for manipulation. We demonstrate that sim data can significantly enhance real-world performance, even with notable differences between the sim and the real. (1/n)
1:15

How to use simulation data for real-world robot manipulation? We present sim-and-real co-training, a simple recipe for manipulation. We demonstrate that sim data can significantly enhance real-world performance, even with notable differences between the sim and the real. (1/n)

Zhenyu Jiang

44,310 Aufrufe • vor 1 Jahr

Long-horizon visual goals remain surprisingly hard for robot manipulation. We introduce Act2Goal, a goal-conditioned policy that uses a visual world model to reason about progress toward a goal, and practice it autonomously in the real world.
0:20

Long-horizon visual goals remain surprisingly hard for robot manipulation. We introduce Act2Goal, a goal-conditioned policy that uses a visual world model to reason about progress toward a goal, and practice it autonomously in the real world.

Jianlan Luo

95,100 Aufrufe • vor 6 Monaten

For the first time in the world, a humanoid robot fitted with a jetpack has shown it can fly. The breakthrough is a significant milestone for humanoid robots, according to the developers who say it was designed for real-world applications
2:54

For the first time in the world, a humanoid robot fitted with a jetpack has shown it can fly. The breakthrough is a significant milestone for humanoid robots, according to the developers who say it was designed for real-world applications

Reuters

50,719 Aufrufe • vor 1 Jahr

We are proud to announce our rebrand!We’re excited to share the opportunities we have created in communities around the country and looking forward to implementing new initiatives. Big shout out to 2Cents FC for partnering with us on the rebrand!
0:51

We are proud to announce our rebrand!We’re excited to share the opportunities we have created in communities around the country and looking forward to implementing new initiatives. Big shout out to 2Cents FC for partnering with us on the rebrand!

United Black Players of the USL

34,537 Aufrufe • vor 3 Jahren

🎉🎉🎉Super excited to announce that we launched a joint lab of Embodied AI and Humanoid Robot between UniTree and BIGAI! I will direct the lab to foster the research in integrating the 3D scene understanding capability to Humanoid robot. Hope to see more generalist Humanoid robots in our home very soon😁
0:58

🎉🎉🎉Super excited to announce that we launched a joint lab of Embodied AI and Humanoid Robot between UniTree and BIGAI! I will direct the lab to foster the research in integrating the 3D scene understanding capability to Humanoid robot. Hope to see more generalist Humanoid robots in our home very soon😁

Siyuan Huang

42,142 Aufrufe • vor 2 Jahren

📢📢📢 Excited to release ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning (CVPR25). 🤏🤙✌️With ManipTrans, we can transfer dexterous manipulation skills into robotic hands in simulation and deploy them on a real robot, using a residual policy learned for dex manipulation. 🤖🤖🤖The video below illustrates how the MoCap data can be transferred to Inspire, Shadow, Xhand, Allegro, and Mano. With ManipTrans, we can scale up dex manip data greatly with minimal effort. For more details, please check our -webpage: -code: -huggingface:
1:59

📢📢📢 Excited to release ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning (CVPR25). 🤏🤙✌️With ManipTrans, we can transfer dexterous manipulation skills into robotic hands in simulation and deploy them on a real robot, using a residual policy learned for dex manipulation. 🤖🤖🤖The video below illustrates how the MoCap data can be transferred to Inspire, Shadow, Xhand, Allegro, and Mano. With ManipTrans, we can scale up dex manip data greatly with minimal effort. For more details, please check our -webpage: -code: -huggingface:

Siyuan Huang

20,918 Aufrufe • vor 1 Jahr

We RL'ed humanoid robots to Cristiano Ronaldo, LeBron James, and Kobe Byrant! These are neural nets running on real hardware at our GEAR lab. Most robot demos you see online speed videos up. We actually *slow them down* so you can enjoy the fluid motions. I'm excited to announce "ASAP", a "real2sim2real" model that masters extremely smooth and dynamic motions for humanoid whole body control. We pretrain the robot in simulation first, but there is a notorious "sim2real" gap: it's very difficult for hand-engineered physics equations to match real world dynamics. Our fix is simple: just deploy a pretrained policy on real hardware, collect data, and replay the motion in sim. The replay will obviously have many errors, but that gives a rich signal to compensate for the physics discrepancy. Use another neural net to learn the delta. Basically, we "patch up" a traditional physics engine, so that the robot can experience almost the real world at scale in GPUs. The future is hybrid simulation: combine the power of classical sim engines refined over decades and the uncanny ability of modern NNs to capture a messy world.
0:50

We RL'ed humanoid robots to Cristiano Ronaldo, LeBron James, and Kobe Byrant! These are neural nets running on real hardware at our GEAR lab. Most robot demos you see online speed videos up. We actually *slow them down* so you can enjoy the fluid motions. I'm excited to announce "ASAP", a "real2sim2real" model that masters extremely smooth and dynamic motions for humanoid whole body control. We pretrain the robot in simulation first, but there is a notorious "sim2real" gap: it's very difficult for hand-engineered physics equations to match real world dynamics. Our fix is simple: just deploy a pretrained policy on real hardware, collect data, and replay the motion in sim. The replay will obviously have many errors, but that gives a rich signal to compensate for the physics discrepancy. Use another neural net to learn the delta. Basically, we "patch up" a traditional physics engine, so that the robot can experience almost the real world at scale in GPUs. The future is hybrid simulation: combine the power of classical sim engines refined over decades and the uncanny ability of modern NNs to capture a messy world.

Jim Fan

566,544 Aufrufe • vor 1 Jahr

There’s a lot of pain in the world, but none of it was with us at #SomeTypeofFon 🥹💫 Thank you for crossing over into 2025 with us, we can’t wait to share what we have planned for you in this new year 👀🔥
1:11

There’s a lot of pain in the world, but none of it was with us at #SomeTypeofFon 🥹💫 Thank you for crossing over into 2025 with us, we can’t wait to share what we have planned for you in this new year 👀🔥

HomeComing Events

54,141 Aufrufe • vor 1 Jahr

Want to help us set a Guinness World Record? Join the bolt.new hackathon! $1M+ in prizes. Register at to join. Excited to be judging. Enjoy a little #veo2 teaser I created for it.
0:33

Want to help us set a Guinness World Record? Join the bolt.new hackathon! $1M+ in prizes. Register at to join. Excited to be judging. Enjoy a little #veo2 teaser I created for it.

Addy Osmani

15,332 Aufrufe • vor 1 Jahr