Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

PHC has been accepted by ICCV 2023! We aim to develop a physics-based humanoid controller capable of imitating ALL of the motion from the AMASS dataset (almost there🧐), recover from failure state, does NOT use any external forces, all the while supporting real-time use cases!

Zhengyi “Zen” Luo

5,834 subscribers

57,938 views • 2 years ago •via X (Twitter)

Education Science & Technology News & Politics

Anya Rossi• Live Now

Private livecam show

8 Comments

Zhengyi “Zen” Luo2 years ago

Here is some imitation results👇🏻

Zhengyi “Zen” Luo2 years ago

Using output from MeTRAbs, PHC can be used to drive real-time simulated avatar from videos, an effect I long tried to achieved. PHC can stay robust to noisy input and recover from fail-state (as in the beginning of the video), and perpetually control a humanoid without reset.

Zhengyi “Zen” Luo2 years ago

Connecting with an off-the-shelf text-to-motion model (MDM in this demo), PHC can chain up multiple utterances and control a humanoid to perform these motion.

Zhengyi “Zen” Luo2 years ago

Code and trained models coming soon! Work done at @RealityLabs Pittsburgh. Much thanks to the team! @jinkuncao @awinkler_ @kkitani @xuweipeng000

Ye Yuan2 years ago

See you in Paris 😉

はな2 years ago

Congrats!

Jin Cheng2 years ago

Beautiful!!! Nice work!

shan_wen42 years ago

This guy must be a master of balance

Related Videos

Why not use the real-world as a game level? This is a real-time augmented reality prototype using a physics based character controller, all running on the web 👀

Why not use the real-world as a game level? This is a real-time augmented reality prototype using a physics based character controller, all running on the web 👀

Ian Curtis

533,276 views • 2 years ago

A new humanoid robotics startup has emerged—not from China this time, but from the U.S.: Foundation Robotics. The company has recently acquired Florida-based Boardwalk Robotics and has been piloting the Phantom robot (previously named Alex at Boardwalk) in industrial use cases.

A new humanoid robotics startup has emerged—not from China this time, but from the U.S.: Foundation Robotics. The company has recently acquired Florida-based Boardwalk Robotics and has been piloting the Phantom robot (previously named Alex at Boardwalk) in industrial use cases.

The Humanoid Hub

140,712 views • 1 year ago

The Senate has not removed any means of transmission. If you want to use a bicycle to carry your votes from one polling unit to the ward centre, do so. If you want to use your phone to transmit, do so. If you want to use your iPad, do so. All we said was that we should remove the word ‘real time,’ because if you say real time and there is grid failure and the network is not working, when you go to court somebody will say it ought to have been real time. That was what we said. We left the burden for INEC to determine the mode of transmission of votes. - Senate President Akpabio insists that the Senate did not remove electronic transmission of election results, clarifying that lawmakers only questioned the requirement for real-time transmission

The Senate has not removed any means of transmission. If you want to use a bicycle to carry your votes from one polling unit to the ward centre, do so. If you want to use your phone to transmit, do so. If you want to use your iPad, do so. All we said was that we should remove the word ‘real time,’ because if you say real time and there is grid failure and the network is not working, when you go to court somebody will say it ought to have been real time. That was what we said. We left the burden for INEC to determine the mode of transmission of votes. - Senate President Akpabio insists that the Senate did not remove electronic transmission of election results, clarifying that lawmakers only questioned the requirement for real-time transmission

Nigerian Affairs Journal

74,892 views • 4 months ago

Almost all the drones used by Russia in the war against Ukraine are from China. Russian Ministry of Finance Anton Siluanov stated this at a meeting of the State Duma Committee on Budget and Taxes. "Today, almost all drones are from China. We are also grateful to our partners for this. But we need to develop our own resource base, and the necessary money has been allocated," the Russian minister said.

Almost all the drones used by Russia in the war against Ukraine are from China. Russian Ministry of Finance Anton Siluanov stated this at a meeting of the State Duma Committee on Budget and Taxes. "Today, almost all drones are from China. We are also grateful to our partners for this. But we need to develop our own resource base, and the necessary money has been allocated," the Russian minister said.

Anton Gerashchenko

536,297 views • 2 years ago

Controller Flicking Without The Use Of Aim Assist

Controller Flicking Without The Use Of Aim Assist

Dynamic

65,992 views • 6 months ago

A magnet levitating between two bismuth crystals. Without the use of any external power source.🧐

A magnet levitating between two bismuth crystals. Without the use of any external power source.🧐

Bronze Giant

211,023 views • 7 months ago

🤔 Ever wondered if simulation-based animation/avatar learnings can be applied to real humanoid in real-time? 🤖 Introducing H2O (Human2HumanOid): - 🧠 An RL-based human-to-humanoid real-time whole-body teleoperation framework - 💃 Scalable retargeting and training using large human motion dataset - 🎥 With just an RGB camera, everyone can teleoperate a full-sized humanoid to perform actions like pick and place, walking, kicking, boxing, etc - 💡Unleash the potential of humanoids with human cognitive skills and adaptability 🔗: 📄: 🎬: H2O proposes: - A scalable retargeting framework for obtaining large-scale humanoid motion dataset, intelligently filtering out infeasible motion for the humanoid embodiment. - We train a full-body motion imitator (similar to PHC) and deploy to the real world zero-shot. - Using this framework, we enable real-time teleoperation of a humanoid via a human operator and webcam, performing skills such as pick and place, kicking, walking strollers, etc. Team: Tairan He Zhengyi “Zen” Luo Wenli Xiao @ChongZitaZhang Kris Kitani Changliu Liu Guanya Shi

Zhengyi “Zen” Luo

47,251 views • 2 years ago

VDM on his hometown: We can not use NGO money to develop our village. That money was not contributed only by the people of Edo State. We don’t do triba!ism, because I am a Nigerian - I am from every tribe.

VDM on his hometown: We can not use NGO money to develop our village. That money was not contributed only by the people of Edo State. We don’t do triba!ism, because I am a Nigerian - I am from every tribe.

ONLYVDMFAN

39,400 views • 2 months ago

To use some classic British understatement – my time in the UK has been quite eventful! Throughout it all, I have been deeply touched by the decency of the British people and immensely proud of the work we have done together.

To use some classic British understatement – my time in the UK has been quite eventful! Throughout it all, I have been deeply touched by the decency of the British people and immensely proud of the work we have done together.

Ambassador Warren Stephens

24,072 views • 1 year ago

Rakai actually stole five toothbrushes from the dentist after getting his braces done, and we all know he’s definitely not going to use any of them 😭

Rakai actually stole five toothbrushes from the dentist after getting his braces done, and we all know he’s definitely not going to use any of them 😭

Woody

21,407 views • 6 months ago

Develop your players ability to forecheck and avoid the forecheck using this keep-away activity. Insert this into any station-based practice or use pads in all of the circles to get your players a lot of reps.

Develop your players ability to forecheck and avoid the forecheck using this keep-away activity. Insert this into any station-based practice or use pads in all of the circles to get your players a lot of reps.

USA Hockey Coaches

16,791 views • 5 months ago

🎉 Our paper "PGC: Physics-Based Gaussian Cloth from a Single Pose" has been accepted to #CVPR2025! 👕 PGC uses a PBR + 3DGS representation to render simulation-ready garments under novel lighting and motion, all from a single static frame. ✨Web: 🧵1/4

🎉 Our paper "PGC: Physics-Based Gaussian Cloth from a Single Pose" has been accepted to #CVPR2025! 👕 PGC uses a PBR + 3DGS representation to render simulation-ready garments under novel lighting and motion, all from a single static frame. ✨Web: 🧵1/4

Michelle Guo

10,758 views • 1 year ago

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 views • 8 months ago

What are the different use cases of #CBDCs? Ripple's James Wallis, VP of Central Bank Engagements, gets this question all the time and breezes through a simple, 1-minute explanation of the three different categories of use cases. ⏱️ #CryptoInOneMinute

What are the different use cases of #CBDCs? Ripple's James Wallis, VP of Central Bank Engagements, gets this question all the time and breezes through a simple, 1-minute explanation of the three different categories of use cases. ⏱️ #CryptoInOneMinute

Ripple

230,289 views • 2 years ago

Russian propagandist Solovyev: "All European and American reasoning is based on the basic model of 'Russia will not use nuclear weapons.' That's why I'm sure we will see the use of nuclear weapons. Their rhetoric, by and large, makes it an almost inevitable scenario" Awful man

Russian propagandist Solovyev: "All European and American reasoning is based on the basic model of 'Russia will not use nuclear weapons.' That's why I'm sure we will see the use of nuclear weapons. Their rhetoric, by and large, makes it an almost inevitable scenario" Awful man

Anton Gerashchenko

163,721 views • 1 year ago

“22% of all the gold that’s ever been mined by humans has come from the Witwatersrand”. (The real number is closer to 50%)

“22% of all the gold that’s ever been mined by humans has come from the Witwatersrand”. (The real number is closer to 50%)

Sizwe SikaMusi

13,093 views • 5 months ago

On Thursday, the Fine Gael delegation will be rejecting the motion of censure and supporting the continuation of the current Commission, including Irish Commissioner Micheal McGrath. The motion has been tabled by right wing and far-right members of the Parliament in a bid to destabilise the EU for political gain. We urge all Irish MEPs to reject the motion.

On Thursday, the Fine Gael delegation will be rejecting the motion of censure and supporting the continuation of the current Commission, including Irish Commissioner Micheal McGrath. The motion has been tabled by right wing and far-right members of the Parliament in a bid to destabilise the EU for political gain. We urge all Irish MEPs to reject the motion.

Seán Kelly MEP

29,200 views • 11 months ago

German Chancellor Merz: We did not discuss any withdrawal of U.S. soldiers, nor any restriction on the use of military infrastructure maintained by the American armed forces in Germany. There are stationing agreements in place, and the federal government has no reason to doubt that the American forces have acted within the framework of these agreements in recent weeks.

German Chancellor Merz: We did not discuss any withdrawal of U.S. soldiers, nor any restriction on the use of military infrastructure maintained by the American armed forces in Germany. There are stationing agreements in place, and the federal government has no reason to doubt that the American forces have acted within the framework of these agreements in recent weeks.

Clash Report

58,907 views • 2 months ago

AOC to Pablo Manríquez: It is the responsibility of Congress to declare and authorize the use of military force. Congress has not authorized a military use of force. There has not been a case made, and I think the absence of one really speaks volumes.

AOC to Pablo Manríquez: It is the responsibility of Congress to declare and authorize the use of military force. Congress has not authorized a military use of force. There has not been a case made, and I think the absence of one really speaks volumes.

Acyn

47,148 views • 5 months ago