Загрузка видео...

Не удалось загрузить видео

На главную

PHC has been accepted by ICCV 2023! We aim to develop a physics-based humanoid controller capable of imitating ALL of the motion from the AMASS dataset (almost there🧐), recover from failure state, does NOT use any external forces, all the while supporting real-time use cases!

zhengyiluo's profile picture

Zhengyi “Zen” Luo

5,834 subscribers

57,938 просмотров • 2 лет назад •via X (Twitter)

ОбразованиеНаука и технологииНовости и политика
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 8

Фото профиля Zhengyi “Zen” Luo
Zhengyi “Zen” Luo2 лет назад

Here is some imitation results👇🏻

Фото профиля Zhengyi “Zen” Luo
Zhengyi “Zen” Luo2 лет назад

Using output from MeTRAbs, PHC can be used to drive real-time simulated avatar from videos, an effect I long tried to achieved. PHC can stay robust to noisy input and recover from fail-state (as in the beginning of the video), and perpetually control a humanoid without reset.

Фото профиля Zhengyi “Zen” Luo
Zhengyi “Zen” Luo2 лет назад

Connecting with an off-the-shelf text-to-motion model (MDM in this demo), PHC can chain up multiple utterances and control a humanoid to perform these motion.

Фото профиля Zhengyi “Zen” Luo
Zhengyi “Zen” Luo2 лет назад

Code and trained models coming soon! Work done at @RealityLabs Pittsburgh. Much thanks to the team! @jinkuncao @awinkler_ @kkitani @xuweipeng000

Фото профиля Ye Yuan
Ye Yuan2 лет назад

See you in Paris 😉

Фото профиля はな
はな2 лет назад

Congrats!

Фото профиля Jin Cheng
Jin Cheng2 лет назад

Beautiful!!! Nice work!

Фото профиля shan_wen4
shan_wen42 лет назад

This guy must be a master of balance

Похожие видео

Why not use the real-world as a game level? This is a real-time augmented reality prototype using a physics based character controller, all running on the web 👀
0:30

Why not use the real-world as a game level? This is a real-time augmented reality prototype using a physics based character controller, all running on the web 👀

Ian Curtis

533,290 просмотров • 2 лет назад

A new humanoid robotics startup has emerged—not from China this time, but from the U.S.: Foundation Robotics. The company has recently acquired Florida-based Boardwalk Robotics and has been piloting the Phantom robot (previously named Alex at Boardwalk) in industrial use cases.
1:29

A new humanoid robotics startup has emerged—not from China this time, but from the U.S.: Foundation Robotics. The company has recently acquired Florida-based Boardwalk Robotics and has been piloting the Phantom robot (previously named Alex at Boardwalk) in industrial use cases.

The Humanoid Hub

140,712 просмотров • 1 год назад

The Senate has not removed any means of transmission. If you want to use a bicycle to carry your votes from one polling unit to the ward centre, do so. If you want to use your phone to transmit, do so. If you want to use your iPad, do so. All we said was that we should remove the word ‘real time,’ because if you say real time and there is grid failure and the network is not working, when you go to court somebody will say it ought to have been real time. That was what we said. We left the burden for INEC to determine the mode of transmission of votes. - Senate President Akpabio insists that the Senate did not remove electronic transmission of election results, clarifying that lawmakers only questioned the requirement for real-time transmission
2:49

The Senate has not removed any means of transmission. If you want to use a bicycle to carry your votes from one polling unit to the ward centre, do so. If you want to use your phone to transmit, do so. If you want to use your iPad, do so. All we said was that we should remove the word ‘real time,’ because if you say real time and there is grid failure and the network is not working, when you go to court somebody will say it ought to have been real time. That was what we said. We left the burden for INEC to determine the mode of transmission of votes. - Senate President Akpabio insists that the Senate did not remove electronic transmission of election results, clarifying that lawmakers only questioned the requirement for real-time transmission

Nigerian Affairs Journal

74,892 просмотров • 4 месяцев назад

Almost all the drones used by Russia in the war against Ukraine are from China. Russian Ministry of Finance Anton Siluanov stated this at a meeting of the State Duma Committee on Budget and Taxes. "Today, almost all drones are from China. We are also grateful to our partners for this. But we need to develop our own resource base, and the necessary money has been allocated," the Russian minister said.
0:34

Almost all the drones used by Russia in the war against Ukraine are from China. Russian Ministry of Finance Anton Siluanov stated this at a meeting of the State Duma Committee on Budget and Taxes. "Today, almost all drones are from China. We are also grateful to our partners for this. But we need to develop our own resource base, and the necessary money has been allocated," the Russian minister said.

Anton Gerashchenko

536,297 просмотров • 2 лет назад

Controller Flicking Without The Use Of Aim Assist
1:00

Controller Flicking Without The Use Of Aim Assist

Dynamic

65,992 просмотров • 6 месяцев назад

A magnet levitating between two bismuth crystals. Without the use of any external power source.🧐
0:21

A magnet levitating between two bismuth crystals. Without the use of any external power source.🧐

Bronze Giant

211,023 просмотров • 7 месяцев назад

🤔 Ever wondered if simulation-based animation/avatar learnings can be applied to real humanoid in real-time? 🤖 Introducing H2O (Human2HumanOid): - 🧠 An RL-based human-to-humanoid real-time whole-body teleoperation framework - 💃 Scalable retargeting and training using large human motion dataset - 🎥 With just an RGB camera, everyone can teleoperate a full-sized humanoid to perform actions like pick and place, walking, kicking, boxing, etc - 💡Unleash the potential of humanoids with human cognitive skills and adaptability 🔗: 📄: 🎬: H2O proposes: - A scalable retargeting framework for obtaining large-scale humanoid motion dataset, intelligently filtering out infeasible motion for the humanoid embodiment. - We train a full-body motion imitator (similar to PHC) and deploy to the real world zero-shot. - Using this framework, we enable real-time teleoperation of a humanoid via a human operator and webcam, performing skills such as pick and place, kicking, walking strollers, etc. Team: Tairan He Zhengyi “Zen” Luo Wenli Xiao @ChongZitaZhang Kris Kitani Changliu Liu Guanya Shi
1:15

🤔 Ever wondered if simulation-based animation/avatar learnings can be applied to real humanoid in real-time? 🤖 Introducing H2O (Human2HumanOid): - 🧠 An RL-based human-to-humanoid real-time whole-body teleoperation framework - 💃 Scalable retargeting and training using large human motion dataset - 🎥 With just an RGB camera, everyone can teleoperate a full-sized humanoid to perform actions like pick and place, walking, kicking, boxing, etc - 💡Unleash the potential of humanoids with human cognitive skills and adaptability 🔗: 📄: 🎬: H2O proposes: - A scalable retargeting framework for obtaining large-scale humanoid motion dataset, intelligently filtering out infeasible motion for the humanoid embodiment. - We train a full-body motion imitator (similar to PHC) and deploy to the real world zero-shot. - Using this framework, we enable real-time teleoperation of a humanoid via a human operator and webcam, performing skills such as pick and place, kicking, walking strollers, etc. Team: Tairan He Zhengyi “Zen” Luo Wenli Xiao @ChongZitaZhang Kris Kitani Changliu Liu Guanya Shi

Zhengyi “Zen” Luo

47,287 просмотров • 2 лет назад

To use some classic British understatement – my time in the UK has been quite eventful! Throughout it all, I have been deeply touched by the decency of the British people and immensely proud of the work we have done together.
1:30

To use some classic British understatement – my time in the UK has been quite eventful! Throughout it all, I have been deeply touched by the decency of the British people and immensely proud of the work we have done together.

Ambassador Warren Stephens

24,072 просмотров • 1 год назад

VDM on his hometown: We can not use NGO money to develop our village. That money was not contributed only by the people of Edo State. We don’t do triba!ism, because I am a Nigerian - I am from every tribe.
1:03

VDM on his hometown: We can not use NGO money to develop our village. That money was not contributed only by the people of Edo State. We don’t do triba!ism, because I am a Nigerian - I am from every tribe.

ONLYVDMFAN

39,400 просмотров • 2 месяцев назад

Rakai actually stole five toothbrushes from the dentist after getting his braces done, and we all know he’s definitely not going to use any of them 😭
0:23

Rakai actually stole five toothbrushes from the dentist after getting his braces done, and we all know he’s definitely not going to use any of them 😭

Woody

21,407 просмотров • 6 месяцев назад

🎉 Our paper "PGC: Physics-Based Gaussian Cloth from a Single Pose" has been accepted to #CVPR2025! 👕 PGC uses a PBR + 3DGS representation to render simulation-ready garments under novel lighting and motion, all from a single static frame. ✨Web: 🧵1/4
0:22

🎉 Our paper "PGC: Physics-Based Gaussian Cloth from a Single Pose" has been accepted to #CVPR2025! 👕 PGC uses a PBR + 3DGS representation to render simulation-ready garments under novel lighting and motion, all from a single static frame. ✨Web: 🧵1/4

Michelle Guo

10,795 просмотров • 1 год назад

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 просмотров • 9 месяцев назад

Develop your players ability to forecheck and avoid the forecheck using this keep-away activity. Insert this into any station-based practice or use pads in all of the circles to get your players a lot of reps.
0:24

Develop your players ability to forecheck and avoid the forecheck using this keep-away activity. Insert this into any station-based practice or use pads in all of the circles to get your players a lot of reps.

USA Hockey Coaches

16,791 просмотров • 6 месяцев назад

What are the different use cases of #CBDCs? Ripple's James Wallis, VP of Central Bank Engagements, gets this question all the time and breezes through a simple, 1-minute explanation of the three different categories of use cases. ⏱️ #CryptoInOneMinute
1:31

What are the different use cases of #CBDCs? Ripple's James Wallis, VP of Central Bank Engagements, gets this question all the time and breezes through a simple, 1-minute explanation of the three different categories of use cases. ⏱️ #CryptoInOneMinute

Ripple

230,294 просмотров • 2 лет назад

Russian propagandist Solovyev: "All European and American reasoning is based on the basic model of 'Russia will not use nuclear weapons.' That's why I'm sure we will see the use of nuclear weapons. Their rhetoric, by and large, makes it an almost inevitable scenario" Awful man
0:39

Russian propagandist Solovyev: "All European and American reasoning is based on the basic model of 'Russia will not use nuclear weapons.' That's why I'm sure we will see the use of nuclear weapons. Their rhetoric, by and large, makes it an almost inevitable scenario" Awful man

Anton Gerashchenko

163,721 просмотров • 1 год назад

“22% of all the gold that’s ever been mined by humans has come from the Witwatersrand”. (The real number is closer to 50%)
1:03

“22% of all the gold that’s ever been mined by humans has come from the Witwatersrand”. (The real number is closer to 50%)

Sizwe SikaMusi

13,093 просмотров • 6 месяцев назад

German Chancellor Merz: We did not discuss any withdrawal of U.S. soldiers, nor any restriction on the use of military infrastructure maintained by the American armed forces in Germany. There are stationing agreements in place, and the federal government has no reason to doubt that the American forces have acted within the framework of these agreements in recent weeks.
0:29

German Chancellor Merz: We did not discuss any withdrawal of U.S. soldiers, nor any restriction on the use of military infrastructure maintained by the American armed forces in Germany. There are stationing agreements in place, and the federal government has no reason to doubt that the American forces have acted within the framework of these agreements in recent weeks.

Clash Report

58,907 просмотров • 2 месяцев назад

On Thursday, the Fine Gael delegation will be rejecting the motion of censure and supporting the continuation of the current Commission, including Irish Commissioner Micheal McGrath. The motion has been tabled by right wing and far-right members of the Parliament in a bid to destabilise the EU for political gain. We urge all Irish MEPs to reject the motion.
2:07

On Thursday, the Fine Gael delegation will be rejecting the motion of censure and supporting the continuation of the current Commission, including Irish Commissioner Micheal McGrath. The motion has been tabled by right wing and far-right members of the Parliament in a bid to destabilise the EU for political gain. We urge all Irish MEPs to reject the motion.

Seán Kelly MEP

29,200 просмотров • 11 месяцев назад

AOC to Pablo Manríquez: It is the responsibility of Congress to declare and authorize the use of military force. Congress has not authorized a military use of force. There has not been a case made, and I think the absence of one really speaks volumes.
1:08

AOC to Pablo Manríquez: It is the responsibility of Congress to declare and authorize the use of military force. Congress has not authorized a military use of force. There has not been a case made, and I think the absence of one really speaks volumes.

Acyn

47,148 просмотров • 6 месяцев назад