Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Ever wonder how we got our humanoids to walk naturally using a motion tracker? Here is the secret: We have a world-class, game-engine-ready, real-time motion generator running under the hood! Graphics 🤝 Robotics Check out the full thread here 👇

zhengyiluo's profile picture

Zhengyi “Zen” Luo

6,223 subscribers

15,289 Aufrufe • vor 5 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

2 Kommentare

Profilbild von Kashu Yamazaki
Kashu Yamazakivor 5 Monaten

Awesome work 👌

Profilbild von Jakie PLA
Jakie PLAvor 5 Monaten

OH YES. 15k FPS at 2ms latency? This is the unicorn breakthrough for real-time robotics motion. Absolutely magical work.

Ähnliche Videos

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,782 Aufrufe • vor 11 Monaten

I just made the most expressive real-time motion harness for the Reachy Mini. It was created by: > synthesizing a massive motion dataset using Astra (over 10000 samples) > fine-tuning Qwen 3.5 4B using such dataset > then training a flow matching transformer head to transform sparse motion plan (<1hz) into dense expressive motion (25Hz) The average inference time for a full motion is less than 200ms, enabling real-time interaction. Pollen Robotics and Hugging Face only recorded 85 emotions for the reachy mini. With my work, you can now prompt and animate any motion you want. Everything is open-source; write-up and links attached below. Here is a video of Reachy explaining itself through my harness.
2:06

I just made the most expressive real-time motion harness for the Reachy Mini. It was created by: > synthesizing a massive motion dataset using Astra (over 10000 samples) > fine-tuning Qwen 3.5 4B using such dataset > then training a flow matching transformer head to transform sparse motion plan (<1hz) into dense expressive motion (25Hz) The average inference time for a full motion is less than 200ms, enabling real-time interaction. Pollen Robotics and Hugging Face only recorded 85 emotions for the reachy mini. With my work, you can now prompt and animate any motion you want. Everything is open-source; write-up and links attached below. Here is a video of Reachy explaining itself through my harness.

Binh

30,130 Aufrufe • vor 9 Tagen

here's how we did it and the open sourced HyperFrames code in thread 🧵 i did a quick screen recording as a quick explainer our open source framework &amp; motion graphics skills:
0:36

here's how we did it and the open sourced HyperFrames code in thread 🧵 i did a quick screen recording as a quick explainer our open source framework &amp; motion graphics skills:

Bin Liu

32,579 Aufrufe • vor 2 Monaten

We see a lot of slow motion Michael Jordan, here is what young Mike was doing to the league in real time speed 🔥 (fanofthegame TT)
0:54

We see a lot of slow motion Michael Jordan, here is what young Mike was doing to the league in real time speed 🔥 (fanofthegame TT)

Jacob

71,525 Aufrufe • vor 5 Monaten

With AI native video tools, the bar for motion graphics just got a lot higher. We made this using our free Tesseract plugin for ChatGPT, based on a single reference video.
0:33

With AI native video tools, the bar for motion graphics just got a lot higher. We made this using our free Tesseract plugin for ChatGPT, based on a single reference video.

Mirage

26,825 Aufrufe • vor 20 Tagen

Introducing Motionfly V2, the Claude for Launch videos. The first AI to pass the Motion Graphics Turing test We trained our harness with thousands of motion graphics videos. This video is one-shotted 1. The motion 2. The sound effects 3. The AI voiceovers We hidden a code for free credits somewhere in the video. Find it and Go to for early access.
0:30

Introducing Motionfly V2, the Claude for Launch videos. The first AI to pass the Motion Graphics Turing test We trained our harness with thousands of motion graphics videos. This video is one-shotted 1. The motion 2. The sound effects 3. The AI voiceovers We hidden a code for free credits somewhere in the video. Find it and Go to for early access.

Motionfly

11,928 Aufrufe • vor 6 Tagen

We see so many slow motion clips of Jordan, here is all footage in real time speed. We forgot Michael was a BLUR on the court 👀🔥 (Queztheplug IG)
1:01

We see so many slow motion clips of Jordan, here is all footage in real time speed. We forgot Michael was a BLUR on the court 👀🔥 (Queztheplug IG)

Jacob

64,388 Aufrufe • vor 2 Monaten

This is the best champions league game we played under Xavi. Crazy how we didn’t walk out with a win.
4:50

This is the best champions league game we played under Xavi. Crazy how we didn’t walk out with a win.

ELI LEE

514,341 Aufrufe • vor 4 Monaten

Here is the Full Video👇👇 We have to fight for our Country #citizenoutreach
1:18

Here is the Full Video👇👇 We have to fight for our Country #citizenoutreach

UMUKUNDWA Lilly

15,174 Aufrufe • vor 1 Jahr

In response to our motion to unimpound all of the discovery we have, Cosgrove introduced into evidence an article on Ratchet Madness. Here is the judges reaction.
0:27

In response to our motion to unimpound all of the discovery we have, Cosgrove introduced into evidence an article on Ratchet Madness. Here is the judges reaction.

Aidan Kearney

85,524 Aufrufe • vor 1 Jahr

Quantum threat: how long do we have? Quantus's Yuvi Lightman | Quantus highlights differing perspectives on how much time we have before the world's cryptography needs to be upgraded. Check out the full interview here:
0:31

Quantum threat: how long do we have? Quantus's Yuvi Lightman | Quantus highlights differing perspectives on how much time we have before the world's cryptography needs to be upgraded. Check out the full interview here:

Moby from Whale Coin Talk

21,461 Aufrufe • vor 5 Monaten

The time to release the 1871 thread is here. Who’s ready to find out we aren’t (weren’t) free. And I’ve got alllllllllll the corresponding government and congressional and treaty citations/sauce you can handle
2:46

The time to release the 1871 thread is here. Who’s ready to find out we aren’t (weren’t) free. And I’ve got alllllllllll the corresponding government and congressional and treaty citations/sauce you can handle

IET 17

310,944 Aufrufe • vor 3 Jahren

We have an amazing surprise! 😊♥️ We got to film with the wonderful Hearts2Hearts and we played a super fun game of Know or No! Check out the video here: #Hearts2Hearts #하츠투하츠 #H2H #STYLE #Hearts2Hearts_STYLE
0:44

We have an amazing surprise! 😊♥️ We got to film with the wonderful Hearts2Hearts and we played a super fun game of Know or No! Check out the video here: #Hearts2Hearts #하츠투하츠 #H2H #STYLE #Hearts2Hearts_STYLE

BuzzFeed UK

63,265 Aufrufe • vor 1 Jahr

Introduce HumanPlus - Shadowing part Humanoids are born for using human data. We build a real-time shadowing system using a single RGB camera and a whole-body policy for cloning human motion. Examples: - boxing🥊 - playing the piano🎹/ping pong - tossing - typing Open-sourced!
0:53

Introduce HumanPlus - Shadowing part Humanoids are born for using human data. We build a real-time shadowing system using a single RGB camera and a whole-body policy for cloning human motion. Examples: - boxing🥊 - playing the piano🎹/ping pong - tossing - typing Open-sourced!

Zipeng Fu

230,733 Aufrufe • vor 2 Jahren

Hey Cardano! Want to see Ouroboros-Leios working? We have a demo below. This is real, running code — not theory. Watch the full demo here 👇 #Cardano #Leios #Ouroboros #Treasury
7:16

Hey Cardano! Want to see Ouroboros-Leios working? We have a demo below. This is real, running code — not theory. Watch the full demo here 👇 #Cardano #Leios #Ouroboros #Treasury

Carlos Lopez de Lara

63,233 Aufrufe • vor 5 Monaten

Game results reflect practice habits. "We have got to understand - we win the games today. We win the games before we play them. Then you deserve to win. When we come in here, it's a plan to get ready to win the game."
0:25

Game results reflect practice habits. "We have got to understand - we win the games today. We win the games before we play them. Then you deserve to win. When we come in here, it's a plan to get ready to win the game."

The Winning Difference

42,186 Aufrufe • vor 1 Jahr

Over a million Sudanese refugees have fled to Chad. Aid is running out. Disease is spreading. And the world isn’t watching. On Talk to Al Jazeera, we ask: Is the humanitarian system collapsing in silence? Watch the full episode here:
0:52

Over a million Sudanese refugees have fled to Chad. Aid is running out. Disease is spreading. And the world isn’t watching. On Talk to Al Jazeera, we ask: Is the humanitarian system collapsing in silence? Watch the full episode here:

Talk to Al Jazeera

80,221 Aufrufe • vor 1 Jahr

If you're a camera wizard, then we have an awesome opportunity for you! We are hiring a full-time videographer/ photographer. To learn more, check out the listing here 👉
1:16

If you're a camera wizard, then we have an awesome opportunity for you! We are hiring a full-time videographer/ photographer. To learn more, check out the listing here 👉

Thermaltake ANZ

22,995 Aufrufe • vor 3 Jahren