Loading video...

Video Failed to Load

Go Home

Any2Track: Galbot’s whole-body motion tracking system.

TheHumanoidHub's profile picture

The Humanoid Hub

85,103 subscribers

64,382 views • 7 months ago •via X (Twitter)

GamingScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Whole body motion tracking open source code:
1:24

Whole body motion tracking open source code:

Brian Roemmele

22,849 views • 2 months ago

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!
0:21

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Gloria - 3D artist 🪡✂️

18,107 views • 1 month ago

Sony's new motion tracking VR system brings you into the Metaverse
1:21

Sony's new motion tracking VR system brings you into the Metaverse

Mashable

11,091 views • 1 year ago

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

61,821 views • 7 months ago

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 views • 1 year ago

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:
1:45

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:

Adge

39,650 views • 8 months ago

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 views • 8 months ago

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️
3:03

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️

Adge

92,777 views • 8 months ago

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:
2:42

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:

The Humanoid Hub

58,081 views • 10 months ago

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐
1:30

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐

Yanjie Ze

79,914 views • 1 year ago

The Biometric tracking system
0:21

The Biometric tracking system

Vision4theBlind

30,935 views • 1 year ago

jungkook playing with his new camera’s motion tracking ☝️
0:33

jungkook playing with his new camera’s motion tracking ☝️

ajk ⋆

16,505 views • 7 months ago

Multiple cars real-time tracking system
0:56

Multiple cars real-time tracking system

Ranbir Singh

24,183 views • 3 months ago

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:
3:05

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:

UploadVR

80,338 views • 6 months ago

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.
1:08

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.

The Humanoid Hub

38,155 views • 1 year ago

Can robots leverage their entire body to sense and interact with their environment, rather than just relying on a centralized camera and end-effector? Introducing RoboPanoptes, a robot system that achieves whole-body dexterity through whole-body vision.
0:34

Can robots leverage their entire body to sense and interact with their environment, rather than just relying on a centralized camera and end-effector? Introducing RoboPanoptes, a robot system that achieves whole-body dexterity through whole-body vision.

Xiaomeng Xu

76,347 views • 1 year ago

Any2Track tracks diverse motions under various disturbances. The two-stage RL framework learns to track contact-rich human motions from motion capture datasets and adds adaptability to disturbances via dynamics-aware model prediction.
1:19

Any2Track tracks diverse motions under various disturbances. The two-stage RL framework learns to track contact-rich human motions from motion capture datasets and adds adaptability to disturbances via dynamics-aware model prediction.

The Humanoid Hub

144,422 views • 8 months ago

Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST). video with 🔊
0:32

Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST). video with 🔊

Yanjie Ze

88,183 views • 10 months ago

Low budget chair tracking test (using PICO 4 Pro + PICO motion tracker x2)
1:08

Low budget chair tracking test (using PICO 4 Pro + PICO motion tracker x2)

모래캣 🐱🛸 :: 외계 고양이 VTuber

10,324 views • 5 months ago