Loading video...

Video Failed to Load

Go Home

Any2Track: Galbot’s whole-body motion tracking system.

TheHumanoidHub's profile picture

The Humanoid Hub

115,709 subscribers

66,766 views • 10 months ago •via X (Twitter)

GamingScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Whole body motion tracking open source code:
1:24

Whole body motion tracking open source code:

Brian Roemmele

22,955 views • 5 months ago

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!
0:21

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Gloria - 3D artist 🪡✂️

18,107 views • 4 months ago

Sony's new motion tracking VR system brings you into the Metaverse
1:21

Sony's new motion tracking VR system brings you into the Metaverse

Mashable

11,091 views • 1 year ago

🚀 Looking forward to a foundtional humanoid motion tracker? 📢Meet Any2Track — Track Any Motions under Any Disturbances! 💡Any2Track shows SOTA performance on diverse motions under multiple disturbances. Project: Codebase:
1:58

🚀 Looking forward to a foundtional humanoid motion tracker? 📢Meet Any2Track — Track Any Motions under Any Disturbances! 💡Any2Track shows SOTA performance on diverse motions under multiple disturbances. Project: Codebase:

Zhikai Zhang

44,739 views • 11 months ago

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,515 views • 10 months ago

Congratulations to our NVIDIA Research team for SONIC being published in Science Magazine. 🦾 Built by NVIDIA Robotics researchers and collaborators, SONIC demonstrates scaling motion tracking for natural, robust humanoid whole-body control. Read the paper 📄
0:36

Congratulations to our NVIDIA Research team for SONIC being published in Science Magazine. 🦾 Built by NVIDIA Robotics researchers and collaborators, SONIC demonstrates scaling motion tracking for natural, robust humanoid whole-body control. Read the paper 📄

NVIDIA Robotics

51,626 views • 26 days ago

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 views • 1 year ago

Have you ever seen a customizable with such a huge range of motion?✨ This model can be used with full body tracking, but for those like me who only use face tracking, I developed a custom live2D animation system so that our customizable can move like our 2D counterparts! 🩷
0:46

Have you ever seen a customizable with such a huge range of motion?✨ This model can be used with full body tracking, but for those like me who only use face tracking, I developed a custom live2D animation system so that our customizable can move like our 2D counterparts! 🩷

Pastell & Palette🤍 3D Customizable Model!

30,092 views • 2 months ago

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:
1:45

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:

Adge

39,919 views • 11 months ago

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 views • 11 months ago

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming
0:36

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming

GingasVR

18,958 views • 1 month ago

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️
3:03

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️

Adge

93,393 views • 11 months ago

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐
1:30

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐

Yanjie Ze

80,079 views • 1 year ago

100 AI Directing Techniques - Cinematic Motion 01｜Tracking Motion Side Tracking · Matched Speed · Motion Blur · Foreground Wipe · Parallax · Handheld Breathing · Dynamic Light 02｜Opposing Motion Opposing Motion · Speed Contrast · Side Tracking · Sharp Subject · Background Streaks · Motion Blur 03｜Anchored Motion Anchored Subject · Vehicle Tracking · Moving Scenery · Near-Far Parallax · Motion Blur · Wind Interaction 04｜Locked-off Motion Locked-off Camera · Static Background · Slow Shutter · Motion Trails · Directional Blur · Still-Motion Contrast 05｜Still Subject Still Subject · Flowing Crowd · Locked-off Camera · Multi-directional Motion · Long Exposure · Foreground Occlusion · Temporal Contrast Use official invite code VIDUAIGUST1 to get 200 free credits, and become a director yourself.
1:08

100 AI Directing Techniques - Cinematic Motion 01｜Tracking Motion Side Tracking · Matched Speed · Motion Blur · Foreground Wipe · Parallax · Handheld Breathing · Dynamic Light 02｜Opposing Motion Opposing Motion · Speed Contrast · Side Tracking · Sharp Subject · Background Streaks · Motion Blur 03｜Anchored Motion Anchored Subject · Vehicle Tracking · Moving Scenery · Near-Far Parallax · Motion Blur · Wind Interaction 04｜Locked-off Motion Locked-off Camera · Static Background · Slow Shutter · Motion Trails · Directional Blur · Still-Motion Contrast 05｜Still Subject Still Subject · Flowing Crowd · Locked-off Camera · Multi-directional Motion · Long Exposure · Foreground Occlusion · Temporal Contrast Use official invite code VIDUAIGUST1 to get 200 free credits, and become a director yourself.

Vidu AI

947,073 views • 27 days ago

New Major #Eno3D Update out soon! More body customization, face tracking, implementation of suppression system, new clothing updates, and much more.
1:19

New Major #Eno3D Update out soon! More body customization, face tracking, implementation of suppression system, new clothing updates, and much more.

Hyeon (graymore+)

79,648 views • 12 days ago

The Biometric tracking system
0:21

The Biometric tracking system

Vision4theBlind

31,402 views • 1 year ago

jungkook playing with his new camera’s motion tracking ☝️
0:33

jungkook playing with his new camera’s motion tracking ☝️

ajk ⋆

16,505 views • 10 months ago

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.
0:27

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.

Tetsuya Ogata / 尾形哲也

42,928 views • 2 years ago