Загрузка видео...

Не удалось загрузить видео

На главную

Any2Track: Galbot’s whole-body motion tracking system.

TheHumanoidHub's profile picture

The Humanoid Hub

85,103 subscribers

64,382 просмотров • 7 месяцев назад •via X (Twitter)

ИгрыНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Whole body motion tracking open source code:
1:24

Whole body motion tracking open source code:

Brian Roemmele

22,843 просмотров • 2 месяцев назад

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!
0:21

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Gloria - 3D artist 🪡✂️

18,107 просмотров • 1 месяц назад

Sony's new motion tracking VR system brings you into the Metaverse
1:21

Sony's new motion tracking VR system brings you into the Metaverse

Mashable

11,091 просмотров • 1 год назад

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

61,761 просмотров • 7 месяцев назад

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 просмотров • 1 год назад

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:
1:45

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:

Adge

39,650 просмотров • 8 месяцев назад

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 просмотров • 8 месяцев назад

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️
3:03

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️

Adge

92,321 просмотров • 8 месяцев назад

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:
2:42

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:

The Humanoid Hub

58,081 просмотров • 10 месяцев назад

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐
1:30

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐

Yanjie Ze

79,914 просмотров • 1 год назад

The Biometric tracking system
0:21

The Biometric tracking system

Vision4theBlind

30,935 просмотров • 1 год назад

jungkook playing with his new camera’s motion tracking ☝️
0:33

jungkook playing with his new camera’s motion tracking ☝️

ajk ⋆

16,505 просмотров • 7 месяцев назад

Multiple cars real-time tracking system
0:56

Multiple cars real-time tracking system

Ranbir Singh

24,183 просмотров • 3 месяцев назад

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:
3:05

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:

UploadVR

80,338 просмотров • 6 месяцев назад

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.
1:08

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.

The Humanoid Hub

38,155 просмотров • 1 год назад

Can robots leverage their entire body to sense and interact with their environment, rather than just relying on a centralized camera and end-effector? Introducing RoboPanoptes, a robot system that achieves whole-body dexterity through whole-body vision.
0:34

Can robots leverage their entire body to sense and interact with their environment, rather than just relying on a centralized camera and end-effector? Introducing RoboPanoptes, a robot system that achieves whole-body dexterity through whole-body vision.

Xiaomeng Xu

76,347 просмотров • 1 год назад

Any2Track tracks diverse motions under various disturbances. The two-stage RL framework learns to track contact-rich human motions from motion capture datasets and adds adaptability to disturbances via dynamics-aware model prediction.
1:19

Any2Track tracks diverse motions under various disturbances. The two-stage RL framework learns to track contact-rich human motions from motion capture datasets and adds adaptability to disturbances via dynamics-aware model prediction.

The Humanoid Hub

144,422 просмотров • 8 месяцев назад

Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST). video with 🔊
0:32

Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST). video with 🔊

Yanjie Ze

88,183 просмотров • 10 месяцев назад

Low budget chair tracking test (using PICO 4 Pro + PICO motion tracker x2)
1:08

Low budget chair tracking test (using PICO 4 Pro + PICO motion tracker x2)

모래캣 🐱🛸 :: 외계 고양이 VTuber

10,324 просмотров • 5 месяцев назад