Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Any2Track: Galbot’s whole-body motion tracking system.

TheHumanoidHub's profile picture

The Humanoid Hub

110,614 subscribers

66,724 görüntüleme • 8 ay önce •via X (Twitter)

OyunBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Whole body motion tracking open source code:
1:24

Whole body motion tracking open source code:

Brian Roemmele

22,861 görüntüleme • 4 ay önce

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!
0:21

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Gloria - 3D artist 🪡✂️

18,107 görüntüleme • 2 ay önce

Sony's new motion tracking VR system brings you into the Metaverse
1:21

Sony's new motion tracking VR system brings you into the Metaverse

Mashable

11,091 görüntüleme • 1 yıl önce

🚀 Looking forward to a foundtional humanoid motion tracker? 📢Meet Any2Track — Track Any Motions under Any Disturbances! 💡Any2Track shows SOTA performance on diverse motions under multiple disturbances. Project: Codebase:
1:58

🚀 Looking forward to a foundtional humanoid motion tracker? 📢Meet Any2Track — Track Any Motions under Any Disturbances! 💡Any2Track shows SOTA performance on diverse motions under multiple disturbances. Project: Codebase:

Zhikai Zhang

44,386 görüntüleme • 10 ay önce

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,040 görüntüleme • 8 ay önce

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 görüntüleme • 1 yıl önce

Have you ever seen a customizable with such a huge range of motion?✨ This model can be used with full body tracking, but for those like me who only use face tracking, I developed a custom live2D animation system so that our customizable can move like our 2D counterparts! 🩷
0:46

Have you ever seen a customizable with such a huge range of motion?✨ This model can be used with full body tracking, but for those like me who only use face tracking, I developed a custom live2D animation system so that our customizable can move like our 2D counterparts! 🩷

Pastell & Palette🤍 3D Customizable Model!

29,611 görüntüleme • 20 gün önce

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:
1:45

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:

Adge

39,757 görüntüleme • 9 ay önce

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 görüntüleme • 10 ay önce

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming
0:36

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming

GingasVR

18,037 görüntüleme • 7 gün önce

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️
3:03

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️

Adge

93,033 görüntüleme • 10 ay önce

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:
2:42

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:

The Humanoid Hub

58,081 görüntüleme • 11 ay önce

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐
1:30

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐

Yanjie Ze

79,978 görüntüleme • 1 yıl önce

The Biometric tracking system
0:21

The Biometric tracking system

Vision4theBlind

30,935 görüntüleme • 1 yıl önce

jungkook playing with his new camera’s motion tracking ☝️
0:33

jungkook playing with his new camera’s motion tracking ☝️

ajk ⋆

16,505 görüntüleme • 8 ay önce

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.
0:27

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.

Tetsuya Ogata / 尾形哲也

42,928 görüntüleme • 2 yıl önce

Multiple cars real-time tracking system
0:56

Multiple cars real-time tracking system

Ranbir Singh

24,210 görüntüleme • 5 ay önce

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:
3:05

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:

UploadVR

80,338 görüntüleme • 7 ay önce

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.
1:08

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.

The Humanoid Hub

38,155 görüntüleme • 1 yıl önce