正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Any2Track: Galbot’s whole-body motion tracking system.

The Humanoid Hub

115,709 subscribers

66,766 次观看 • 10 个月前 •via X (Twitter)

游戏科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Whole body motion tracking open source code:

Whole body motion tracking open source code:

Brian Roemmele

22,955 次观看 • 5 个月前

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Gloria - 3D artist 🪡✂️

18,107 次观看 • 4 个月前

Sony's new motion tracking VR system brings you into the Metaverse

Sony's new motion tracking VR system brings you into the Metaverse

Mashable

11,091 次观看 • 1 年前

🚀 Looking forward to a foundtional humanoid motion tracker? 📢Meet Any2Track — Track Any Motions under Any Disturbances! 💡Any2Track shows SOTA performance on diverse motions under multiple disturbances. Project: Codebase:

🚀 Looking forward to a foundtional humanoid motion tracker? 📢Meet Any2Track — Track Any Motions under Any Disturbances! 💡Any2Track shows SOTA performance on diverse motions under multiple disturbances. Project: Codebase:

Zhikai Zhang

44,739 次观看 • 11 个月前

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,515 次观看 • 10 个月前

Congratulations to our NVIDIA Research team for SONIC being published in Science Magazine. 🦾 Built by NVIDIA Robotics researchers and collaborators, SONIC demonstrates scaling motion tracking for natural, robust humanoid whole-body control. Read the paper 📄

Congratulations to our NVIDIA Research team for SONIC being published in Science Magazine. 🦾 Built by NVIDIA Robotics researchers and collaborators, SONIC demonstrates scaling motion tracking for natural, robust humanoid whole-body control. Read the paper 📄

NVIDIA Robotics

51,626 次观看 • 26 天前

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 次观看 • 1 年前

Have you ever seen a customizable with such a huge range of motion?✨ This model can be used with full body tracking, but for those like me who only use face tracking, I developed a custom live2D animation system so that our customizable can move like our 2D counterparts! 🩷

Have you ever seen a customizable with such a huge range of motion?✨ This model can be used with full body tracking, but for those like me who only use face tracking, I developed a custom live2D animation system so that our customizable can move like our 2D counterparts! 🩷

Pastell & Palette🤍 3D Customizable Model!

30,092 次观看 • 2 个月前

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:

💥MOTION TRACKING IS IN PREMIERE💥 My motion tracking extension is now available for Premiere! 😎 Get it here:

Adge

39,919 次观看 • 11 个月前

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 次观看 • 11 个月前

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming

GingasVR

18,958 次观看 • 1 个月前

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️

🚨MOTION TRACKING IN PREMIERE 🚨 I made a motion tracking extension for Premiere. lmk whatchu guys think 🗣️🗣️🗣️

Adge

93,393 次观看 • 11 个月前

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐

🤖Introducing TWIST: Teleoperated Whole-Body Imitation System. We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network. This is our first step toward general-purpose robots. 🌐

Yanjie Ze

80,079 次观看 • 1 年前

100 AI Directing Techniques - Cinematic Motion 01｜Tracking Motion Side Tracking · Matched Speed · Motion Blur · Foreground Wipe · Parallax · Handheld Breathing · Dynamic Light 02｜Opposing Motion Opposing Motion · Speed Contrast · Side Tracking · Sharp Subject · Background Streaks · Motion Blur 03｜Anchored Motion Anchored Subject · Vehicle Tracking · Moving Scenery · Near-Far Parallax · Motion Blur · Wind Interaction 04｜Locked-off Motion Locked-off Camera · Static Background · Slow Shutter · Motion Trails · Directional Blur · Still-Motion Contrast 05｜Still Subject Still Subject · Flowing Crowd · Locked-off Camera · Multi-directional Motion · Long Exposure · Foreground Occlusion · Temporal Contrast Use official invite code VIDUAIGUST1 to get 200 free credits, and become a director yourself.

100 AI Directing Techniques - Cinematic Motion 01｜Tracking Motion Side Tracking · Matched Speed · Motion Blur · Foreground Wipe · Parallax · Handheld Breathing · Dynamic Light 02｜Opposing Motion Opposing Motion · Speed Contrast · Side Tracking · Sharp Subject · Background Streaks · Motion Blur 03｜Anchored Motion Anchored Subject · Vehicle Tracking · Moving Scenery · Near-Far Parallax · Motion Blur · Wind Interaction 04｜Locked-off Motion Locked-off Camera · Static Background · Slow Shutter · Motion Trails · Directional Blur · Still-Motion Contrast 05｜Still Subject Still Subject · Flowing Crowd · Locked-off Camera · Multi-directional Motion · Long Exposure · Foreground Occlusion · Temporal Contrast Use official invite code VIDUAIGUST1 to get 200 free credits, and become a director yourself.

Vidu AI

947,073 次观看 • 27 天前

New Major #Eno3D Update out soon! More body customization, face tracking, implementation of suppression system, new clothing updates, and much more.

New Major #Eno3D Update out soon! More body customization, face tracking, implementation of suppression system, new clothing updates, and much more.

Hyeon (graymore+)

79,648 次观看 • 12 天前

The Biometric tracking system

The Biometric tracking system

Vision4theBlind

31,402 次观看 • 1 年前

jungkook playing with his new camera’s motion tracking ☝️

jungkook playing with his new camera’s motion tracking ☝️

ajk ⋆

16,505 次观看 • 10 个月前

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.

Tetsuya Ogata / 尾形哲也

42,928 次观看 • 2 年前