Loading video...

Video Failed to Load

Go Home

A touch-aware humanoid manipulation policy that cleans the lab for you🧹🧪 Introducing Humanoid Touch Dream: a real-world system for dexterous, contact-rich humanoid loco-manipulation. Our key idea is simple: the policy predicts future hand forces and tactile latents alongside actions, within a single-stage training framework. 1/7

yaru_niu's profile picture

Yaru Niu

1,032 subscribers

69,795 views • 2 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Sanctuary AI is setting the stage for more ‘dexterous and versatile’ humanoid robots with its latest breakthrough: in-hand manipulation.
0:31

Sanctuary AI is setting the stage for more ‘dexterous and versatile’ humanoid robots with its latest breakthrough: in-hand manipulation.

TechCrunch

32,660 views • 1 year ago

We visited Paxini in Shenzhen, a company focused on the sense of touch for robots. We got hands-on with their dual-modal Dexter Hands (cameras + tactile sensors) and their Tora Double One humanoid. Humanoid robots will need this touch layer to get truly dexterous. Lena RoboHub🤖
6:50

We visited Paxini in Shenzhen, a company focused on the sense of touch for robots. We got hands-on with their dual-modal Dexter Hands (cameras + tactile sensors) and their Tora Double One humanoid. Humanoid robots will need this touch layer to get truly dexterous. Lena RoboHub🤖

The Humanoid Hub

22,782 views • 5 days ago

Humanoids need a single, generalist control policy for all of their physical tasks, not a new one for every new chore or demo. A policy for walking can't dance. A policy for dancing can't support mowing the lawn. We need to scale up humanoid control for diverse behaviors, just like we did with language and video models. Watch this humanoid, supported by a single control policy, to start its day, mow the lawn, jog, dance, and even hold the elevator for a colleague. This is the "System 1" for humanoids—a robust, natural humanoid controller that will support general-purpose autonomy. Project Page: #Robotics #AI #NVIDIA #SONIC #FoundationModel 🤖🔥
1:33

Humanoids need a single, generalist control policy for all of their physical tasks, not a new one for every new chore or demo. A policy for walking can't dance. A policy for dancing can't support mowing the lawn. We need to scale up humanoid control for diverse behaviors, just like we did with language and video models. Watch this humanoid, supported by a single control policy, to start its day, mow the lawn, jog, dance, and even hold the elevator for a colleague. This is the "System 1" for humanoids—a robust, natural humanoid controller that will support general-purpose autonomy. Project Page: #Robotics #AI #NVIDIA #SONIC #FoundationModel 🤖🔥

Zhengyi “Zen” Luo

15,851 views • 7 months ago

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.
1:44

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.

The Humanoid Hub

63,226 views • 1 year ago

Time to democratize humanoid robots! Introducing ToddlerBot, a low-cost ($6K), open-source humanoid for robotics and AI research. Watch two ToddlerBots seamlessly chain their loco-manipulation skills to collaborate in tidying up after a toy session.
1:18

Time to democratize humanoid robots! Introducing ToddlerBot, a low-cost ($6K), open-source humanoid for robotics and AI research. Watch two ToddlerBots seamlessly chain their loco-manipulation skills to collaborate in tidying up after a toy session.

Haochen Shi

113,486 views • 1 year ago

ViTacFormer is a unified visuo-tactile framework for dexterous robot manipulation. It fuses high-res visual+tactile data using cross-attention and predicts future tactile signals via an autoregressive head, enabling multi-fingered hands to perform precise, long-horizon tasks.
2:18

ViTacFormer is a unified visuo-tactile framework for dexterous robot manipulation. It fuses high-res visual+tactile data using cross-attention and predicts future tactile signals via an autoregressive head, enabling multi-fingered hands to perform precise, long-horizon tasks.

The Humanoid Hub

10,816 views • 1 year ago

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D
0:20

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D

Toru

49,561 views • 1 year ago

Another day, another humanoid robot from china AGIBOT introduces GO-1, a generalist foundation model that integrates a vision-language model with a latent planner for enhanced long-horizon and dexterous manipulation.
3:46

Another day, another humanoid robot from china AGIBOT introduces GO-1, a generalist foundation model that integrates a vision-language model with a latent planner for enhanced long-horizon and dexterous manipulation.

Chubby♨️

23,513 views • 1 year ago

Humanoid Long Jump. The G1 humanoid from Unitree Robotics has completed a long jump of 1.4 meters - possibly the longest jump ever achieved by a humanoid robot of its size in the world, standing only 1.32 meters tall. The G1 has up to 43 joint motors and a dexterous three-fingered hand, designed for precise manipulation and AI research. Priced from $16,000, it features robust Sim2Real capabilities, making it a compelling choice for robotics developers.
0:45

Humanoid Long Jump. The G1 humanoid from Unitree Robotics has completed a long jump of 1.4 meters - possibly the longest jump ever achieved by a humanoid robot of its size in the world, standing only 1.32 meters tall. The G1 has up to 43 joint motors and a dexterous three-fingered hand, designed for precise manipulation and AI research. Priced from $16,000, it features robust Sim2Real capabilities, making it a compelling choice for robotics developers.

Circuit

26,485 views • 1 year ago

We just released TAVI -- a robotics framework that combines touch and vision to solve challenging dexterous tasks in under 1 hour. The key? Use human demonstrations to initialize a policy, followed by tactile-based online learning with vision-based rewards. Details in🧵(1/7)
0:35

We just released TAVI -- a robotics framework that combines touch and vision to solve challenging dexterous tasks in under 1 hour. The key? Use human demonstrations to initialize a policy, followed by tactile-based online learning with vision-based rewards. Details in🧵(1/7)

Lerrel Pinto

138,536 views • 2 years ago

Introduce OmniH2O, a learning-based system for whole-body humanoid teleop and autonomy: 🦾Robust loco-mani policy 🦸Universal teleop interface: VR, verbal, RGB 🧠Autonomy via ShitposterAI or imitation 🔗Release the first whole-body humanoid dataset
2:06

Introduce OmniH2O, a learning-based system for whole-body humanoid teleop and autonomy: 🦾Robust loco-mani policy 🦸Universal teleop interface: VR, verbal, RGB 🧠Autonomy via ShitposterAI or imitation 🔗Release the first whole-body humanoid dataset

Tairan He

130,032 views • 2 years ago

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:
3:13

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Siyuan Huang

21,892 views • 8 months ago

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:
0:20

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

165,502 views • 1 month ago

Let’s think about humanoid robots outside carrying the box. How about having the humanoid come out the door, interact with humans, and even dance? Introducing Expressive Whole-Body Control for Humanoid Robots: See how our robot performs rich, diverse, and expressive motions in the real world 👇🧵
2:37

Let’s think about humanoid robots outside carrying the box. How about having the humanoid come out the door, interact with humans, and even dance? Introducing Expressive Whole-Body Control for Humanoid Robots: See how our robot performs rich, diverse, and expressive motions in the real world 👇🧵

Xiaolong Wang

309,104 views • 2 years ago

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 views • 9 months ago

Sanctuary AI announced the integration of new tactile sensors into its Phoenix humanoid robot, enhancing its dexterity for fine manipulation. The combination of touch and haptic servoing provides richer data, enabling blind picking, slippage detection, and better force control.
2:37

Sanctuary AI announced the integration of new tactile sensors into its Phoenix humanoid robot, enhancing its dexterity for fine manipulation. The combination of touch and haptic servoing provides richer data, enabling blind picking, slippage detection, and better force control.

The Humanoid Hub

51,910 views • 1 year ago

🤖 How can we scale up humanoid robot learning? Introducing 🌟VLK🌟: generating large-scale synthetic data with paired egocentric observations, text, and full-body G1 kinematics for learning humanoid loco-manipulation. No teleoperation needed! Website:
0:23

🤖 How can we scale up humanoid robot learning? Introducing 🌟VLK🌟: generating large-scale synthetic data with paired egocentric observations, text, and full-body G1 kinematics for learning humanoid loco-manipulation. No teleoperation needed! Website:

Jiaman Li

960,306 views • 4 days ago

Most of today's AI can see the world, but it doesn’t **feel** it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:
0:24

Most of today's AI can see the world, but it doesn’t **feel** it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Paul Liang

47,158 views • 2 months ago

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: Paper link: Github:
3:55

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: Paper link: Github:

Haoran Geng

95,196 views • 1 year ago

Humanoid robot transforms into a Thanksgiving chef and household butler 👩‍🍳 Of course, these close-ups showcase Sahrpa's dexterous hands and highly flexible, precise manipulation abilities, just like a real human.
1:18

Humanoid robot transforms into a Thanksgiving chef and household butler 👩‍🍳 Of course, these close-ups showcase Sahrpa's dexterous hands and highly flexible, precise manipulation abilities, just like a real human.

CyberRobo

19,632 views • 7 months ago