Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger... show more

Jiaman Li

1,558 subscribers

104,880 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie Gesundheit & Wellness Bildung

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Michael Black

Michael Blackvor 1 Jahr

Great work!

Profilbild von Jiaman Li

Jiaman Livor 1 Jahr

Thank you!

Profilbild von AssemblyAI

AssemblyAIvor 2 Jahren

Announcing: Our most advanced speech-to-text model goes beyond accuracy to capture the real-world complexity of human conversation and deliver reliable, source-of-truth audio data. Explore Universal-2 updates 👇

Profilbild von The Highly Automated Cat — e/acc ⏩

The Highly Automated Cat — e/acc ⏩vor 1 Jahr

in the future we will all be playing w doll houses

Profilbild von Johnny Núñez

Johnny Núñezvor 1 Jahr

omg it is really cool! I love it

Profilbild von Abhinav Girdhar

Abhinav Girdharvor 1 Jahr

Incredible advancement! Human-object interaction driven by human-level instructions is a huge leap forward. Excited to see how this multi-stage framework reshapes AI applications in realistic simulations!

Profilbild von satheesh kola

satheesh kolavor 1 Jahr

Great work!

Profilbild von satheesh kola

satheesh kolavor 1 Jahr

Loved it!

Profilbild von Patrick Kwon

Patrick Kwonvor 1 Jahr

Amazing!

Profilbild von Nicolas Keller

Nicolas Kellervor 1 Jahr

This looks amazing! :)

Profilbild von MichaelS

MichaelSvor 1 Jahr

Super cool👏👏👏

Ähnliche Videos

New study introduces a system to generate realistic, physically plausible human-object interactions from natural language instructions. It uses LLMs for planning, a motion generator for synchronized body and finger movements, and RL for physical accuracy.

New study introduces a system to generate realistic, physically plausible human-object interactions from natural language instructions. It uses LLMs for planning, a motion generator for synchronized body and finger movements, and RL for physical accuracy.

The Humanoid Hub

27,606 Aufrufe • vor 1 Jahr

Any2Track tracks diverse motions under various disturbances. The two-stage RL framework learns to track contact-rich human motions from motion capture datasets and adds adaptability to disturbances via dynamics-aware model prediction.

Any2Track tracks diverse motions under various disturbances. The two-stage RL framework learns to track contact-rich human motions from motion capture datasets and adds adaptability to disturbances via dynamics-aware model prediction.

The Humanoid Hub

146,181 Aufrufe • vor 1 Jahr

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Angela Dai

12,487 Aufrufe • vor 5 Monaten

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with physics-in-the-loop that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

15,631 Aufrufe • vor 7 Monaten

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

The Humanoid Hub

17,395 Aufrufe • vor 1 Jahr

RobotMDM, by Disney Research, combines diffusion-based motion generation with RL to produce physics-aware humanoid motions from text prompts. Trained on human motion data with a reward surrogate for physical feasibility, it ensures realistic motions.

RobotMDM, by Disney Research, combines diffusion-based motion generation with RL to produce physics-aware humanoid motions from text prompts. Trained on human motion data with a reward surrogate for physical feasibility, it ensures realistic motions.

The Humanoid Hub

22,943 Aufrufe • vor 2 Jahren

PAMI Part Anchored Motion for Text to Human-Object Interaction Generation paper:

PAMI Part Anchored Motion for Text to Human-Object Interaction Generation paper:

AK

20,327 Aufrufe • vor 16 Tagen

HumanX: a scalable framework that converts single monocular human videos into agile, generalizable interaction skills for humanoid robots without task-specific rewards. Core parts: - XGen: retargets human motion + synthesizes diverse physically plausible training data (via physics-driven object trajectories and augmentation). - XMimic: unified imitation pipeline for robust generalization. Shows promising results for both Blind (no external sensors) and MoCap modes.

HumanX: a scalable framework that converts single monocular human videos into agile, generalizable interaction skills for humanoid robots without task-specific rewards. Core parts: - XGen: retargets human motion + synthesizes diverse physically plausible training data (via physics-driven object trajectories and augmentation). - XMimic: unified imitation pipeline for robust generalization. Shows promising results for both Blind (no external sensors) and MoCap modes.

The Humanoid Hub

20,358 Aufrufe • vor 8 Monaten

Humanoid motion tracking performance is greatly determined by retargeting quality! Introducing 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁🎯, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with 𝗺𝗶𝗻𝗶𝗺𝗮𝗹 RL: - 5 rewards, - 4 DR terms, - Proprio. ONLY, - NO history/curriculum. Ready for agile, human-like 🤖? (Best with 🎧) 🔗 🎥 1/9

Humanoid motion tracking performance is greatly determined by retargeting quality! Introducing 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁🎯, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with 𝗺𝗶𝗻𝗶𝗺𝗮𝗹 RL: - 5 rewards, - 4 DR terms, - Proprio. ONLY, - NO history/curriculum. Ready for agile, human-like 🤖? (Best with 🎧) 🔗 🎥 1/9

Zhen Wu

829,318 Aufrufe • vor 1 Jahr

We are releasing EgoHTR, a dataset with both human motions and terrain references, accepted Conference on Robot Learning. 📖 Paper: 🌐 Project Page: • 55 scene-aligned sequences • 150k+ frames • rough-terrain environments • multi-modal 3D scene

We are releasing EgoHTR, a dataset with both human motions and terrain references, accepted Conference on Robot Learning. 📖 Paper: 🌐 Project Page: • 55 scene-aligned sequences • 150k+ frames • rough-terrain environments • multi-modal 3D scene

Robotic Systems Lab

11,914 Aufrufe • vor 1 Monat

🚀🚀🚀 Ever wondered what it takes for robots to handle real-world household tasks? long-horizon execution, deformable object dexterity, and unseen object generalization — meet GR-3, ByteDance Seed’s new Vision-Language-Action (VLA) model! GR-3 is a generalizable Vision-Language-Action (VLA) model with strong capabilities in complex long-horizon tasks. It understands unseen abstract concepts, manipulates deformable objects robustly, and adapts to novel settings with minimal human data. ✨ Generalization: Generalizes well to unseen objects, environments, and even instructions with abstract concepts. ✨ Long-Horizon Manipulation: Completes long-horizon tasks with strong instruction-following capabilities. ✨ Deformable Object Manipulation: Manipulate deformable objects robustly. Project Page: Arxiv: #ByteDance #ByteDanceSeed #GR3 #VLA #Robotics #FoundationModels

🚀🚀🚀 Ever wondered what it takes for robots to handle real-world household tasks? long-horizon execution, deformable object dexterity, and unseen object generalization — meet GR-3, ByteDance Seed’s new Vision-Language-Action (VLA) model! GR-3 is a generalizable Vision-Language-Action (VLA) model with strong capabilities in complex long-horizon tasks. It understands unseen abstract concepts, manipulates deformable objects robustly, and adapts to novel settings with minimal human data. ✨ Generalization: Generalizes well to unseen objects, environments, and even instructions with abstract concepts. ✨ Long-Horizon Manipulation: Completes long-horizon tasks with strong instruction-following capabilities. ✨ Deformable Object Manipulation: Manipulate deformable objects robustly. Project Page: Arxiv: #ByteDance #ByteDanceSeed #GR3 #VLA #Robotics #FoundationModels

Xiao Ma

46,426 Aufrufe • vor 1 Jahr

Alert🚨 This could be by far the most impressive video about 4D human motion generation! 🔥🔥🔥 We present TRUMANS, a pioneering and solid effort that scales up 4D human-scene interactions with both static and dynamic objects. With our model, we could eventually generate diverse and physically plausible human motions of any length in the physical 3D world. Cannot stop to wonder how TRUMANS could be adapted to the humanoid robot. Let me know if you are interested! Our paper has been accepted by CVPR24; check our code, demo, and more details in

Alert🚨 This could be by far the most impressive video about 4D human motion generation! 🔥🔥🔥 We present TRUMANS, a pioneering and solid effort that scales up 4D human-scene interactions with both static and dynamic objects. With our model, we could eventually generate diverse and physically plausible human motions of any length in the physical 3D world. Cannot stop to wonder how TRUMANS could be adapted to the humanoid robot. Let me know if you are interested! Our paper has been accepted by CVPR24; check our code, demo, and more details in

Siyuan Huang

13,689 Aufrufe • vor 2 Jahren

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Siyuan Huang

22,105 Aufrufe • vor 1 Jahr

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 Aufrufe • vor 1 Jahr

How to learn dexterous manipulation for any robot hand from a single human demonstration? Check out DexMachina, our new RL algorithm that learns long-horizon, bimanual dexterous policies for a variety of dexterous hands, articulated objects, and complex motions.

How to learn dexterous manipulation for any robot hand from a single human demonstration? Check out DexMachina, our new RL algorithm that learns long-horizon, bimanual dexterous policies for a variety of dexterous hands, articulated objects, and complex motions.

Mandi Zhao

121,807 Aufrufe • vor 1 Jahr

Pen spinning is a classic test of human finger dexterity. WUJI just trained a robot hand to do it. Their sim-to-real policy, trained entirely in simulation, spins a pen on a physical WUJI Hand 2. At IROS 2026 they also showed glove-based teleoperation, a human driving the hand's motions live. Two paths to dexterity: learn it in sim, or lend it from a human.

Pen spinning is a classic test of human finger dexterity. WUJI just trained a robot hand to do it. Their sim-to-real policy, trained entirely in simulation, spins a pen on a physical WUJI Hand 2. At IROS 2026 they also showed glove-based teleoperation, a human driving the hand's motions live. Two paths to dexterity: learn it in sim, or lend it from a human.

The Humanoid Hub

30,699 Aufrufe • vor 13 Tagen

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

73,877 Aufrufe • vor 4 Monaten