Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with physics-in-the-loop that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

13,622 subscribers

15,639 views • 7 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

1 Comments

Carolina7 months ago

Nice to see progress bridging perception and simulation for human-scene work. How scalable is the pipeline for diverse environments?

Related Videos

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

Jiaman Li

104,880 views • 1 year ago

Your Blender scenes just got an upgrade. 🤖 NVIDIA Omniverse libraries are now part of NVIDIA Agent Toolkit, so AI agents can handle physics, sensor behavior, and scene checks right inside Blender, helping you take your 3D worlds from visually complete to simulation ready. Watch now 👉

Your Blender scenes just got an upgrade. 🤖 NVIDIA Omniverse libraries are now part of NVIDIA Agent Toolkit, so AI agents can handle physics, sensor behavior, and scene checks right inside Blender, helping you take your 3D worlds from visually complete to simulation ready. Watch now 👉

NVIDIA Omniverse

32,023 views • 3 months ago

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗

Haoyang Weng

137,006 views • 1 year ago

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

Ziwei Liu

26,953 views • 1 year ago

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

73,877 views • 4 months ago

📢📢📢 Excited to share our ICLR25 work, ArtGS, which can reconstruct articulated objects and scenes from human-scene interactions. 💻🖱️🧱🪑📖 Understanding physics and articulation is extremely important. With ArtGS, we can build a digital and simulatable replica of the real 3D world with minimal human effort!

📢📢📢 Excited to share our ICLR25 work, ArtGS, which can reconstruct articulated objects and scenes from human-scene interactions. 💻🖱️🧱🪑📖 Understanding physics and articulation is extremely important. With ArtGS, we can build a digital and simulatable replica of the real 3D world with minimal human effort!

Siyuan Huang

12,833 views • 1 year ago

🕸️ Introducing SPIDER — Scalable Physics-Informed Dexterous Retargeting! A dynamically feasible, cross-embodiment retargeting framework for BOTH humanoids 🤖 and dexterous hands ✋. From human motion → sim → real robots, at scale. 🔗 Website: 🧵 1/n

🕸️ Introducing SPIDER — Scalable Physics-Informed Dexterous Retargeting! A dynamically feasible, cross-embodiment retargeting framework for BOTH humanoids 🤖 and dexterous hands ✋. From human motion → sim → real robots, at scale. 🔗 Website: 🧵 1/n

Chaoyi Pan

66,077 views • 11 months ago

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.

Angela Dai

107,013 views • 2 years ago

🤖WATCH: DO YOU SEE BOYS OR ROBOTS? It’s in the way they move, play and goof around. With every human-like moment, HUMANOIDS inch closer to winning human hearts.

🤖WATCH: DO YOU SEE BOYS OR ROBOTS? It’s in the way they move, play and goof around. With every human-like moment, HUMANOIDS inch closer to winning human hearts.

Coin Bureau

19,387 views • 4 months ago

Wow! We just put a human-in-the-loop within ChatGPT. ❤️🤖

Wow! We just put a human-in-the-loop within ChatGPT. ❤️🤖

Marc Benioff

105,057 views • 11 months ago

Physics simulation gives robots a place to learn before they enter the physical world. 🤖 Developers can model complex interactions, train and evaluate policies, and validate robot behavior in controlled virtual environments before deployment. Explore physics simulation for robotics 🔗

Physics simulation gives robots a place to learn before they enter the physical world. 🤖 Developers can model complex interactions, train and evaluate policies, and validate robot behavior in controlled virtual environments before deployment. Explore physics simulation for robotics 🔗

NVIDIA Robotics

28,742 views • 1 month ago

2025. The year humans trained robots. 🤖 70,000+ teleop sessions 🤖 Nearly 5,000 hours of real human-in-the-loop work 🤖 1.2M+ app members This is PrismaX Wrapped 2025.

2025. The year humans trained robots. 🤖 70,000+ teleop sessions 🤖 Nearly 5,000 hours of real human-in-the-loop work 🤖 1.2M+ app members This is PrismaX Wrapped 2025.

PrismaX

54,672 views • 10 months ago

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

Hao Zhao

52,630 views • 2 months ago

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Siyuan Huang

22,105 views • 1 year ago

Lucida from ByteDance Cool project! It transforms indoor video into editable 3D scenes; reconstructs objects as simulation-ready assets - VLM-based object detection and referring descriptions. - good at pose alignment - high-fidelity real-to-sim digital twins. - multi-view masks, boxes, partial point clouds - Seed3D 2.0 for image-to-3D asset gen

Lucida from ByteDance Cool project! It transforms indoor video into editable 3D scenes; reconstructs objects as simulation-ready assets - VLM-based object detection and referring descriptions. - good at pose alignment - high-fidelity real-to-sim digital twins. - multi-view masks, boxes, partial point clouds - Seed3D 2.0 for image-to-3D asset gen

Wildminder

47,204 views • 1 month ago

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai

Galaxea Dynamics

21,113 views • 7 months ago

You can now enable Codex to execute CodeRabbit directly in your development workflow! Let AI code, review, and fix issues autonomously without any human intervention 🤖 (Check out the updated CodeRabbit CLI x Codex docs below!)

You can now enable Codex to execute CodeRabbit directly in your development workflow! Let AI code, review, and fix issues autonomously without any human intervention 🤖 (Check out the updated CodeRabbit CLI x Codex docs below!)

CodeRabbit

19,211 views • 1 year ago

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

NVIDIA Robotics

101,112 views • 4 months ago

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,946 views • 1 year ago