Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

liuziwei7's profile picture

Ziwei Liu

13,420 subscribers

15,631 Aufrufe • vor 7 Monaten •via X (Twitter)

#HSImul3R
LIVE

Anya Rossi• Live Now

Private livecam show

1 Kommentare

Profilbild von Carolina
Carolinavor 7 Monaten

Nice to see progress bridging perception and simulation for human-scene work. How scalable is the pipeline for diverse environments?

Ähnliche Videos

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:
0:34

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

Jiaman Li

104,880 Aufrufe • vor 1 Jahr

Your Blender scenes just got an upgrade. 🤖 NVIDIA Omniverse libraries are now part of NVIDIA Agent Toolkit, so AI agents can handle physics, sensor behavior, and scene checks right inside Blender, helping you take your 3D worlds from visually complete to simulation ready. Watch now 👉
0:30

Your Blender scenes just got an upgrade. 🤖 NVIDIA Omniverse libraries are now part of NVIDIA Agent Toolkit, so AI agents can handle physics, sensor behavior, and scene checks right inside Blender, helping you take your 3D worlds from visually complete to simulation ready. Watch now 👉

NVIDIA Omniverse

32,023 Aufrufe • vor 3 Monaten

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗
1:32

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗

Haoyang Weng

136,949 Aufrufe • vor 1 Jahr

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:
1:04

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

Ziwei Liu

26,953 Aufrufe • vor 1 Jahr

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK
0:31

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

73,877 Aufrufe • vor 4 Monaten

📢📢📢 Excited to share our ICLR25 work, ArtGS, which can reconstruct articulated objects and scenes from human-scene interactions. 💻🖱️🧱🪑📖 Understanding physics and articulation is extremely important. With ArtGS, we can build a digital and simulatable replica of the real 3D world with minimal human effort!
0:38

📢📢📢 Excited to share our ICLR25 work, ArtGS, which can reconstruct articulated objects and scenes from human-scene interactions. 💻🖱️🧱🪑📖 Understanding physics and articulation is extremely important. With ArtGS, we can build a digital and simulatable replica of the real 3D world with minimal human effort!

Siyuan Huang

12,833 Aufrufe • vor 1 Jahr

🕸️ Introducing SPIDER — Scalable Physics-Informed Dexterous Retargeting! A dynamically feasible, cross-embodiment retargeting framework for BOTH humanoids 🤖 and dexterous hands ✋. From human motion → sim → real robots, at scale. 🔗 Website: 🧵 1/n
1:25

🕸️ Introducing SPIDER — Scalable Physics-Informed Dexterous Retargeting! A dynamically feasible, cross-embodiment retargeting framework for BOTH humanoids 🤖 and dexterous hands ✋. From human motion → sim → real robots, at scale. 🔗 Website: 🧵 1/n

Chaoyi Pan

66,077 Aufrufe • vor 11 Monaten

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.
0:22

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.

Angela Dai

107,013 Aufrufe • vor 2 Jahren

🤖WATCH: DO YOU SEE BOYS OR ROBOTS? It’s in the way they move, play and goof around. With every human-like moment, HUMANOIDS inch closer to winning human hearts.
0:55

🤖WATCH: DO YOU SEE BOYS OR ROBOTS? It’s in the way they move, play and goof around. With every human-like moment, HUMANOIDS inch closer to winning human hearts.

Coin Bureau

19,387 Aufrufe • vor 4 Monaten

Wow! We just put a human-in-the-loop within ChatGPT. ❤️🤖
1:32

Wow! We just put a human-in-the-loop within ChatGPT. ❤️🤖

Marc Benioff

105,048 Aufrufe • vor 11 Monaten

Physics simulation gives robots a place to learn before they enter the physical world. 🤖 Developers can model complex interactions, train and evaluate policies, and validate robot behavior in controlled virtual environments before deployment. Explore physics simulation for robotics 🔗
0:20

Physics simulation gives robots a place to learn before they enter the physical world. 🤖 Developers can model complex interactions, train and evaluate policies, and validate robot behavior in controlled virtual environments before deployment. Explore physics simulation for robotics 🔗

NVIDIA Robotics

28,742 Aufrufe • vor 1 Monat

2025. The year humans trained robots. 🤖 70,000+ teleop sessions 🤖 Nearly 5,000 hours of real human-in-the-loop work 🤖 1.2M+ app members This is PrismaX Wrapped 2025.
0:50

2025. The year humans trained robots. 🤖 70,000+ teleop sessions 🤖 Nearly 5,000 hours of real human-in-the-loop work 🤖 1.2M+ app members This is PrismaX Wrapped 2025.

PrismaX

54,672 Aufrufe • vor 9 Monaten

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄
3:52

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

Hao Zhao

52,630 Aufrufe • vor 1 Monat

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:
3:13

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Siyuan Huang

22,105 Aufrufe • vor 1 Jahr

Lucida from ByteDance Cool project! It transforms indoor video into editable 3D scenes; reconstructs objects as simulation-ready assets - VLM-based object detection and referring descriptions. - good at pose alignment - high-fidelity real-to-sim digital twins. - multi-view masks, boxes, partial point clouds - Seed3D 2.0 for image-to-3D asset gen
0:38

Lucida from ByteDance Cool project! It transforms indoor video into editable 3D scenes; reconstructs objects as simulation-ready assets - VLM-based object detection and referring descriptions. - good at pose alignment - high-fidelity real-to-sim digital twins. - multi-view masks, boxes, partial point clouds - Seed3D 2.0 for image-to-3D asset gen

Wildminder

46,938 Aufrufe • vor 1 Monat

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai
1:20

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai

Galaxea Dynamics

21,113 Aufrufe • vor 7 Monaten

You can now enable Codex to execute CodeRabbit directly in your development workflow! Let AI code, review, and fix issues autonomously without any human intervention 🤖 (Check out the updated CodeRabbit CLI x Codex docs below!)
1:33

You can now enable Codex to execute CodeRabbit directly in your development workflow! Let AI code, review, and fix issues autonomously without any human intervention 🤖 (Check out the updated CodeRabbit CLI x Codex docs below!)

CodeRabbit

19,211 Aufrufe • vor 1 Jahr

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️
0:24

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

NVIDIA Robotics

101,112 Aufrufe • vor 4 Monaten

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:
0:50

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,934 Aufrufe • vor 1 Jahr