Загрузка видео...

Не удалось загрузить видео

На главную

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

liuziwei7's profile picture

Ziwei Liu

13,420 subscribers

15,631 просмотров • 7 месяцев назад •via X (Twitter)

#HSImul3R
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 1

Фото профиля Carolina
Carolina7 месяцев назад

Nice to see progress bridging perception and simulation for human-scene work. How scalable is the pipeline for diverse environments?

Похожие видео

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:
0:34

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

Jiaman Li

104,880 просмотров • 1 год назад

Your Blender scenes just got an upgrade. 🤖 NVIDIA Omniverse libraries are now part of NVIDIA Agent Toolkit, so AI agents can handle physics, sensor behavior, and scene checks right inside Blender, helping you take your 3D worlds from visually complete to simulation ready. Watch now 👉
0:30

Your Blender scenes just got an upgrade. 🤖 NVIDIA Omniverse libraries are now part of NVIDIA Agent Toolkit, so AI agents can handle physics, sensor behavior, and scene checks right inside Blender, helping you take your 3D worlds from visually complete to simulation ready. Watch now 👉

NVIDIA Omniverse

32,023 просмотров • 3 месяцев назад

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗
1:32

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗

Haoyang Weng

136,949 просмотров • 1 год назад

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:
1:04

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

Ziwei Liu

26,953 просмотров • 1 год назад

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK
0:31

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

73,877 просмотров • 4 месяцев назад

📢📢📢 Excited to share our ICLR25 work, ArtGS, which can reconstruct articulated objects and scenes from human-scene interactions. 💻🖱️🧱🪑📖 Understanding physics and articulation is extremely important. With ArtGS, we can build a digital and simulatable replica of the real 3D world with minimal human effort!
0:38

📢📢📢 Excited to share our ICLR25 work, ArtGS, which can reconstruct articulated objects and scenes from human-scene interactions. 💻🖱️🧱🪑📖 Understanding physics and articulation is extremely important. With ArtGS, we can build a digital and simulatable replica of the real 3D world with minimal human effort!

Siyuan Huang

12,833 просмотров • 1 год назад

🕸️ Introducing SPIDER — Scalable Physics-Informed Dexterous Retargeting! A dynamically feasible, cross-embodiment retargeting framework for BOTH humanoids 🤖 and dexterous hands ✋. From human motion → sim → real robots, at scale. 🔗 Website: 🧵 1/n
1:25

🕸️ Introducing SPIDER — Scalable Physics-Informed Dexterous Retargeting! A dynamically feasible, cross-embodiment retargeting framework for BOTH humanoids 🤖 and dexterous hands ✋. From human motion → sim → real robots, at scale. 🔗 Website: 🧵 1/n

Chaoyi Pan

66,077 просмотров • 11 месяцев назад

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.
0:22

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.

Angela Dai

107,013 просмотров • 2 лет назад

🤖WATCH: DO YOU SEE BOYS OR ROBOTS? It’s in the way they move, play and goof around. With every human-like moment, HUMANOIDS inch closer to winning human hearts.
0:55

🤖WATCH: DO YOU SEE BOYS OR ROBOTS? It’s in the way they move, play and goof around. With every human-like moment, HUMANOIDS inch closer to winning human hearts.

Coin Bureau

19,387 просмотров • 4 месяцев назад

Wow! We just put a human-in-the-loop within ChatGPT. ❤️🤖
1:32

Wow! We just put a human-in-the-loop within ChatGPT. ❤️🤖

Marc Benioff

105,048 просмотров • 11 месяцев назад

Physics simulation gives robots a place to learn before they enter the physical world. 🤖 Developers can model complex interactions, train and evaluate policies, and validate robot behavior in controlled virtual environments before deployment. Explore physics simulation for robotics 🔗
0:20

Physics simulation gives robots a place to learn before they enter the physical world. 🤖 Developers can model complex interactions, train and evaluate policies, and validate robot behavior in controlled virtual environments before deployment. Explore physics simulation for robotics 🔗

NVIDIA Robotics

28,742 просмотров • 1 месяц назад

2025. The year humans trained robots. 🤖 70,000+ teleop sessions 🤖 Nearly 5,000 hours of real human-in-the-loop work 🤖 1.2M+ app members This is PrismaX Wrapped 2025.
0:50

2025. The year humans trained robots. 🤖 70,000+ teleop sessions 🤖 Nearly 5,000 hours of real human-in-the-loop work 🤖 1.2M+ app members This is PrismaX Wrapped 2025.

PrismaX

54,672 просмотров • 9 месяцев назад

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄
3:52

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

Hao Zhao

52,340 просмотров • 1 месяц назад

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:
3:13

Excited to introduce COLA: Learning Human–Humanoid Coordination for Collaborative Object Carrying 🤝🤖 COLA makes humanoids truly helpful in human collaboration — capable of carrying objects, pushing carts, or responding to human push commands. It provides a proprioception-only policy for compliant human–humanoid coordination across diverse movement patterns. The core idea is simple yet effective: 👉 Fine-tune a collaborative policy from a locomotion policy using a residual teacher. 👉 Train in simulation and distill to a real-world student policy for deployment. Paper: Project:

Siyuan Huang

22,105 просмотров • 1 год назад

Lucida from ByteDance Cool project! It transforms indoor video into editable 3D scenes; reconstructs objects as simulation-ready assets - VLM-based object detection and referring descriptions. - good at pose alignment - high-fidelity real-to-sim digital twins. - multi-view masks, boxes, partial point clouds - Seed3D 2.0 for image-to-3D asset gen
0:38

Lucida from ByteDance Cool project! It transforms indoor video into editable 3D scenes; reconstructs objects as simulation-ready assets - VLM-based object detection and referring descriptions. - good at pose alignment - high-fidelity real-to-sim digital twins. - multi-view masks, boxes, partial point clouds - Seed3D 2.0 for image-to-3D asset gen

Wildminder

46,938 просмотров • 1 месяц назад

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai
1:20

Sometimes the model’s driving. Sometimes the human is. With Lite-T, a wearable data collection system, operators can jump in and out of control during training—seamless human-in-the-loop. Tag team training for embodied AI 🤝🤖 #data #embodiedai

Galaxea Dynamics

21,113 просмотров • 7 месяцев назад

You can now enable Codex to execute CodeRabbit directly in your development workflow! Let AI code, review, and fix issues autonomously without any human intervention 🤖 (Check out the updated CodeRabbit CLI x Codex docs below!)
1:33

You can now enable Codex to execute CodeRabbit directly in your development workflow! Let AI code, review, and fix issues autonomously without any human intervention 🤖 (Check out the updated CodeRabbit CLI x Codex docs below!)

CodeRabbit

19,211 просмотров • 1 год назад

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️
0:24

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

NVIDIA Robotics

101,112 просмотров • 4 месяцев назад

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:
0:50

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,918 просмотров • 1 год назад