正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Many works model 3D virtual humans, but how can we create realistic dense crowds? At SIGGRAPH Asia 2024, we will show that solving human-human interactions is key to modeling realistic crowds. project: 🧵1/4

Dan Casas

1,848 subscribers

22,760 次观看 • 1 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

9 条评论

Dan Casas 的头像

Dan Casas1 年前

By approximating each individual with a parametric set of 3D volumetric proxies, we resolve human-human interactions while maintaining the overall motion of the crowd. Previous methods for dense crowds modeled humans as 2D disks instead of 3D articulated volumes. 2/4

Dan Casas 的头像

Dan Casas1 年前

We validate our approach through an extensive user study, using videos of crowds at 5 different density levels, rendered from 4 viewpoints. Our results demonstrate that resolving collisions is crucial for improving the realism of dense 3D crowds.

Dan Casas 的头像

Dan Casas1 年前

Joint work from @etsii_urjc (Madrid, Spain) and @Inria (Rennes, France), as part of the @CrowdDNA_H2020 project. It will be presented in Tokyo for SIGGRAPH Asia 2024. Check our project website for more details.

German Barquero 的头像

German Barquero1 年前

Great work, Dan!! Congrats to the team!!

Silvia Sellán 的头像

Silvia Sellán1 年前

Really cool work, Dan! Can’t wait to see it presented in Tokyo :)

Michael Black 的头像

Michael Black1 年前

Congratulations! I really like it.

Dan Casas 的头像

Dan Casas1 年前

Thank you, Michael! 🙏

Xiaohan Zhang 的头像

Xiaohan Zhang1 年前

Congrats on the fantastic work! Just wondering if there will be a code release down the timeline?

Dan Casas 的头像

Dan Casas1 年前

We plan to release the code, yes. Notice, however, that most of the physics stuff is borrowed from FLSH, which is already available here and

相关视频

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Angela Dai

20,508 次观看 • 2 年前

3D Gaussian is great, but how can you interact with it 🌹👋? Introducing #PhysDreamer: Create your own realistic interactive 3D assets from only static images! Discover how we do this below👇 🧵1/: Website:

3D Gaussian is great, but how can you interact with it 🌹👋? Introducing #PhysDreamer: Create your own realistic interactive 3D assets from only static images! Discover how we do this below👇 🧵1/: Website:

Tianyuan Zhang

60,830 次观看 • 2 年前

How to Create a Realistic Pillow Model

How to Create a Realistic Pillow Model

Photoshop Tricks!

2,579,180 次观看 • 1 年前

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n

Chuang Gan

90,042 次观看 • 1 年前

Existing 3D human manipulation datasets are valuable, but are limited in scale and diversity. At #CVPR2025, we will introduce GigaHands👐 which, to our knowledge, is the most extensive 3D bimanual manipulation, interaction, and gesture dataset.🧵👇(1/9)

Existing 3D human manipulation datasets are valuable, but are limited in scale and diversity. At #CVPR2025, we will introduce GigaHands👐 which, to our knowledge, is the most extensive 3D bimanual manipulation, interaction, and gesture dataset.🧵👇(1/9)

Srinath Sridhar

13,443 次观看 • 1 年前

Lifelike AI human avatar videos are becoming incredibly realistic. They’re so realistic, you might just forget they’re not real people. (Is this the future?) Here's how to create your AI avatar easily:

Robin Delta

96,352 次观看 • 1 年前

"we need more complex, realistic and flawed human character" yet some of you guys can barely handle him

Sensitive content

"we need more complex, realistic and flawed human character" yet some of you guys can barely handle him

mikey / 🏳️‍🌈

286,848 次观看 • 1 年前

Multi-modal #LLMs understand a lot about humans. But do they understand our 3D pose? We train #PoseGPT to estimate, generate, and reason about 3D human pose (#SMPL) in images and text. This is the first true foundation model for understanding 3D humans.

Multi-modal #LLMs understand a lot about humans. But do they understand our 3D pose? We train #PoseGPT to estimate, generate, and reason about 3D human pose (#SMPL) in images and text. This is the first true foundation model for understanding 3D humans.

Michael Black

81,398 次观看 • 2 年前

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,610 次观看 • 11 个月前

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with physics-in-the-loop that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

15,544 次观看 • 3 个月前

(1/2) 📢📢📢NeRSemble #SIGGRAPH'23! We reconstruct dynamic radiance fields for high-quality novel view synthesis of human heads. Key is a deformation field and an ensemble of multi-resolution hash encodings to model coarse & fine-scale deformations.

(1/2) 📢📢📢NeRSemble #SIGGRAPH'23! We reconstruct dynamic radiance fields for high-quality novel view synthesis of human heads. Key is a deformation field and an ensemble of multi-resolution hash encodings to model coarse & fine-scale deformations.

Matthias Niessner

69,652 次观看 • 3 年前

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.

Can we synthesize 3D human-scene interactions without learning from any 3D data? Yes! Check out Lei Li's GenZI, a novel zero-shot approach to generating 3D interactions by distilling priors from large vision-language models.

Angela Dai

106,862 次观看 • 2 年前

A hyper-realistic humanoid robot that looks almost human

A hyper-realistic humanoid robot that looks almost human

Science girl

24,443 次观看 • 4 个月前

How far can a very simple eye go in solving vision tasks? Like a 1-pixel camera? Humans have one of the greatest eyes in nature, while many animals have significantly simpler eyes and visual systems yet show complex perceptual behavior. In an interesting project, we find that many computer vision tasks can be solved without a typical camera and with such simple 1-pixel sensors (photoreceptors). We also find that proper design (e.g., where to place the photoreceptors strategically) makes a big difference, so we developed a computational design method to find them. 🌐 👁️[Solving Vision Tasks with Simple Photoreceptors Instead of Cameras] 🧵1/n

How far can a very simple eye go in solving vision tasks? Like a 1-pixel camera? Humans have one of the greatest eyes in nature, while many animals have significantly simpler eyes and visual systems yet show complex perceptual behavior. In an interesting project, we find that many computer vision tasks can be solved without a typical camera and with such simple 1-pixel sensors (photoreceptors). We also find that proper design (e.g., where to place the photoreceptors strategically) makes a big difference, so we developed a computational design method to find them. 🌐 👁️[Solving Vision Tasks with Simple Photoreceptors Instead of Cameras] 🧵1/n

Amir Zamir

75,877 次观看 • 2 年前

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

Ziwei Liu

26,953 次观看 • 1 年前

We also present another paper at @SIGGRAPH 2023 on neural implicit 3D Morphable Models that can be used to create a dynamic 3D avatar from a single in-the-wild image. (Lead author Connor Lin).

Koki Nagano

12,758 次观看 • 3 年前

📁 Yann LeCun says that AGI does not exist and is a poorly defined concept built around an idealized view of human intelligence. He argues that humans are highly specialized, good at navigating the physical and social world, but weak at many other tasks. We seem general only because we can imagine the problems we are good at. For LeCun, AGI mistakes human limits for universal laws of intelligence.

📁 Yann LeCun says that AGI does not exist and is a poorly defined concept built around an idealized view of human intelligence. He argues that humans are highly specialized, good at navigating the physical and social world, but weak at many other tasks. We seem general only because we can imagine the problems we are good at. For LeCun, AGI mistakes human limits for universal laws of intelligence.

Jon Hernandez

28,104 次观看 • 6 个月前