Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

1/5 📢 Excited to share PowerSim, which lets us (a) interact with objects in captured scenes, (b) simulate how they move and deform, and (c) render their changing appearance. This is one of the first papers from the first cohort of PhD students in my new 3P Vision Group...

13,478 görüntüleme • 1 ay önce •via X (Twitter)

6 Yorum

Anand Bhattad profil fotoğrafı
Anand Bhattad1 ay önce

2/5 Why did we build PowerSim? We want to capture scenes and then push, pull, or rearrange the objects in them. But what happens to their appearance when they deform? While working on another project, we ran into limitations of PhysGaussian and other existing methods under large deformations. You can see some of these in the video below: surface details disappear or become blurry as the object stretches. We needed a better way to handle this.

Anand Bhattad profil fotoğrafı
Anand Bhattad1 ay önce

3/5 What do we do? We build on Power Foam, whose primitives partition space into volumetric cells and combine them with Material Point Method (MPM) simulation. The connection is quite natural here. MPM tracks how an object deforms and we can use that information to update the primitives’ geometry and appearance without converting the scene into any other representation. A big shout-out to the Power Foam authors (@Shrisudhan001, Daniel Rebain, @kwangmoo_yi, @taiyasaki, @dorverbin, @prabhubility99) for the foundation this work builds on!

Anand Bhattad profil fotoğrafı
Anand Bhattad1 ay önce

4/5 Simply moving the PowerFoam primitives with MPM isn’t enough. Here, we twist a bread model, treating it as an elastic material. If we leave the dipole plane or detail axis fixed, the surface appearance doesn’t follow the deformation correctly. PowerSim rotates both with the material, preserving detail as it twists.

Anand Bhattad profil fotoğrafı
Anand Bhattad1 ay önce

5/5 With PowerSim, we can: - Physically interact with objects in captured scenes. - Recover material properties that vary across an object. - Combine objects from separately captured scenes and simulate them together. - Ray-trace reflections that change as objects move and deform. Huge congrats to @Tung11199951 for bringing this together! Excited to see what others build with PowerSim 😊

Anand Bhattad profil fotoğrafı
Anand Bhattad1 ay önce

6/5: PowerSim code is now live! Give it a try — we would love to see what you build with it. 💻

Lantern Works profil fotoğrafı
Lantern Works1 ay önce

My game Halls of History runs on splat rooms in the browser, and your 2/5 explains why PowerSim moved off splats. How close does it get to interactive rates? I couldn't find a runtime in the paper.

Benzer Videolar