Video yükleniyor...
Video Yüklenemedi
1/5 📢 Excited to share PowerSim, which lets us (a) interact with objects in captured scenes, (b) simulate how they move and deform, and (c) render their changing appearance. This is one of the first papers from the first cohort of PhD students in my new 3P Vision Group... show more
13,478 görüntüleme • 1 ay önce •via X (Twitter)
6 Yorum

2/5 Why did we build PowerSim? We want to capture scenes and then push, pull, or rearrange the objects in them. But what happens to their appearance when they deform? While working on another project, we ran into limitations of PhysGaussian and other existing methods under large deformations. You can see some of these in the video below: surface details disappear or become blurry as the object stretches. We needed a better way to handle this.

3/5 What do we do? We build on Power Foam, whose primitives partition space into volumetric cells and combine them with Material Point Method (MPM) simulation. The connection is quite natural here. MPM tracks how an object deforms and we can use that information to update the primitives’ geometry and appearance without converting the scene into any other representation. A big shout-out to the Power Foam authors (@Shrisudhan001, Daniel Rebain, @kwangmoo_yi, @taiyasaki, @dorverbin, @prabhubility99) for the foundation this work builds on!

4/5 Simply moving the PowerFoam primitives with MPM isn’t enough. Here, we twist a bread model, treating it as an elastic material. If we leave the dipole plane or detail axis fixed, the surface appearance doesn’t follow the deformation correctly. PowerSim rotates both with the material, preserving detail as it twists.

5/5 With PowerSim, we can: - Physically interact with objects in captured scenes. - Recover material properties that vary across an object. - Combine objects from separately captured scenes and simulate them together. - Ray-trace reflections that change as objects move and deform. Huge congrats to @Tung11199951 for bringing this together! Excited to see what others build with PowerSim 😊

6/5: PowerSim code is now live! Give it a try — we would love to see what you build with it. 💻

My game Halls of History runs on splat rooms in the browser, and your 2/5 explains why PowerSim moved off splats. How close does it get to interactive rates? I couldn't find a runtime in the paper.

