Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Point Cloud Pro tip: use a rolling average inside a double buffer to average pixel positions to avoid bouncing animations

13,419 Aufrufe • vor 8 Monaten •via X (Twitter)

14 Kommentare

Profilbild von patricio gonzalez vivo
patricio gonzalez vivovor 8 Monaten

give it a try:

Profilbild von O%ΩURΩBΩRΩS
O%ΩURΩBΩRΩSvor 8 Monaten

A general... Higher dimensional noise tip frankly...

Profilbild von Nicholas Bardy
Nicholas Bardyvor 8 Monaten

What model is this? Results look great

Profilbild von patricio gonzalez vivo
patricio gonzalez vivovor 8 Monaten

Thank you! Actually it's a pretty old (not temporal stable) but metric model, ZoeDepth. You can see the same model without the rolling average here

Profilbild von Nicholas Bardy
Nicholas Bardyvor 8 Monaten

Thinking this would actually be a really good self supervised metrics for training video depth models.

Profilbild von Colin Duffy 🇺🇦
Colin Duffy 🇺🇦vor 8 Monaten

Was that used in the Rocky example? I noticed that bounced a lot

Profilbild von patricio gonzalez vivo
patricio gonzalez vivovor 8 Monaten

No, that was just a 1:1 with the depth data. Give it a try here

Profilbild von Wrennly
Wrennlyvor 6 Monaten

oh nice, i tried that to fix jitter and it totally smoothed things out, though i had to tweak the buffer size to get it right 🤔

Profilbild von Wrennly
Wrennlyvor 7 Monaten

oh i hit bouncing points too, switching to a simple rolling average in the compute pass fixed it for me. curious if you're using a separate buffer for the averages or doing it inline?

Profilbild von Ziyang Xie
Ziyang Xievor 8 Monaten

why not just try a video depth estimation model e.g. video depth anything to ensure consistency? If there is camera movement, just try Pi3/DA3

Profilbild von patricio gonzalez vivo
patricio gonzalez vivovor 8 Monaten

this experiment is from back 2022

Profilbild von patricio gonzalez vivo
patricio gonzalez vivovor 8 Monaten

My timeline doesn't go that far, but funded a link to this other post

Profilbild von Wrennly
Wrennlyvor 7 Monaten

rolling average in compute vs frame history in vertex — curious if the double buffer overhead matters more than the noise reduction for this scale. tried storing a velocity buffer instead for smoother damping?

Profilbild von patricio gonzalez vivo
patricio gonzalez vivovor 8 Monaten

Pushing a new version with some optimizations, web-glslViewer now can load CSVs into uniforms. In this case the min and max depth per everyframe

Ähnliche Videos