Video yükleniyor...
Video Yüklenemedi
Real-time lens tracing experiment in three.js (WIP) Turns out you can generate metric depth with a 40 MB model on the CPU in the browser in about 10 seconds. That's enough to drive the lens simulation, no 3D scene needed. Might turn the 2D part into its own app. #threejs
19,126 görüntüleme • 7 gün önce •via X (Twitter)
12 Yorum

First thing I wondered about seeing your sim. Getting depth on a real photo. Tried using the iPhone lidar? Obviously I'm making yet another camera app, so I'm keen on your results.

thats pretty fucking neat

10 sec on CPU sounds crazy — what kind of lens effects can it drive?

pls release a standalone tool or plugin for After Effects :( @Damjan_Minovski

Incredible stuff.

looks great! what model are you using? some variant of DepthPro?

I quantized a version of MoGe-2 from Microsoft. It gives metric depth and also important - a FOV estimate. And it seems to run on pretty much everything because its so small

Very cool, looks great!

CSI needs you

That’s very creative; I like it.

How do you handle occluded areas, rays that pass behind objects?

Not at all - as you can see in the video on the foreground person - its a sharp edge.. But it might be possible to fill in gaps with some tricks
