🚨 Forget LIDAR. The Robbyant team just dropped a streaming 3D model that reconstructs scenes live, at ~20 FPS, over long sequences. One single camera. Runs in real time. Open-source. Entirely end-to-end. NO iterative optimization tricks and no post-processing cleanup steps! It outperforms both existing streaming approaches and several... offline methods. 100% Free and open-source. Repo, paper and model weights in 🧵↓show more

→ Code:

→ Project page:

→ Paper:

→ Models:

nice. finally a single camera streaming 3d pipeline that actually runs open source at 20 fps feels realistic

@DataChaz dude, that's wild. curious how it holds up in low-light situations tho? seems like a single cam might struggle there 🤔

At ~20FPS means nothing without talking about the hardware. Other models can also do that like Depth Anything v3

Single camera doing all that is actually insane, vision models evolving ridiculously fast

Let’s drop LiDAR millimeter-accuracy and eat hallucinated garbage.

Told to forget LIDAR roughly twice a month now, at this point LIDAR is the friend who keeps getting uninvited and keeps showing up anyway

Reminds me of the legendary game Age of Empires

Does it include measurements of the space?

Monocular beats LIDAR on cost. Ask it to pick from a pile though. That advantage disappears real fast.

did you actually try the tool to assert that?

finally

a single camera doing real time 3D reconstruction without lidar is huge 📷

lidar salespeople are sweating hard right now

Is it some kind of 3d Gaussian Splatting?