正在加载视频...

视频加载失败

3D Gaussian Splatting is great, but can it work without the pre-computed camera poses? Introducing: COLMAP-Free 3D Gaussian Splatting Our recent work shows not only it can, but 3D Gaussians make camera pose estimation easy (compared to NeRF) along with reconstruction. 👇🧵

76,747 次观看 • 2 年前 •via X (Twitter)

7 条评论

Xiaolong Wang 的头像
Xiaolong Wang2 年前

Starting from the initial frame, we process the following frames in a sequential manner by progressively growing the 3D Gaussians set and estimating the camera pose at the same time. 2/n)

Xiaolong Wang 的头像
Xiaolong Wang2 年前

Our approach demonstrates a significant improvement in novel view synthesis, enhancing both quality and efficiency, compared to sota unposed NeRF. 3/n)

Xiaolong Wang 的头像
Xiaolong Wang2 年前

Additionally, we show enhanced effectiveness and robustness in camera pose estimation, especially in challenging scenarios like 360 videos. 4/n)

Xiaolong Wang 的头像
Xiaolong Wang2 年前

Check out our website: arxiv: Collaboration with @yangfu21, Sifei Liu, Amey Kulkarni, @jankautz, Alyosha Efros and thank you for @_akhaliq for sharing:

Zhiwen(Aaron) Fan 的头像
Zhiwen(Aaron) Fan2 年前

It's a truly innovative and neat approach to leverage DPT depth for camera pose estimation within the 3DGS framework. Is there a schedule for releasing the code this month? :)

Ralph Brooks 🎯 Precision SEO Targeting 🎯 的头像
Ralph Brooks 🎯 Precision SEO Targeting 🎯2 年前

In addition to looking at Dr. Wang's work, it may be worth while to check out research on SMERF that was also released today.

Xiaolong Wang 的头像
Xiaolong Wang2 年前

@PMel3D Thanks for the note. In general colmap was used for preprocessing in these applications. We want to humbly emphasize this is helping build 3D Gaussian without colmap. But we do not exclude the possibility there are better sfm approaches out there.

相关视频