正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Big day for open source 3D capture! 🌐 nerfstudio hits 1.0 and gets a commercial-ready Gaussian Splatting implementation Google AI open sourced Zip-NeRF — the highest quality 3D reconstruction pipeline, setting the stage for a future SMERF release

Bilawal Sidhu

107,992 subscribers

85,222 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 条评论

Bilawal Sidhu 的头像

Bilawal Sidhu2 年前

More understated, but equally exciting is Google’s CamP — which dramatically improves 3D pose estimation of your input 2D images, giving you much cleaner 3D reconstructions than using COLMAP. Code linked below (oh and it’s an Apache license too!) ⬇️

Bilawal Sidhu 的头像

Bilawal Sidhu2 年前

Zip-NeRF is SOTA for visual quality but not speed. Perhaps we‘ll see that SMERF release later this year bringing us quality AND speed? Needless to say, 2024 is shaping up to be a fun year for 3D reconstruction :) More in my video below ⬇️

Bilawal Sidhu 的头像

Bilawal Sidhu2 年前

Links below (Apache licenses all round too!) ⬇️ 🔗NeRF Studio: 🔗CamP (Camera Preconditioning for Neural Radiance Fields): 🔗Zip-NeRF (Anti-Aliased Grid-Based Neural Radiance Fields): 🔗SMERF vs. Gaussian Splatting video: Enjoyed this thread? You might also enjoy my feed on all things AI, 3D and sPaTiaL CoMpuTiNg: @bilawalsidhu

Charlie Fink 的头像

Charlie Fink2 年前

@nerfstudioteam @GoogleAI So good.

Antonio Santoni 🔎𝕏 的头像

Antonio Santoni 🔎𝕏2 年前

@nerfstudioteam @GoogleAI So good!

Bilawal Sidhu 的头像

Bilawal Sidhu2 年前

@nerfstudioteam @GoogleAI 3d nerds this week

Batis Samadian 的头像

Batis Samadian2 年前

@bilawalsidhu Check DM plz 🙏

Teofilo Colon Jr 💰 🇺🇲 📈 🚀 的头像

Teofilo Colon Jr 💰 🇺🇲 📈 🚀2 年前

@nerfstudioteam @GoogleAI 😯

Traci Mills 的头像

Traci Mills2 年前

@nerfstudioteam @GoogleAI Wow, open source 3D capture is really leveling up! 🚀📸

Eric Schleicher 的头像

Eric Schleicher2 年前

@nerfstudioteam @GoogleAI There is a now an accepted view that these (nerf/splat) scene techniques don’t have to create geometry artifacts (I e. the reconstruction) to be called reconstructions? Without these, they seem like clever novel rendering, but fall (far) short as reconstruction pipelines.

相关视频

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 次观看 • 1 年前

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

Abdullah Hamdi

71,661 次观看 • 1 年前

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

119,827 次观看 • 1 年前

3D Gaussian Splatting inside Godot🎮 Instead of forcing splats into a mesh pipeline, this project adds a separate rendering pass🤩 and blends it after mesh rendering. And yeah, it’s fully open source🥳

3D Gaussian Splatting inside Godot🎮 Instead of forcing splats into a mesh pipeline, this project adds a separate rendering pass🤩 and blends it after mesh rendering. And yeah, it’s fully open source🥳

KIRI Engine - 3D Scanner App

19,209 次观看 • 4 个月前

After 10 months of development, it's finally here! ✨SuperSplat 1.0✨ The open source editor for working with 3D Gaussian Splats. TRY NOW: GITHUB:

After 10 months of development, it's finally here! ✨SuperSplat 1.0✨ The open source editor for working with 3D Gaussian Splats. TRY NOW: GITHUB:

Will Eastcott

52,543 次观看 • 2 年前

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,242 次观看 • 2 年前

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 次观看 • 2 年前

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,345 次观看 • 1 年前

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 次观看 • 2 年前

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

PlayCanvas

53,617 次观看 • 2 个月前

Turn any 3D Gaussian splat into a collision/proxy mesh (glTF 3D format). 🧊 Coming in the next release of the free and open source SuperSplat Editor by PlayCanvas. What do you think? 👂

Turn any 3D Gaussian splat into a collision/proxy mesh (glTF 3D format). 🧊 Coming in the next release of the free and open source SuperSplat Editor by PlayCanvas. What do you think? 👂

Will Eastcott

18,793 次观看 • 1 个月前

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Yanpei Cao

132,996 次观看 • 1 年前

The biggest announcement from NVIDIA GTC was just released! It's the open sourcing of TWO Radiance Field methods, 3D Gaussian Ray Tracing and 3D Gaussian Unscented Transform from NVIDIA AI Developer. Not only has the code been released, but they come with an Apache 2.0 License, meaning you can use these methods commercially. This is the same license that Nerfstudio carries and is a big win for the community! 3DGRT introduces a pure ray tracing implementation, while 3DGUT brings the effects of ray tracing, such as secondary lighting effects to rasterization. This is a big deal! Article👇 Code👇

The biggest announcement from NVIDIA GTC was just released! It's the open sourcing of TWO Radiance Field methods, 3D Gaussian Ray Tracing and 3D Gaussian Unscented Transform from NVIDIA AI Developer. Not only has the code been released, but they come with an Apache 2.0 License, meaning you can use these methods commercially. This is the same license that Nerfstudio carries and is a big win for the community! 3DGRT introduces a pure ray tracing implementation, while 3DGUT brings the effects of ray tracing, such as secondary lighting effects to rasterization. This is a big deal! Article👇 Code👇

Radiance Fields

29,483 次观看 • 1 年前

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

Wildminder

15,711 次观看 • 2 个月前

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

PlayCanvas

122,769 次观看 • 9 个月前

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

Zhiwen(Aaron) Fan

31,864 次观看 • 5 个月前

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Contributions: • An incremental joint optimization approach for simultaneous camera pose and 3DGS reconstruction, reducing local minima and ensuring global consistency. • A robust pose estimation module leveraging learned 3D priors for accurate camera pose estimation. • An adaptive Octree Anchor Formation strategy that significantly reduces memory usage while preserving reconstruction quality.

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Contributions: • An incremental joint optimization approach for simultaneous camera pose and 3DGS reconstruction, reducing local minima and ensuring global consistency. • A robust pose estimation module leveraging learned 3D priors for accurate camera pose estimation. • An adaptive Octree Anchor Formation strategy that significantly reduces memory usage while preserving reconstruction quality.

MrNeRF

35,969 次观看 • 11 个月前

[SIGGRAPH ASIA '25] Detail-Enhanced Gaussian Splatting for Large-Scale Volumetric Capture Contributions: - A two-stage approach to performance capture, combining a scene-scale capture rig and a single-actor facial capture rig. - A novel high-quality scene-scale volumetric performance capture rig, incorporating both static and dynamic cameras to track the performance of multiple actors. - A reconstruction pipeline for dynamic performance capture, featuring stable calibration of moving cameras and 4DGS with improved dynamic range and color fidelity. - A detail enhancement Diffusion Model, which supports 4K, RGB, and Alpha, with improved temporal stability.

[SIGGRAPH ASIA '25] Detail-Enhanced Gaussian Splatting for Large-Scale Volumetric Capture Contributions: - A two-stage approach to performance capture, combining a scene-scale capture rig and a single-actor facial capture rig. - A novel high-quality scene-scale volumetric performance capture rig, incorporating both static and dynamic cameras to track the performance of multiple actors. - A reconstruction pipeline for dynamic performance capture, featuring stable calibration of moving cameras and 4DGS with improved dynamic range and color fidelity. - A detail enhancement Diffusion Model, which supports 4K, RGB, and Alpha, with improved temporal stability.

MrNeRF

42,456 次观看 • 9 个月前

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

Bilawal Sidhu

61,583 次观看 • 9 个月前

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas

37,540 次观看 • 9 个月前