Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Big day for open source 3D capture! 🌐 nerfstudio hits 1.0 and gets a commercial-ready Gaussian Splatting implementation Google AI open sourced Zip-NeRF — the highest quality 3D reconstruction pipeline, setting the stage for a future SMERF release

Bilawal Sidhu

107,992 subscribers

85,222 views • 2 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Comments

Bilawal Sidhu2 years ago

More understated, but equally exciting is Google’s CamP — which dramatically improves 3D pose estimation of your input 2D images, giving you much cleaner 3D reconstructions than using COLMAP. Code linked below (oh and it’s an Apache license too!) ⬇️

Bilawal Sidhu2 years ago

Zip-NeRF is SOTA for visual quality but not speed. Perhaps we‘ll see that SMERF release later this year bringing us quality AND speed? Needless to say, 2024 is shaping up to be a fun year for 3D reconstruction :) More in my video below ⬇️

Bilawal Sidhu2 years ago

Links below (Apache licenses all round too!) ⬇️ 🔗NeRF Studio: 🔗CamP (Camera Preconditioning for Neural Radiance Fields): 🔗Zip-NeRF (Anti-Aliased Grid-Based Neural Radiance Fields): 🔗SMERF vs. Gaussian Splatting video: Enjoyed this thread? You might also enjoy my feed on all things AI, 3D and sPaTiaL CoMpuTiNg: @bilawalsidhu

Charlie Fink2 years ago

@nerfstudioteam @GoogleAI So good.

Antonio Santoni 🔎𝕏2 years ago

@nerfstudioteam @GoogleAI So good!

Bilawal Sidhu2 years ago

@nerfstudioteam @GoogleAI 3d nerds this week

Batis Samadian2 years ago

@bilawalsidhu Check DM plz 🙏

Teofilo Colon Jr 💰 🇺🇲 📈 🚀2 years ago

@nerfstudioteam @GoogleAI 😯

Traci Mills2 years ago

@nerfstudioteam @GoogleAI Wow, open source 3D capture is really leveling up! 🚀📸

Eric Schleicher2 years ago

@nerfstudioteam @GoogleAI There is a now an accepted view that these (nerf/splat) scene techniques don’t have to create geometry artifacts (I e. the reconstruction) to be called reconstructions? Without these, they seem like clever novel rendering, but fall (far) short as reconstruction pipelines.

Related Videos

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 views • 1 year ago

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

Abdullah Hamdi

71,661 views • 1 year ago

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

119,827 views • 1 year ago

3D Gaussian Splatting inside Godot🎮 Instead of forcing splats into a mesh pipeline, this project adds a separate rendering pass🤩 and blends it after mesh rendering. And yeah, it’s fully open source🥳

3D Gaussian Splatting inside Godot🎮 Instead of forcing splats into a mesh pipeline, this project adds a separate rendering pass🤩 and blends it after mesh rendering. And yeah, it’s fully open source🥳

KIRI Engine - 3D Scanner App

19,209 views • 4 months ago

After 10 months of development, it's finally here! ✨SuperSplat 1.0✨ The open source editor for working with 3D Gaussian Splats. TRY NOW: GITHUB:

After 10 months of development, it's finally here! ✨SuperSplat 1.0✨ The open source editor for working with 3D Gaussian Splats. TRY NOW: GITHUB:

Will Eastcott

52,543 views • 2 years ago

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,242 views • 2 years ago

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 views • 2 years ago

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,345 views • 1 year ago

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 views • 2 years ago

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

PlayCanvas

53,617 views • 2 months ago

Turn any 3D Gaussian splat into a collision/proxy mesh (glTF 3D format). 🧊 Coming in the next release of the free and open source SuperSplat Editor by PlayCanvas. What do you think? 👂

Turn any 3D Gaussian splat into a collision/proxy mesh (glTF 3D format). 🧊 Coming in the next release of the free and open source SuperSplat Editor by PlayCanvas. What do you think? 👂

Will Eastcott

18,793 views • 1 month ago

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Yanpei Cao

132,996 views • 1 year ago

The biggest announcement from NVIDIA GTC was just released! It's the open sourcing of TWO Radiance Field methods, 3D Gaussian Ray Tracing and 3D Gaussian Unscented Transform from NVIDIA AI Developer. Not only has the code been released, but they come with an Apache 2.0 License, meaning you can use these methods commercially. This is the same license that Nerfstudio carries and is a big win for the community! 3DGRT introduces a pure ray tracing implementation, while 3DGUT brings the effects of ray tracing, such as secondary lighting effects to rasterization. This is a big deal! Article👇 Code👇

The biggest announcement from NVIDIA GTC was just released! It's the open sourcing of TWO Radiance Field methods, 3D Gaussian Ray Tracing and 3D Gaussian Unscented Transform from NVIDIA AI Developer. Not only has the code been released, but they come with an Apache 2.0 License, meaning you can use these methods commercially. This is the same license that Nerfstudio carries and is a big win for the community! 3DGRT introduces a pure ray tracing implementation, while 3DGUT brings the effects of ray tracing, such as secondary lighting effects to rasterization. This is a big deal! Article👇 Code👇

Radiance Fields

29,483 views • 1 year ago

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

Wildminder

15,711 views • 2 months ago

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

PlayCanvas

122,769 views • 9 months ago

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

Zhiwen(Aaron) Fan

31,864 views • 5 months ago

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Contributions: • An incremental joint optimization approach for simultaneous camera pose and 3DGS reconstruction, reducing local minima and ensuring global consistency. • A robust pose estimation module leveraging learned 3D priors for accurate camera pose estimation. • An adaptive Octree Anchor Formation strategy that significantly reduces memory usage while preserving reconstruction quality.

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Contributions: • An incremental joint optimization approach for simultaneous camera pose and 3DGS reconstruction, reducing local minima and ensuring global consistency. • A robust pose estimation module leveraging learned 3D priors for accurate camera pose estimation. • An adaptive Octree Anchor Formation strategy that significantly reduces memory usage while preserving reconstruction quality.

MrNeRF

35,969 views • 11 months ago

[SIGGRAPH ASIA '25] Detail-Enhanced Gaussian Splatting for Large-Scale Volumetric Capture Contributions: - A two-stage approach to performance capture, combining a scene-scale capture rig and a single-actor facial capture rig. - A novel high-quality scene-scale volumetric performance capture rig, incorporating both static and dynamic cameras to track the performance of multiple actors. - A reconstruction pipeline for dynamic performance capture, featuring stable calibration of moving cameras and 4DGS with improved dynamic range and color fidelity. - A detail enhancement Diffusion Model, which supports 4K, RGB, and Alpha, with improved temporal stability.

[SIGGRAPH ASIA '25] Detail-Enhanced Gaussian Splatting for Large-Scale Volumetric Capture Contributions: - A two-stage approach to performance capture, combining a scene-scale capture rig and a single-actor facial capture rig. - A novel high-quality scene-scale volumetric performance capture rig, incorporating both static and dynamic cameras to track the performance of multiple actors. - A reconstruction pipeline for dynamic performance capture, featuring stable calibration of moving cameras and 4DGS with improved dynamic range and color fidelity. - A detail enhancement Diffusion Model, which supports 4K, RGB, and Alpha, with improved temporal stability.

MrNeRF

42,456 views • 9 months ago

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

Bilawal Sidhu

61,583 views • 9 months ago

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas

37,540 views • 9 months ago