Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Big day for open source 3D capture! 🌐 nerfstudio hits 1.0 and gets a commercial-ready Gaussian Splatting implementation Google AI open sourced Zip-NeRF — the highest quality 3D reconstruction pipeline, setting the stage for a future SMERF release

Bilawal Sidhu

107,992 subscribers

85,222 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 2 Jahren

More understated, but equally exciting is Google’s CamP — which dramatically improves 3D pose estimation of your input 2D images, giving you much cleaner 3D reconstructions than using COLMAP. Code linked below (oh and it’s an Apache license too!) ⬇️

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 2 Jahren

Zip-NeRF is SOTA for visual quality but not speed. Perhaps we‘ll see that SMERF release later this year bringing us quality AND speed? Needless to say, 2024 is shaping up to be a fun year for 3D reconstruction :) More in my video below ⬇️

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 2 Jahren

Links below (Apache licenses all round too!) ⬇️ 🔗NeRF Studio: 🔗CamP (Camera Preconditioning for Neural Radiance Fields): 🔗Zip-NeRF (Anti-Aliased Grid-Based Neural Radiance Fields): 🔗SMERF vs. Gaussian Splatting video: Enjoyed this thread? You might also enjoy my feed on all things AI, 3D and sPaTiaL CoMpuTiNg: @bilawalsidhu

Profilbild von Charlie Fink

Charlie Finkvor 2 Jahren

@nerfstudioteam @GoogleAI So good.

Profilbild von Antonio Santoni 🔎𝕏

Antonio Santoni 🔎𝕏vor 2 Jahren

@nerfstudioteam @GoogleAI So good!

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 2 Jahren

@nerfstudioteam @GoogleAI 3d nerds this week

Profilbild von Batis Samadian

Batis Samadianvor 2 Jahren

@bilawalsidhu Check DM plz 🙏

Profilbild von Teofilo Colon Jr 💰 🇺🇲 📈 🚀

Teofilo Colon Jr 💰 🇺🇲 📈 🚀vor 2 Jahren

@nerfstudioteam @GoogleAI 😯

Profilbild von Traci Mills

Traci Millsvor 2 Jahren

@nerfstudioteam @GoogleAI Wow, open source 3D capture is really leveling up! 🚀📸

Profilbild von Eric Schleicher

Eric Schleichervor 2 Jahren

@nerfstudioteam @GoogleAI There is a now an accepted view that these (nerf/splat) scene techniques don’t have to create geometry artifacts (I e. the reconstruction) to be called reconstructions? Without these, they seem like clever novel rendering, but fall (far) short as reconstruction pipelines.

Ähnliche Videos

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 Aufrufe • vor 1 Jahr

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

Abdullah Hamdi

71,661 Aufrufe • vor 1 Jahr

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

119,827 Aufrufe • vor 1 Jahr

3D Gaussian Splatting inside Godot🎮 Instead of forcing splats into a mesh pipeline, this project adds a separate rendering pass🤩 and blends it after mesh rendering. And yeah, it’s fully open source🥳

3D Gaussian Splatting inside Godot🎮 Instead of forcing splats into a mesh pipeline, this project adds a separate rendering pass🤩 and blends it after mesh rendering. And yeah, it’s fully open source🥳

KIRI Engine - 3D Scanner App

19,209 Aufrufe • vor 4 Monaten

After 10 months of development, it's finally here! ✨SuperSplat 1.0✨ The open source editor for working with 3D Gaussian Splats. TRY NOW: GITHUB:

After 10 months of development, it's finally here! ✨SuperSplat 1.0✨ The open source editor for working with 3D Gaussian Splats. TRY NOW: GITHUB:

Will Eastcott

52,543 Aufrufe • vor 2 Jahren

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,242 Aufrufe • vor 2 Jahren

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 Aufrufe • vor 2 Jahren

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,345 Aufrufe • vor 1 Jahr

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 Aufrufe • vor 2 Jahren

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

PlayCanvas

53,617 Aufrufe • vor 2 Monaten

Turn any 3D Gaussian splat into a collision/proxy mesh (glTF 3D format). 🧊 Coming in the next release of the free and open source SuperSplat Editor by PlayCanvas. What do you think? 👂

Turn any 3D Gaussian splat into a collision/proxy mesh (glTF 3D format). 🧊 Coming in the next release of the free and open source SuperSplat Editor by PlayCanvas. What do you think? 👂

Will Eastcott

18,793 Aufrufe • vor 1 Monat

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Yanpei Cao

132,996 Aufrufe • vor 1 Jahr

The biggest announcement from NVIDIA GTC was just released! It's the open sourcing of TWO Radiance Field methods, 3D Gaussian Ray Tracing and 3D Gaussian Unscented Transform from NVIDIA AI Developer. Not only has the code been released, but they come with an Apache 2.0 License, meaning you can use these methods commercially. This is the same license that Nerfstudio carries and is a big win for the community! 3DGRT introduces a pure ray tracing implementation, while 3DGUT brings the effects of ray tracing, such as secondary lighting effects to rasterization. This is a big deal! Article👇 Code👇

The biggest announcement from NVIDIA GTC was just released! It's the open sourcing of TWO Radiance Field methods, 3D Gaussian Ray Tracing and 3D Gaussian Unscented Transform from NVIDIA AI Developer. Not only has the code been released, but they come with an Apache 2.0 License, meaning you can use these methods commercially. This is the same license that Nerfstudio carries and is a big win for the community! 3DGRT introduces a pure ray tracing implementation, while 3DGUT brings the effects of ray tracing, such as secondary lighting effects to rasterization. This is a big deal! Article👇 Code👇

Radiance Fields

29,483 Aufrufe • vor 1 Jahr

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

Wildminder

15,711 Aufrufe • vor 2 Monaten

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

PlayCanvas

122,769 Aufrufe • vor 9 Monaten

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

Zhiwen(Aaron) Fan

31,864 Aufrufe • vor 5 Monaten

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Contributions: • An incremental joint optimization approach for simultaneous camera pose and 3DGS reconstruction, reducing local minima and ensuring global consistency. • A robust pose estimation module leveraging learned 3D priors for accurate camera pose estimation. • An adaptive Octree Anchor Formation strategy that significantly reduces memory usage while preserving reconstruction quality.

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Contributions: • An incremental joint optimization approach for simultaneous camera pose and 3DGS reconstruction, reducing local minima and ensuring global consistency. • A robust pose estimation module leveraging learned 3D priors for accurate camera pose estimation. • An adaptive Octree Anchor Formation strategy that significantly reduces memory usage while preserving reconstruction quality.

MrNeRF

35,969 Aufrufe • vor 11 Monaten

[SIGGRAPH ASIA '25] Detail-Enhanced Gaussian Splatting for Large-Scale Volumetric Capture Contributions: - A two-stage approach to performance capture, combining a scene-scale capture rig and a single-actor facial capture rig. - A novel high-quality scene-scale volumetric performance capture rig, incorporating both static and dynamic cameras to track the performance of multiple actors. - A reconstruction pipeline for dynamic performance capture, featuring stable calibration of moving cameras and 4DGS with improved dynamic range and color fidelity. - A detail enhancement Diffusion Model, which supports 4K, RGB, and Alpha, with improved temporal stability.

[SIGGRAPH ASIA '25] Detail-Enhanced Gaussian Splatting for Large-Scale Volumetric Capture Contributions: - A two-stage approach to performance capture, combining a scene-scale capture rig and a single-actor facial capture rig. - A novel high-quality scene-scale volumetric performance capture rig, incorporating both static and dynamic cameras to track the performance of multiple actors. - A reconstruction pipeline for dynamic performance capture, featuring stable calibration of moving cameras and 4DGS with improved dynamic range and color fidelity. - A detail enhancement Diffusion Model, which supports 4K, RGB, and Alpha, with improved temporal stability.

MrNeRF

42,456 Aufrufe • vor 9 Monaten

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

Bilawal Sidhu

61,583 Aufrufe • vor 9 Monaten

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas

37,540 Aufrufe • vor 9 Monaten