Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting CLM trains a 102-million Gaussian model on the MatrixCity BigCity Aerial Dataset under 4 hours using a single RTX 4090, achieving a PSNR of 25.

Ryohei Sasaki@engineer

9,362 subscribers

34,570 views • 7 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

15,035 views • 6 months ago

3D Gaussian Splats are cool, but they're static (Part 12). Spacetime Gaussian Feature Splatting is able to capture dynamic, and transient content within a scene and render them at 8K resolution and 60 FPS on an RTX 4090.

3D Gaussian Splats are cool, but they're static (Part 12). Spacetime Gaussian Feature Splatting is able to capture dynamic, and transient content within a scene and render them at 8K resolution and 60 FPS on an RTX 4090.

Dreaming Tulpa 🥓👑

37,333 views • 2 years ago

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Radiance Fields

79,314 views • 10 months ago

#3D model using Gaussian splatting with approx. 1400 photos of a drone flight over the Kastel-Staadt hermitage near #Trier. I had already calculated a photogrammetry model last year, the details of the plants in this model are fantastic.

#3D model using Gaussian splatting with approx. 1400 photos of a drone flight over the Kastel-Staadt hermitage near #Trier. I had already calculated a photogrammetry model last year, the details of the plants in this model are fantastic.

Sven Schroeter

16,679 views • 1 year ago

Whoa, this is Temporal Gaussian Hierarchy (TGH). This AI can real-time render long volumetric videos in 1080p at 450 fps on a single RTX 4090 GPU. And 18,000 frames (around 10 minutes) long 🤯 7 wild demos: 1. Real-time demos on MobileStage dataset

Whoa, this is Temporal Gaussian Hierarchy (TGH). This AI can real-time render long volumetric videos in 1080p at 450 fps on a single RTX 4090 GPU. And 18,000 frames (around 10 minutes) long 🤯 7 wild demos: 1. Real-time demos on MobileStage dataset

Min Choi

464,126 views • 1 year ago

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,354 views • 1 year ago

A drone scan of the partial glacier collapse in Blatten, reconstructed using 3D Gaussian Splatting. New approaches to disaster visualization can provide a rapid overview of the situation.

A drone scan of the partial glacier collapse in Blatten, reconstructed using 3D Gaussian Splatting. New approaches to disaster visualization can provide a rapid overview of the situation.

MrNeRF

24,208 views • 1 year ago

100M Gaussians. Streamed on a single RTX 3090. Welcome to NVIDIA AI Developer 's fVDB Reality Capture — bringing 3D Gaussian Splatting, volumetric data, and OpenUSD into one pipeline. 🎥 Full demo → #NVIDIA #GaussianSplatting #3D

100M Gaussians. Streamed on a single RTX 3090. Welcome to NVIDIA AI Developer 's fVDB Reality Capture — bringing 3D Gaussian Splatting, volumetric data, and OpenUSD into one pipeline. 🎥 Full demo → #NVIDIA #GaussianSplatting #3D

Jonathan Stephens

36,725 views • 9 months ago

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 views • 2 years ago

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Ruilong Li

88,077 views • 2 years ago

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,776 views • 3 months ago

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,242 views • 2 years ago

Coding some shaders for 3D Gaussian Splatting 😀 Input is a 40 second video processed with Luma Check the reflections on the bag! Demo:

Coding some shaders for 3D Gaussian Splatting 😀 Input is a 40 second video processed with Luma Check the reflections on the bag! Demo:

Alexandre Devaux

44,165 views • 2 years ago

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI.

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI.

むっちゃん

90,945 views • 4 months ago

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:

Bernhard Kerbl

356,429 views • 2 years ago

Forget about #Sora. DUSt3R is the real deal. I took two pictures of our kitchen that barely overlap. It took << 2sec on a RTX 4090 to reconstruct it in an insane quality. Can we get out a point cloud for Gaussian Splatting #3DGS training + the camera poses?

Forget about #Sora. DUSt3R is the real deal. I took two pictures of our kitchen that barely overlap. It took << 2sec on a RTX 4090 to reconstruct it in an insane quality. Can we get out a point cloud for Gaussian Splatting #3DGS training + the camera poses?

MrNeRF

103,288 views • 2 years ago

I gave a talk on "Getting Started with 3D Gaussian Splatting" at the Khronos Group WebGL/WebGPU meetup. Check it out!

I gave a talk on "Getting Started with 3D Gaussian Splatting" at the Khronos Group WebGL/WebGPU meetup. Check it out!

Will Eastcott

11,510 views • 2 years ago

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer + automatic LOD streaming. 🧵

PlayCanvas

54,143 views • 2 months ago

Hosting a 3D Gaussian Splatting study session soon. Made a quick video comparing point cloud vs Gaussian Splats vs trained result, all with the same number of points. Hope it sparks some interest in #3DGS among the attendees.

Hosting a 3D Gaussian Splatting study session soon. Made a quick video comparing point cloud vs Gaussian Splats vs trained result, all with the same number of points. Hope it sparks some interest in #3DGS among the attendees.

Takashi Yoshinaga

17,593 views • 4 months ago

HoloDreamer can generate enclosed 3D scenes from text descriptions! It does so by first creating a high-quality equirectangular panorama and then rapidly reconstructing the 3D scene using 3D Gaussian Splatting. Links ⬇️

HoloDreamer can generate enclosed 3D scenes from text descriptions! It does so by first creating a high-quality equirectangular panorama and then rapidly reconstructing the 3D scene using 3D Gaussian Splatting. Links ⬇️

Dreaming Tulpa 🥓👑

59,377 views • 2 years ago