Radiance Fields's banner

Radiance Fields

@RadianceFields • 8,877 subscribers

News about radiance fields, including Gaussian Splatting & Neural Radiance Fields (NeRFs). Dell Precision Pro Ambassador | Khronos Group IC

Shorts

75 RED cameras shooting at 8K/120fps, capturing an entire live performance in a single take. What happens when you push 4D Gaussian Splatting to its limit?

75 RED cameras shooting at 8K/120fps, capturing an entire live performance in a single take. What happens when you push 4D Gaussian Splatting to its limit?

21,167 просмотров

gaussian splatting formally announced by Insta360 for the X6. Captures process in the cloud. Splats won't be available in the US at launch :(

gaussian splatting formally announced by Insta360 for the X6. Captures process in the cloud. Splats won't be available in the US at launch :(

11,461 просмотров

Pretty much every person in LORD FLACKO JODYE II Helicopter video are dynamic gaussian splats.

Pretty much every person in LORD FLACKO JODYE II Helicopter video are dynamic gaussian splats.

63,171 просмотров

Pretty much most splat reconstructions should use this. Learn about how PPISP works straight from the lead author in our most recent podcast episode.

Pretty much most splat reconstructions should use this. Learn about how PPISP works straight from the lead author in our most recent podcast episode.

21,782 просмотров

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

18,084 просмотров

Good news for splat workflows: Chaos now supports relighting in V-Ray Update 3.

Good news for splat workflows: Chaos now supports relighting in V-Ray Update 3.

11,487 просмотров

Esri just brought gaussian splatting to the web. ArcGIS Maps SDK 5.0 introduces a native GaussianSplatLayer for SceneView. Splats now stream directly into browser-based GIS apps.

Esri just brought gaussian splatting to the web. ArcGIS Maps SDK 5.0 introduces a native GaussianSplatLayer for SceneView. Splats now stream directly into browser-based GIS apps.

12,948 просмотров

The first public dynamic Gaussian Splatting implementation in VR is here from San Francisco based Gmix, compatible with WebXR and Apple Vision Pro. 🔗

The first public dynamic Gaussian Splatting implementation in VR is here from San Francisco based Gmix, compatible with WebXR and Apple Vision Pro. 🔗

31,650 просмотров

splaTV, developed by Kevin Kwok, is a browser-based implementation for experiencing dynamic Gaussian Splatting with Spacetime Gaussians. This newly released application supports both WebGL and WebXR technologies and is available under the MIT License. 🔗

splaTV, developed by Kevin Kwok, is a browser-based implementation for experiencing dynamic Gaussian Splatting with Spacetime Gaussians. This newly released application supports both WebGL and WebXR technologies and is available under the MIT License. 🔗

18,667 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

jesus christ

jesus christ

Radiance Fields

91,781 просмотров • 6 дней назад

Apple just announced gaussian splatting is coming to Apple Maps at WWDC.

Apple just announced gaussian splatting is coming to Apple Maps at WWDC.

Radiance Fields

264,879 просмотров • 3 месяцев назад

For the people asking about 3D printing gaussian splats, this is honestly amazing.

For the people asking about 3D printing gaussian splats, this is honestly amazing.

Radiance Fields

193,186 просмотров • 2 месяцев назад

My phone thinks I'm on 42nd Street, but I'm in the subway two levels down. GPS can't handle it, but VPS can. I feed gaussian splatting of a location and can then localize to provide directions. Here's it navigating me to the 4,5,6 train in NYC.

My phone thinks I'm on 42nd Street, but I'm in the subway two levels down. GPS can't handle it, but VPS can. I feed gaussian splatting of a location and can then localize to provide directions. Here's it navigating me to the 4,5,6 train in NYC.

Radiance Fields

22,793 просмотров • 12 дней назад

This guy just made Google Maps of coral reefs using gaussian splatting

This guy just made Google Maps of coral reefs using gaussian splatting

Radiance Fields

28,401 просмотров • 18 дней назад

4DGS with 75 8K RED Cameras. Done by Prism AI, Aina, Deckard Render, and FutureDeluxe. Deep dive with the full creative team coming next week.

4DGS with 75 8K RED Cameras. Done by Prism AI, Aina, Deckard Render, and FutureDeluxe. Deep dive with the full creative team coming next week.

Radiance Fields

76,617 просмотров • 2 месяцев назад

4DGS from a single camera. 4DAnyone Create Anyone in 4D from a Casual Monocular Video (SIGGRAPH Asia) Project: Code (Apache 2.0): Model:

4DGS from a single camera. 4DAnyone Create Anyone in 4D from a Casual Monocular Video (SIGGRAPH Asia) Project: Code (Apache 2.0): Model:

Radiance Fields

25,056 просмотров • 18 дней назад

This is the last year I create content in 2D. To prove it I’m releasing an 11-minute 4DGS video in partnership with 4DV.ai where every single shot is dynamic 3D. Over the next 12–18 months, I'll be moving my filming exclusively to dynamic 3D. Thank you so much to NVIDIA AI and Dell Technologies for making this video possible.

This is the last year I create content in 2D. To prove it I’m releasing an 11-minute 4DGS video in partnership with 4DV.ai where every single shot is dynamic 3D. Over the next 12–18 months, I'll be moving my filming exclusively to dynamic 3D. Thank you so much to NVIDIA AI and Dell Technologies for making this video possible.

Radiance Fields

23,755 просмотров • 24 дней назад

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brad Lynch

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brad Lynch

Radiance Fields

209,804 просмотров • 10 месяцев назад

Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

Radiance Fields

128,650 просмотров • 7 месяцев назад

NVIDIA just showed some new relighting capabilities using gaussians, though this is pure ray tracing (no splatting). TRON extends their ray tracing library (3DGRT) to get an editable 3D material scaffold.

NVIDIA just showed some new relighting capabilities using gaussians, though this is pure ray tracing (no splatting). TRON extends their ray tracing library (3DGRT) to get an editable 3D material scaffold.

Radiance Fields

28,979 просмотров • 2 месяцев назад

It's a bird. It's a plane. It's gaussian splatting. When Framestore needed to bring Kryptonian tech to Earth, they turned to gaussian splatting. In the recently released Superman, every shot of Kal-El's parents is a dynamic splat. I spoke to the team at Framestore about capturing the splats at Infinite-Realities and how they used CG Nomads GSOPs in SideFX's Houdini to help make the highest profile public use of gaussian splatting to date. Article

Radiance Fields

102,814 просмотров • 1 год назад

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Radiance Fields

79,314 просмотров • 11 месяцев назад

Radiance field reconstruction (Gaussian splatting) quality is getting a big step up. NVIDIA AI just released Physically-Plausible Image Signal Processing (PPISP) for Radiance Field Reconstruction. Apache 2.0 and coming to both gsplat and 3DGRUT. Code: Article: Authors: Isaac Deutsch, Nicolas Möenne-Loccoz, Zan Gojcic, Gavriel State NVIDIA AIDev

Radiance field reconstruction (Gaussian splatting) quality is getting a big step up. NVIDIA AI just released Physically-Plausible Image Signal Processing (PPISP) for Radiance Field Reconstruction. Apache 2.0 and coming to both gsplat and 3DGRUT. Code: Article: Authors: Isaac Deutsch, Nicolas Möenne-Loccoz, Zan Gojcic, Gavriel State NVIDIA AIDev

Radiance Fields

49,604 просмотров • 7 месяцев назад

Caught up in the Samsung Galaxy XR announcement hype is that they implied all of Google Maps Immersive View interiors are fully explorable with gaussian splatting.

Caught up in the Samsung Galaxy XR announcement hype is that they implied all of Google Maps Immersive View interiors are fully explorable with gaussian splatting.

Radiance Fields

63,864 просмотров • 10 месяцев назад

When gaussian splatting just looks like normal video

When gaussian splatting just looks like normal video

Radiance Fields

48,962 просмотров • 7 месяцев назад

People keep sleeping on Esri, but they are processing splats with millions of images at a time. These are all splats from their User Conference this month

People keep sleeping on Esri, but they are processing splats with millions of images at a time. These are all splats from their User Conference this month

Radiance Fields

12,486 просмотров • 1 месяц назад

Gaussian splatting was everywhere at NAB Show. Here's a crazy 4DGS capture of me from 4DV.ai right on the show floor.

Gaussian splatting was everywhere at NAB Show. Here's a crazy 4DGS capture of me from 4DV.ai right on the show floor.

Radiance Fields

24,515 просмотров • 4 месяцев назад

this is just wild. Car exteriors with gaussian splatting had been super difficult and now it's just done

this is just wild. Car exteriors with gaussian splatting had been super difficult and now it's just done

Radiance Fields

21,362 просмотров • 3 месяцев назад

NVIDIA just released Lyra 2.0 with code a day after World Labs launched Spark 2.0 and the results are legitimately insane.

NVIDIA just released Lyra 2.0 with code a day after World Labs launched Spark 2.0 and the results are legitimately insane.

Radiance Fields

25,278 просмотров • 4 месяцев назад