Radiance Fields's banner

Radiance Fields

@RadianceFields • 9,042 subscribers

News about radiance fields, including Gaussian Splatting & Neural Radiance Fields (NeRFs). Dell Pro Precision Ambassador | Khronos Group IC

Shorts

Pretty much every person in LORD FLACKO JODYE II Helicopter video are dynamic gaussian splats.

Pretty much every person in LORD FLACKO JODYE II Helicopter video are dynamic gaussian splats.

63,171 Aufrufe

75 RED cameras shooting at 8K/120fps, capturing an entire live performance in a single take. What happens when you push 4D Gaussian Splatting to its limit?

75 RED cameras shooting at 8K/120fps, capturing an entire live performance in a single take. What happens when you push 4D Gaussian Splatting to its limit?

21,322 Aufrufe

gaussian splatting formally announced by Insta360 for the X6. Captures process in the cloud. Splats won't be available in the US at launch :(

gaussian splatting formally announced by Insta360 for the X6. Captures process in the cloud. Splats won't be available in the US at launch :(

11,701 Aufrufe

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

18,084 Aufrufe

Good news for splat workflows: Chaos now supports relighting in V-Ray Update 3.

Good news for splat workflows: Chaos now supports relighting in V-Ray Update 3.

11,487 Aufrufe

Esri just brought gaussian splatting to the web. ArcGIS Maps SDK 5.0 introduces a native GaussianSplatLayer for SceneView. Splats now stream directly into browser-based GIS apps.

Esri just brought gaussian splatting to the web. ArcGIS Maps SDK 5.0 introduces a native GaussianSplatLayer for SceneView. Splats now stream directly into browser-based GIS apps.

12,962 Aufrufe

The first public dynamic Gaussian Splatting implementation in VR is here from San Francisco based Gmix, compatible with WebXR and Apple Vision Pro. 🔗

The first public dynamic Gaussian Splatting implementation in VR is here from San Francisco based Gmix, compatible with WebXR and Apple Vision Pro. 🔗

31,654 Aufrufe

splaTV, developed by Kevin Kwok, is a browser-based implementation for experiencing dynamic Gaussian Splatting with Spacetime Gaussians. This newly released application supports both WebGL and WebXR technologies and is available under the MIT License. 🔗

splaTV, developed by Kevin Kwok, is a browser-based implementation for experiencing dynamic Gaussian Splatting with Spacetime Gaussians. This newly released application supports both WebGL and WebXR technologies and is available under the MIT License. 🔗

18,667 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Apple just announced gaussian splatting is coming to Apple Maps at WWDC.

Apple just announced gaussian splatting is coming to Apple Maps at WWDC.

Radiance Fields

265,171 Aufrufe • vor 4 Monaten

jesus christ

jesus christ

Radiance Fields

93,574 Aufrufe • vor 1 Monat

For the people asking about 3D printing gaussian splats, this is honestly amazing.

For the people asking about 3D printing gaussian splats, this is honestly amazing.

Radiance Fields

193,440 Aufrufe • vor 4 Monaten

4DGS with 75 8K RED Cameras. Done by Prism AI, Aina, Deckard Render, and FutureDeluxe. Deep dive with the full creative team coming next week.

4DGS with 75 8K RED Cameras. Done by Prism AI, Aina, Deckard Render, and FutureDeluxe. Deep dive with the full creative team coming next week.

Radiance Fields

76,825 Aufrufe • vor 3 Monaten

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brad Lynch

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brad Lynch

Radiance Fields

209,804 Aufrufe • vor 11 Monaten

Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

Radiance Fields

128,745 Aufrufe • vor 9 Monaten

This guy just made Google Maps of coral reefs using gaussian splatting

This guy just made Google Maps of coral reefs using gaussian splatting

Radiance Fields

28,696 Aufrufe • vor 2 Monaten

My phone thinks I'm on 42nd Street, but I'm in the subway two levels down. GPS can't handle it, but VPS can. I feed gaussian splatting of a location and can then localize to provide directions. Here's it navigating me to the 4,5,6 train in NYC.

My phone thinks I'm on 42nd Street, but I'm in the subway two levels down. GPS can't handle it, but VPS can. I feed gaussian splatting of a location and can then localize to provide directions. Here's it navigating me to the 4,5,6 train in NYC.

Radiance Fields

23,616 Aufrufe • vor 1 Monat

4DGS from a single camera. 4DAnyone Create Anyone in 4D from a Casual Monocular Video (SIGGRAPH Asia) Project: Code (Apache 2.0): Model:

4DGS from a single camera. 4DAnyone Create Anyone in 4D from a Casual Monocular Video (SIGGRAPH Asia) Project: Code (Apache 2.0): Model:

Radiance Fields

25,501 Aufrufe • vor 2 Monaten

This is the last year I create content in 2D. To prove it I’m releasing an 11-minute 4DGS video in partnership with 4DV.ai where every single shot is dynamic 3D. Over the next 12–18 months, I'll be moving my filming exclusively to dynamic 3D. Thank you so much to NVIDIA AI and Dell Technologies for making this video possible.

This is the last year I create content in 2D. To prove it I’m releasing an 11-minute 4DGS video in partnership with 4DV.ai where every single shot is dynamic 3D. Over the next 12–18 months, I'll be moving my filming exclusively to dynamic 3D. Thank you so much to NVIDIA AI and Dell Technologies for making this video possible.

Radiance Fields

25,145 Aufrufe • vor 2 Monaten

It's a bird. It's a plane. It's gaussian splatting. When Framestore needed to bring Kryptonian tech to Earth, they turned to gaussian splatting. In the recently released Superman, every shot of Kal-El's parents is a dynamic splat. I spoke to the team at Framestore about capturing the splats at Infinite-Realities and how they used CG Nomads GSOPs in SideFX's Houdini to help make the highest profile public use of gaussian splatting to date. Article

Radiance Fields

102,814 Aufrufe • vor 1 Jahr

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Radiance Fields

79,314 Aufrufe • vor 1 Jahr

NVIDIA just showed some new relighting capabilities using gaussians, though this is pure ray tracing (no splatting). TRON extends their ray tracing library (3DGRT) to get an editable 3D material scaffold.

NVIDIA just showed some new relighting capabilities using gaussians, though this is pure ray tracing (no splatting). TRON extends their ray tracing library (3DGRT) to get an editable 3D material scaffold.

Radiance Fields

28,979 Aufrufe • vor 3 Monaten

Caught up in the Samsung Galaxy XR announcement hype is that they implied all of Google Maps Immersive View interiors are fully explorable with gaussian splatting.

Caught up in the Samsung Galaxy XR announcement hype is that they implied all of Google Maps Immersive View interiors are fully explorable with gaussian splatting.

Radiance Fields

63,864 Aufrufe • vor 1 Jahr

Radiance field reconstruction (Gaussian splatting) quality is getting a big step up. NVIDIA AI just released Physically-Plausible Image Signal Processing (PPISP) for Radiance Field Reconstruction. Apache 2.0 and coming to both gsplat and 3DGRUT. Code: Article: Authors: Isaac Deutsch, Nicolas Möenne-Loccoz, Zan Gojcic, Gavriel State NVIDIA AIDev

Radiance field reconstruction (Gaussian splatting) quality is getting a big step up. NVIDIA AI just released Physically-Plausible Image Signal Processing (PPISP) for Radiance Field Reconstruction. Apache 2.0 and coming to both gsplat and 3DGRUT. Code: Article: Authors: Isaac Deutsch, Nicolas Möenne-Loccoz, Zan Gojcic, Gavriel State NVIDIA AIDev

Radiance Fields

49,714 Aufrufe • vor 9 Monaten

When gaussian splatting just looks like normal video

When gaussian splatting just looks like normal video

Radiance Fields

48,992 Aufrufe • vor 9 Monaten

Over the next 30 seconds, you'll see more than 300K images of me, making 60 gaussian splats every second. Last year, I got to visit Infinite-Realities. We are open sourcing all 300K images, in addition to releasing 1800 trained plys for people to download. We are also releasing a free VR experience through Unity through Aras Pranckevičius 🇺🇦🇱🇹 plugin. Check out the higher quality video (there's also a BTS):

Over the next 30 seconds, you'll see more than 300K images of me, making 60 gaussian splats every second. Last year, I got to visit Infinite-Realities. We are open sourcing all 300K images, in addition to releasing 1800 trained plys for people to download. We are also releasing a free VR experience through Unity through Aras Pranckevičius 🇺🇦🇱🇹 plugin. Check out the higher quality video (there's also a BTS):

Radiance Fields

61,300 Aufrufe • vor 1 Jahr

Gaussian splatting was everywhere at NAB Show. Here's a crazy 4DGS capture of me from 4DV.ai right on the show floor.

Gaussian splatting was everywhere at NAB Show. Here's a crazy 4DGS capture of me from 4DV.ai right on the show floor.

Radiance Fields

25,329 Aufrufe • vor 5 Monaten

NVIDIA just released Lyra 2.0 with code a day after World Labs launched Spark 2.0 and the results are legitimately insane.

NVIDIA just released Lyra 2.0 with code a day after World Labs launched Spark 2.0 and the results are legitimately insane.

Radiance Fields

25,389 Aufrufe • vor 6 Monaten

this is just wild. Car exteriors with gaussian splatting had been super difficult and now it's just done

this is just wild. Car exteriors with gaussian splatting had been super difficult and now it's just done

Radiance Fields

21,399 Aufrufe • vor 5 Monaten