Radiance Fields's banner

Radiance Fields

@RadianceFields • 8,458 subscribers

News about radiance fields, including Gaussian Splatting & Neural Radiance Fields (NeRFs). Dell Precision Pro Ambassador | Khronos Group IC

Shorts

75 RED cameras shooting at 8K/120fps, capturing an entire live performance in a single take. What happens when you push 4D Gaussian Splatting to its limit?

75 RED cameras shooting at 8K/120fps, capturing an entire live performance in a single take. What happens when you push 4D Gaussian Splatting to its limit?

20,407 görüntüleme

Pretty much every person in LORD FLACKO JODYE II Helicopter video are dynamic gaussian splats.

Pretty much every person in LORD FLACKO JODYE II Helicopter video are dynamic gaussian splats.

63,109 görüntüleme

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

17,663 görüntüleme

Good news for splat workflows: Chaos now supports relighting in V-Ray Update 3.

Good news for splat workflows: Chaos now supports relighting in V-Ray Update 3.

11,487 görüntüleme

Esri just brought gaussian splatting to the web. ArcGIS Maps SDK 5.0 introduces a native GaussianSplatLayer for SceneView. Splats now stream directly into browser-based GIS apps.

Esri just brought gaussian splatting to the web. ArcGIS Maps SDK 5.0 introduces a native GaussianSplatLayer for SceneView. Splats now stream directly into browser-based GIS apps.

12,934 görüntüleme

The first public dynamic Gaussian Splatting implementation in VR is here from San Francisco based Gmix, compatible with WebXR and Apple Vision Pro. 🔗

The first public dynamic Gaussian Splatting implementation in VR is here from San Francisco based Gmix, compatible with WebXR and Apple Vision Pro. 🔗

31,612 görüntüleme

splaTV, developed by Kevin Kwok, is a browser-based implementation for experiencing dynamic Gaussian Splatting with Spacetime Gaussians. This newly released application supports both WebGL and WebXR technologies and is available under the MIT License. 🔗

splaTV, developed by Kevin Kwok, is a browser-based implementation for experiencing dynamic Gaussian Splatting with Spacetime Gaussians. This newly released application supports both WebGL and WebXR technologies and is available under the MIT License. 🔗

18,667 görüntüleme

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Apple just announced gaussian splatting is coming to Apple Maps at WWDC.

Apple just announced gaussian splatting is coming to Apple Maps at WWDC.

Radiance Fields

263,828 görüntüleme • 1 ay önce

For the people asking about 3D printing gaussian splats, this is honestly amazing.

For the people asking about 3D printing gaussian splats, this is honestly amazing.

Radiance Fields

192,035 görüntüleme • 1 ay önce

4DGS with 75 8K RED Cameras. Done by Prism AI, Aina, Deckard Render, and FutureDeluxe. Deep dive with the full creative team coming next week.

4DGS with 75 8K RED Cameras. Done by Prism AI, Aina, Deckard Render, and FutureDeluxe. Deep dive with the full creative team coming next week.

Radiance Fields

75,132 görüntüleme • 15 gün önce

NVIDIA just showed some new relighting capabilities using gaussians, though this is pure ray tracing (no splatting). TRON extends their ray tracing library (3DGRT) to get an editable 3D material scaffold.

NVIDIA just showed some new relighting capabilities using gaussians, though this is pure ray tracing (no splatting). TRON extends their ray tracing library (3DGRT) to get an editable 3D material scaffold.

Radiance Fields

28,421 görüntüleme • 25 gün önce

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brah Lynch

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brah Lynch

Radiance Fields

209,743 görüntüleme • 8 ay önce

Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

Radiance Fields

128,414 görüntüleme • 6 ay önce

It's a bird. It's a plane. It's gaussian splatting. When Framestore needed to bring Kryptonian tech to Earth, they turned to gaussian splatting. In the recently released Superman, every shot of Kal-El's parents is a dynamic splat. I spoke to the team at Framestore about capturing the splats at Infinite-Realities and how they used CG Nomads GSOPs in SideFX's Houdini to help make the highest profile public use of gaussian splatting to date. Article

Radiance Fields

102,814 görüntüleme • 10 ay önce

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Radiance Fields

79,314 görüntüleme • 9 ay önce

Radiance field reconstruction (Gaussian splatting) quality is getting a big step up. NVIDIA AI just released Physically-Plausible Image Signal Processing (PPISP) for Radiance Field Reconstruction. Apache 2.0 and coming to both gsplat and 3DGRUT. Code: Article: Authors: Isaac Deutsch, Nicolas Möenne-Loccoz, Zan Gojcic, Gavriel State NVIDIA AIDev

Radiance field reconstruction (Gaussian splatting) quality is getting a big step up. NVIDIA AI just released Physically-Plausible Image Signal Processing (PPISP) for Radiance Field Reconstruction. Apache 2.0 and coming to both gsplat and 3DGRUT. Code: Article: Authors: Isaac Deutsch, Nicolas Möenne-Loccoz, Zan Gojcic, Gavriel State NVIDIA AIDev

Radiance Fields

49,604 görüntüleme • 5 ay önce

When gaussian splatting just looks like normal video

When gaussian splatting just looks like normal video

Radiance Fields

48,895 görüntüleme • 6 ay önce

this is just wild. Car exteriors with gaussian splatting had been super difficult and now it's just done

this is just wild. Car exteriors with gaussian splatting had been super difficult and now it's just done

Radiance Fields

21,362 görüntüleme • 2 ay önce

Caught up in the Samsung Galaxy XR announcement hype is that they implied all of Google Maps Immersive View interiors are fully explorable with gaussian splatting.

Caught up in the Samsung Galaxy XR announcement hype is that they implied all of Google Maps Immersive View interiors are fully explorable with gaussian splatting.

Radiance Fields

63,864 görüntüleme • 9 ay önce

Gaussian splatting was everywhere at NAB Show. Here's a crazy 4DGS capture of me from 4DV.ai right on the show floor.

Gaussian splatting was everywhere at NAB Show. Here's a crazy 4DGS capture of me from 4DV.ai right on the show floor.

Radiance Fields

23,971 görüntüleme • 2 ay önce

NVIDIA just released Lyra 2.0 with code a day after World Labs launched Spark 2.0 and the results are legitimately insane.

NVIDIA just released Lyra 2.0 with code a day after World Labs launched Spark 2.0 and the results are legitimately insane.

Radiance Fields

25,278 görüntüleme • 3 ay önce

Over the next 30 seconds, you'll see more than 300K images of me, making 60 gaussian splats every second. Last year, I got to visit Infinite-Realities. We are open sourcing all 300K images, in addition to releasing 1800 trained plys for people to download. We are also releasing a free VR experience through Unity through Aras Pranckevičius 🇺🇦🇱🇹 plugin. Check out the higher quality video (there's also a BTS):

Over the next 30 seconds, you'll see more than 300K images of me, making 60 gaussian splats every second. Last year, I got to visit Infinite-Realities. We are open sourcing all 300K images, in addition to releasing 1800 trained plys for people to download. We are also releasing a free VR experience through Unity through Aras Pranckevičius 🇺🇦🇱🇹 plugin. Check out the higher quality video (there's also a BTS):

Radiance Fields

61,159 görüntüleme • 1 yıl önce

🚨Google and UCSD just introduced Radiance Meshes, a new radiance field representation that produces watertight meshes and renders faster than 3DGS. Code and demos are available now. Code: Demos:

🚨Google and UCSD just introduced Radiance Meshes, a new radiance field representation that produces watertight meshes and renders faster than 3DGS. Code and demos are available now. Code: Demos:

Radiance Fields

30,391 görüntüleme • 7 ay önce

𝗚𝗮𝘂𝘀𝘀𝗶𝗮𝗻 𝗦𝗽𝗹𝗮𝘁𝘁𝗶𝗻𝗴 𝗶𝘀 𝗻𝗼𝘄 𝗶𝗻 𝗗𝗮𝗩𝗶𝗻𝗰𝗶 𝗥𝗲𝘀𝗼𝗹𝘃𝗲! irrealix has just launched a Gaussian Splatting plugin for DaVinci Resolve 18 & 19! 📂 Import .ply files directly into DaVinci Resolve 🎯 Crop with Spherical or Box shapes, or the Y Plane 🔗 Combine up to 10 models in one scene 🎨 Colorize with Ramp using Spherical or Box shapes 🔍 Reveal models with Opacity Ramp animations 💥 Animate Splat Scale with Spherical or Box shapes 🌪️ Distort models with Noise for dynamic effects 🖥️ Real-time GPU export for optimized workflows 🎛️ Color grading for each model to match color temperature and brightness 🔗

𝗚𝗮𝘂𝘀𝘀𝗶𝗮𝗻 𝗦𝗽𝗹𝗮𝘁𝘁𝗶𝗻𝗴 𝗶𝘀 𝗻𝗼𝘄 𝗶𝗻 𝗗𝗮𝗩𝗶𝗻𝗰𝗶 𝗥𝗲𝘀𝗼𝗹𝘃𝗲! irrealix has just launched a Gaussian Splatting plugin for DaVinci Resolve 18 & 19! 📂 Import .ply files directly into DaVinci Resolve 🎯 Crop with Spherical or Box shapes, or the Y Plane 🔗 Combine up to 10 models in one scene 🎨 Colorize with Ramp using Spherical or Box shapes 🔍 Reveal models with Opacity Ramp animations 💥 Animate Splat Scale with Spherical or Box shapes 🌪️ Distort models with Noise for dynamic effects 🖥️ Real-time GPU export for optimized workflows 🎛️ Color grading for each model to match color temperature and brightness 🔗

Radiance Fields

50,550 görüntüleme • 1 yıl önce

Postshot just received its 1.0 release and is now out of beta. It has a tiered pricing structure, with a free tier. Existing Beta licenses will run for one more month. Article👇 Full Changelog

Postshot just received its 1.0 release and is now out of beta. It has a tiered pricing structure, with a free tier. Existing Beta licenses will run for one more month. Article👇 Full Changelog

Radiance Fields

29,751 görüntüleme • 11 ay önce

Triangles are back, again...again! Jan Held and team will release code next week, but they've made a sample Unity project available Project Page: Unity:

Triangles are back, again...again! Jan Held and team will release code next week, but they've made a sample Unity project available Project Page: Unity:

Radiance Fields

25,818 görüntüleme • 9 ay önce

XGRIDS just unveiled their most affordable camera, the PortalCam, and the gaussian splatting capture game just changed. It retails for $5K in the US and I've been using it for nearly a month, so ask me any question!

XGRIDS just unveiled their most affordable camera, the PortalCam, and the gaussian splatting capture game just changed. It retails for $5K in the US and I've been using it for nearly a month, so ask me any question!

Radiance Fields

24,300 görüntüleme • 10 ay önce