Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

📢 Check out 𝗥𝗲𝗹𝗶𝗴𝗵𝘁𝗮𝗯𝗹𝗲 𝗚𝗮𝘂𝘀𝘀𝗶𝗮𝗻 𝗖𝗼𝗱𝗲𝗰 𝗔𝘃𝗮𝘁𝗮𝗿𝘀! Our latest codec avatars using 3D Gaussians generalize to novel lighting (OLAT, envmap) with all-frequency reflection (see video for hair and eye reflection) in real-time!

Shunsuke Saito

4,521 subscribers

45,970 views • 2 years ago •via X (Twitter)

Science & Technology Arts Education

Anya Rossi• Live Now

Private livecam show

8 Comments

Infinite-Realities2 years ago

Incredible work.

Shunsuke Saito2 years ago

Thanks!!

darthgera1232 years ago

Congrats on the paper. Really impressive

Shunsuke Saito2 years ago

Thank you!!

John2 years ago

Great work! Is this open source?

MJW2 years ago

Incredible.

Lee2 years ago

Impressive!

HEROmustache2 years ago

that is incredible

Related Videos

📢📢📢Data release: high-res, multi-view, OLAT face recordings 📢📢📢 We captured individuals in our custom light stage with 16 high-end, global shutter cameras (72 fps) and 40 LED modules, totaling 2.8M precisely calibrated frames. We us the data for BecomingLit (#NeurIPS2025): intrinsically decomposed Gaussian avatars, enabling photorealistic and real-time relighting via hybrid neural shading. Code & Data: Great work by Jonathan Schmidt, Simon Giebenhain

📢📢📢Data release: high-res, multi-view, OLAT face recordings 📢📢📢 We captured individuals in our custom light stage with 16 high-end, global shutter cameras (72 fps) and 40 LED modules, totaling 2.8M precisely calibrated frames. We us the data for BecomingLit (#NeurIPS2025): intrinsically decomposed Gaussian avatars, enabling photorealistic and real-time relighting via hybrid neural shading. Code & Data: Great work by Jonathan Schmidt, Simon Giebenhain

Matthias Niessner

19,473 views • 6 months ago

📢📢 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐒𝐩𝐞𝐞𝐜𝐡: Audio-Driven Gaussian Avatars 📢📢 We synthesize photorealistic and 3D-consistent talking human head avatars driven directly from spoken audio. More specifically, we introduce an efficient 3DGS-based representation, combined with an audio-conditioned transformer, to generate realistic and high-quality animations. Our method can easily generalize to a variety of in the wild scenarios like songs, foreign languages etc. We further introduce a new multiview dataset of native English speakers with overall recording time of ∼3.5 hours. Project: Video: Great work by Shivangi, Artem Sevastopolsky, Tobias Kirschstein, Justus Thies, Angela Dai

📢📢 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐒𝐩𝐞𝐞𝐜𝐡: Audio-Driven Gaussian Avatars 📢📢 We synthesize photorealistic and 3D-consistent talking human head avatars driven directly from spoken audio. More specifically, we introduce an efficient 3DGS-based representation, combined with an audio-conditioned transformer, to generate realistic and high-quality animations. Our method can easily generalize to a variety of in the wild scenarios like songs, foreign languages etc. We further introduce a new multiview dataset of native English speakers with overall recording time of ∼3.5 hours. Project: Video: Great work by Shivangi, Artem Sevastopolsky, Tobias Kirschstein, Justus Thies, Angela Dai

Matthias Niessner

22,641 views • 1 year ago

To showcase Simulon's capability with high-fidelity assets and to highlight the difference between what you see in real-time AR versus the precision of offline cloud rendering, we've made a video using a detailed human scan by 3D Scanstore. Our workflow was designed to closely align the visuals in real-time AR with our offline cloud renders. The video below demonstrates this, transitioning between the AR preview and the final cloud render. This preview lets creators foresee the final VFX shot, reducing guesswork in lighting and composition.

To showcase Simulon's capability with high-fidelity assets and to highlight the difference between what you see in real-time AR versus the precision of offline cloud rendering, we've made a video using a detailed human scan by 3D Scanstore. Our workflow was designed to closely align the visuals in real-time AR with our offline cloud renders. The video below demonstrates this, transitioning between the AR preview and the final cloud render. This preview lets creators foresee the final VFX shot, reducing guesswork in lighting and composition.

Divesh Naidoo

265,602 views • 2 years ago

📢 LinPrim: Linear Primitives for Differentiable Volumetric Rendering 📢 We use octahedra or tetrahedra as explicit as volumetric building blocks for gradient-based novel view synthesis - as an alternative to 3D Gaussians with discrete, bounded geometry. We show how it can be used to reconstruct photorealistic scenes, and introduce a corresponding differentiable CUDA rasterizer that enables real-time rendering. On real-world scenes, LinPrim achieves comparable image quality with fewer primitives, adding a practical polyhedral option to the 3D scene representation toolbox and expanding the known design space. 🌍 🎥 Amazing work by Nicolas von Lützow!

📢 LinPrim: Linear Primitives for Differentiable Volumetric Rendering 📢 We use octahedra or tetrahedra as explicit as volumetric building blocks for gradient-based novel view synthesis - as an alternative to 3D Gaussians with discrete, bounded geometry. We show how it can be used to reconstruct photorealistic scenes, and introduce a corresponding differentiable CUDA rasterizer that enables real-time rendering. On real-world scenes, LinPrim achieves comparable image quality with fewer primitives, adding a practical polyhedral option to the 3D scene representation toolbox and expanding the known design space. 🌍 🎥 Amazing work by Nicolas von Lützow!

Matthias Niessner

11,413 views • 1 year ago

It's time for another Pick'Em prediction game, and HLTV writers are ready to battle it out with AI once more 🔮 Check out our picks for Stage 1 of Cologne Major in this latest video, brought to you by Lucky Coin

It's time for another Pick'Em prediction game, and HLTV writers are ready to battle it out with AI once more 🔮 Check out our picks for Stage 1 of Cologne Major in this latest video, brought to you by Lucky Coin

HLTV.org

27,196 views • 2 months ago

Our new Gaussian point splatting renders huge 3DGS scenes in real time (e.g. 425 M⬇️). It samples pixel-sized points from the Gaussians with massive parallelism and splats them to the screen using 64-bit atomics. Grab ACM SIGGRAPH 2026 paper+code+video now:

Our new Gaussian point splatting renders huge 3DGS scenes in real time (e.g. 425 M⬇️). It samples pixel-sized points from the Gaussians with massive parallelism and splats them to the screen using 64-bit atomics. Grab ACM SIGGRAPH 2026 paper+code+video now:

Christoph Peters

22,818 views • 2 months ago

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

140,992 views • 2 years ago

Kicking off the year with vigour and dedication! 🌟 Dive into our latest plans and see how the #NationalEconomicCouncil is setting the stage for a groundbreaking year. Check out the video below for all the details! #Progress #Innovation #EconomicGrowth"

Kicking off the year with vigour and dedication! 🌟 Dive into our latest plans and see how the #NationalEconomicCouncil is setting the stage for a groundbreaking year. Check out the video below for all the details! #Progress #Innovation #EconomicGrowth"

H.E. Amb. Mohamed Osman, Ph.D. أ.د. محمد عثمان

239,298 views • 2 years ago

Lucario ReUnited 🐾 for VRChat is finally out! After all this time it is indeed real! It is a free to use avatar with an optional early access and support stuff so I can make more avatars like this for y'all to use Check thread for more info

Monado Art!

213,942 views • 3 months ago

(1/2) Filmmakers, it's time to #FindYourFlow. This week, we’re talking about lighting.💡 You can use light to create mood, draw the eye, and tell a better story. This isn't just about brightening things up; it's about creating an atmosphere. Looking for ways to describe lighting in your prompts? Check out our thread below ⬇️

(1/2) Filmmakers, it's time to #FindYourFlow. This week, we’re talking about lighting.💡 You can use light to create mood, draw the eye, and tell a better story. This isn't just about brightening things up; it's about creating an atmosphere. Looking for ways to describe lighting in your prompts? Check out our thread below ⬇️

Google Labs

30,569 views • 11 months ago

Check out the accolade trailer for Monster Hunter Stories 3: Twisted Reflection, the evolution of our turn-based RPG series set in the world of Monster Hunter! Start your story with the free demo, available now on all platforms, then carry your save data over to the full game.

Check out the accolade trailer for Monster Hunter Stories 3: Twisted Reflection, the evolution of our turn-based RPG series set in the world of Monster Hunter! Start your story with the free demo, available now on all platforms, then carry your save data over to the full game.

Monster Hunter

100,199 views • 4 months ago

If you're looking to master 3D Compositing for Virtual Production in Unreal Engine with Composure, veteran VFX artist Dean Yurke - Unreal Engine and VFX Filmmaking has the green screen and CG character integration insights you need🎥 Retain plate shadows, embed video in Fog and VDBs, hold out your plate with the environment—all in real-time and in context. Check out the multi-episode series exploring low cost virtual production using the new camera mapping workflow in Composure here:

If you're looking to master 3D Compositing for Virtual Production in Unreal Engine with Composure, veteran VFX artist Dean Yurke - Unreal Engine and VFX Filmmaking has the green screen and CG character integration insights you need🎥 Retain plate shadows, embed video in Fog and VDBs, hold out your plate with the environment—all in real-time and in context. Check out the multi-episode series exploring low cost virtual production using the new camera mapping workflow in Composure here:

Unreal Engine

23,093 views • 4 months ago

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

Abdullah Hamdi

71,661 views • 1 year ago

We just dropped the tutorials showing how incredibly easy it is to install and customize BeatScreen! A dynamic screen for #VRChat that reacts in real time to video and music using AudioLink. Check it out 👇

We just dropped the tutorials showing how incredibly easy it is to install and customize BeatScreen! A dynamic screen for #VRChat that reacts in real time to video and music using AudioLink. Check it out 👇

DX

34,924 views • 3 months ago

EnvGS: Modeling View-Dependent Appearance with Environment Gaussian Contributions: • We propose a novel scene representation for accurately modeling complex near-field and high-frequency reflections in real-world environments. • We developed a real-time ray-tracing renderer for 2DGS, enabling joint optimization of our representation for accurate scene reconstruction while achieving real-time rendering speeds. • Extensive experiments show that EnvGS significantly outperforms previous methods. To the best of our knowledge, EnvGS is the first method to achieve real-time photorealistic specular reflections synthesis in real-world scenes.

EnvGS: Modeling View-Dependent Appearance with Environment Gaussian Contributions: • We propose a novel scene representation for accurately modeling complex near-field and high-frequency reflections in real-world environments. • We developed a real-time ray-tracing renderer for 2DGS, enabling joint optimization of our representation for accurate scene reconstruction while achieving real-time rendering speeds. • Extensive experiments show that EnvGS significantly outperforms previous methods. To the best of our knowledge, EnvGS is the first method to achieve real-time photorealistic specular reflections synthesis in real-world scenes.

MrNeRF

44,650 views • 1 year ago

📷 Check out our latest video to reconnect with Agora's Vision, Mission, and our journey so far! 📷 There's plenty more in store, as we aim for bigger and better things ahead! Watch now and get inspired! #gamefi

📷 Check out our latest video to reconnect with Agora's Vision, Mission, and our journey so far! 📷 There's plenty more in store, as we aim for bigger and better things ahead! Watch now and get inspired! #gamefi

Agora - Web3's Opportunity Arena

33,508 views • 2 years ago

Enter the SPLATRIX! We digitized Henry Pearce and converted him over to 4DGS to be played back in real-time. 3D Gaussians Splats in Motion. 4DGS. Our goal was to improve the quality of our AeonX & 4DGS pipeline, with automated background removal to retain fine hair details as well as to improve overall surface consistency on a full torso capture. We're currently using a post process to temporally filter the 2D frames. We still need to solve 4DGS temporal stability. We're hoping to test with Jonathon Luiten dynamic gaussian code soon... 🙏 for that script! We captured this performance under global illumination. This is an easy task compared to RGB+W lighting, which is going to be much harder! This is our next challenge. We're posting these snippet videos to show our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon. 3D Gaussian Splatting #GaussianSplatting #inria #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #60fps More info here - Higher Quality Videos:

Enter the SPLATRIX! We digitized Henry Pearce and converted him over to 4DGS to be played back in real-time. 3D Gaussians Splats in Motion. 4DGS. Our goal was to improve the quality of our AeonX & 4DGS pipeline, with automated background removal to retain fine hair details as well as to improve overall surface consistency on a full torso capture. We're currently using a post process to temporally filter the 2D frames. We still need to solve 4DGS temporal stability. We're hoping to test with Jonathon Luiten dynamic gaussian code soon... 🙏 for that script! We captured this performance under global illumination. This is an easy task compared to RGB+W lighting, which is going to be much harder! This is our next challenge. We're posting these snippet videos to show our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon. 3D Gaussian Splatting #GaussianSplatting #inria #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #60fps More info here - Higher Quality Videos:

Infinite-Realities

90,662 views • 2 years ago

SqueezeMe: Efficient Gaussian Avatars for VR TL;DR: Three of these Gaussian Splatting avatars can be run at 72 frames per second. It runs locally on a Meta Quest 3 VR headset. Abstract (excerpt): While previous methods require a desktop GPU for real-time inference of a single avatar, we aim to squeeze multiple Gaussian avatars onto a portable virtual reality headset with real-time drivable inference. We begin by training a previous work, Animatable Gaussians, on a high-quality dataset captured with 512 cameras. The Gaussians are animated by controlling a base set of Gaussians with linear blend skinning (LBS) motion, and then further adjusting them with a neural network decoder to correct their appearance. When deploying the model on a Meta Quest 3 VR headset, we find two major computational bottlenecks: the decoder and the rendering. To accelerate the decoder, we train the Gaussians in UV-space instead of pixel-space and distill the decoder to a single neural network layer. Further, we discover that neighborhoods of Gaussians can share a single corrective from the decoder, providing an additional speedup. To accelerate the rendering, we develop a custom pipeline in Vulkan that runs on the mobile GPU. Putting it all together, we run 3 Gaussian avatars concurrently at 72 FPS on a VR headset.

MrNeRF

27,104 views • 1 year ago

🥁 The winners of the Google Maps Platform Awards are now live, and the Grand Prize goes to Innobrix! 🎉 The 3D configuration platform combines BIM data with Google Maps to provide real-world context for developments. 📢 Check it out along with the rest of our winners ⬇️

🥁 The winners of the Google Maps Platform Awards are now live, and the Grand Prize goes to Innobrix! 🎉 The 3D configuration platform combines BIM data with Google Maps to provide real-world context for developments. 📢 Check it out along with the rest of our winners ⬇️

Google Maps Platform

14,361 views • 10 months ago