Loading video...

Video Failed to Load

Go Home

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

zianwang97's profile picture

Zian Wang

1,170 subscribers

125,321 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :
1:04

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

MrNeRF

59,480 views • 2 years ago

InsertAnywhere Bridging 4D Scene Geometry and Diffusion Models for Realistic Video Object Insertion
0:21

InsertAnywhere Bridging 4D Scene Geometry and Diffusion Models for Realistic Video Object Insertion

AK

26,123 views • 5 months ago

Introducing the new era of rendering, powered by GeForce RTX 50 Series and AI ‘Zorah’ is our new groundbreaking RTX neural rendering tech demo that highlights the latest innovations in shader, geometry, lighting and character technologies. #CES2025
1:36

Introducing the new era of rendering, powered by GeForce RTX 50 Series and AI ‘Zorah’ is our new groundbreaking RTX neural rendering tech demo that highlights the latest innovations in shader, geometry, lighting and character technologies. #CES2025

NVIDIA GeForce

117,114 views • 1 year ago

"ROSE: Remove Objects with Side Effects in Videos" TL;DR: Diffusion transformer; five common cases: shadows, reflections, light, translucency and mirror as video side effects to remove
0:45

"ROSE: Remove Objects with Side Effects in Videos" TL;DR: Diffusion transformer; five common cases: shadows, reflections, light, translucency and mirror as video side effects to remove

Alexandre Morgand

85,858 views • 9 months ago

How do we go beyond reconstructing colors and recovering the intrinsic scene properties? 🤔 👁️ IRIS: Inverse Rendering of Indoor Scenes IRIS estimates accurate material, lighting, and camera response functions given a set of LDR images, enabling photorealistic and view-consistent relighting and object insertion.
0:22

How do we go beyond reconstructing colors and recovering the intrinsic scene properties? 🤔 👁️ IRIS: Inverse Rendering of Indoor Scenes IRIS estimates accurate material, lighting, and camera response functions given a set of LDR images, enabling photorealistic and view-consistent relighting and object insertion.

Jia-Bin Huang

15,917 views • 1 year ago

Introducing FLARE #CVPR2026 2025 FLARE is a feed-forward model that simultaneously estimates high-quality camera poses, 3D geometry, and appearance from sparse uncalibrated images. 1/4
0:29

Introducing FLARE #CVPR2026 2025 FLARE is a feed-forward model that simultaneously estimates high-quality camera poses, 3D geometry, and appearance from sparse uncalibrated images. 1/4

Gordon Wetzstein

29,518 views • 1 year ago

🎬Dive into Hunyuan 3D 2.1, featuring high-precision geometry and PBR textures for stunningly realistic rendering. Get started with our comprehensive open-source package and tutorials⬇️ Model: Github: Hunyuan 3D Creation Engine:
0:36

🎬Dive into Hunyuan 3D 2.1, featuring high-precision geometry and PBR textures for stunningly realistic rendering. Get started with our comprehensive open-source package and tutorials⬇️ Model: Github: Hunyuan 3D Creation Engine:

Hunyuan

28,407 views • 11 months ago

Light it your way — instantly. Introducing Relighting on Akool ✨ Turn any video into a professionally lit scene with just a few clicks. No studio. No expensive equipment. No reshoots. With Akool Relighting, you can: • Adjust lighting direction and mood • Enhance subject clarity and depth • Transform environments instantly • Create cinematic-quality visuals in seconds From bright daylight to dramatic studio lighting, all powered by AI. Create stunning visuals without the setup. That’s the power of Akool Relighting.
0:20

Light it your way — instantly. Introducing Relighting on Akool ✨ Turn any video into a professionally lit scene with just a few clicks. No studio. No expensive equipment. No reshoots. With Akool Relighting, you can: • Adjust lighting direction and mood • Enhance subject clarity and depth • Transform environments instantly • Create cinematic-quality visuals in seconds From bright daylight to dramatic studio lighting, all powered by AI. Create stunning visuals without the setup. That’s the power of Akool Relighting.

Akool Inc

4,193,352 views • 1 month ago

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.
0:24

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

World Labs

15,870 views • 7 months ago

⚡️ NeuralAI Presents: World Engine Teaser 🌏 THE GAME ENGINE REIMAGINED Generate full scale maps, scenes, and entire worlds in collaboration mode with the World Engine, the ultimate AI-powered game engine! Real-time Unleashed Crisp Visuals at AAA Quality Real-time Asset Generation AI Agent Integration and Tokenisation ...And much more! Powered by $NEURAL Ready to create your world? 🚀 🧑‍🚀
0:55

⚡️ NeuralAI Presents: World Engine Teaser 🌏 THE GAME ENGINE REIMAGINED Generate full scale maps, scenes, and entire worlds in collaboration mode with the World Engine, the ultimate AI-powered game engine! Real-time Unleashed Crisp Visuals at AAA Quality Real-time Asset Generation AI Agent Integration and Tokenisation ...And much more! Powered by $NEURAL Ready to create your world? 🚀 🧑‍🚀

NeuralAI

98,975 views • 1 year ago

Compositing Realistic Shadows and Reflections in Photoshop 2024
0:57

Compositing Realistic Shadows and Reflections in Photoshop 2024

Photoshop Tricks!

24,738 views • 1 year ago

Introducing Generative Omnimatte: A method for decomposing a video into complete layers, including objects and their associated effects (e.g., shadows, reflections). It enables many cool applications, such as video stylization, compositions, moment retiming, and object removal.
0:47

Introducing Generative Omnimatte: A method for decomposing a video into complete layers, including objects and their associated effects (e.g., shadows, reflections). It enables many cool applications, such as video stylization, compositions, moment retiming, and object removal.

Jia-Bin Huang

81,713 views • 1 year ago

Added Materials and reflections to my Blockbench upcoming Rendering Plugin.🪩
0:39

Added Materials and reflections to my Blockbench upcoming Rendering Plugin.🪩

Cazfps

21,784 views • 5 months ago

Announcing NVIDIA DLSS 5, an AI-powered breakthrough in visual fidelity for games, coming this fall. DLSS 5 infuses pixels with photorealistic lighting and materials, bridging the gap between rendering and reality.
1:07

Announcing NVIDIA DLSS 5, an AI-powered breakthrough in visual fidelity for games, coming this fall. DLSS 5 infuses pixels with photorealistic lighting and materials, bridging the gap between rendering and reality.

NVIDIA GeForce UK

2,468,124 views • 2 months ago

Announcing NVIDIA DLSS 5, an AI-powered breakthrough in visual fidelity for games, coming this fall. DLSS 5 infuses pixels with photorealistic lighting and materials, bridging the gap between rendering and reality. Learn More →
1:10

Announcing NVIDIA DLSS 5, an AI-powered breakthrough in visual fidelity for games, coming this fall. DLSS 5 infuses pixels with photorealistic lighting and materials, bridging the gap between rendering and reality. Learn More →

NVIDIA GeForce

95,083,472 views • 2 months ago

MaterialFusion Enhancing Inverse Rendering with Material Diffusion Priors discuss: Recent works in inverse rendering have shown promise in using multi-view images of an object to recover shape, albedo, and materials. However, the recovered components often fail to render accurately under new lighting conditions due to the intrinsic challenge of disentangling albedo and material properties from input images. To address this challenge, we introduce MaterialFusion, an enhanced conventional 3D inverse rendering pipeline that incorporates a 2D prior on texture and material properties. We present StableMaterial, a 2D diffusion model prior that refines multi-lit data to estimate the most likely albedo and material from given input appearances. This model is trained on albedo, material, and relit image data derived from a curated dataset of approximately ~12K artist-designed synthetic Blender objects called BlenderVault. we incorporate this diffusion prior with an inverse rendering framework where we use score distillation sampling (SDS) to guide the optimization of the albedo and materials, improving relighting performance in comparison with previous work. We validate MaterialFusion's relighting performance on 4 datasets of synthetic and real objects under diverse illumination conditions, showing our diffusion-aided approach significantly improves the appearance of reconstructed objects under novel lighting conditions. We intend to publicly release our BlenderVault dataset to support further research in this field.
0:43

MaterialFusion Enhancing Inverse Rendering with Material Diffusion Priors discuss: Recent works in inverse rendering have shown promise in using multi-view images of an object to recover shape, albedo, and materials. However, the recovered components often fail to render accurately under new lighting conditions due to the intrinsic challenge of disentangling albedo and material properties from input images. To address this challenge, we introduce MaterialFusion, an enhanced conventional 3D inverse rendering pipeline that incorporates a 2D prior on texture and material properties. We present StableMaterial, a 2D diffusion model prior that refines multi-lit data to estimate the most likely albedo and material from given input appearances. This model is trained on albedo, material, and relit image data derived from a curated dataset of approximately ~12K artist-designed synthetic Blender objects called BlenderVault. we incorporate this diffusion prior with an inverse rendering framework where we use score distillation sampling (SDS) to guide the optimization of the albedo and materials, improving relighting performance in comparison with previous work. We validate MaterialFusion's relighting performance on 4 datasets of synthetic and real objects under diverse illumination conditions, showing our diffusion-aided approach significantly improves the appearance of reconstructed objects under novel lighting conditions. We intend to publicly release our BlenderVault dataset to support further research in this field.

AK

22,949 views • 1 year ago

Announcing Diffusion Forcing Transformer (DFoT), our new video diffusion algorithm that generates ultra-long videos of 800+ frames. DFoT enables History Guidance, a simple add-on to any existing video diffusion models for a quality boost. Website: (1/7)
0:36

Announcing Diffusion Forcing Transformer (DFoT), our new video diffusion algorithm that generates ultra-long videos of 800+ frames. DFoT enables History Guidance, a simple add-on to any existing video diffusion models for a quality boost. Website: (1/7)

Boyuan Chen

175,996 views • 1 year ago

Epic Games has shared a collection of more than 280 Substrate materials for high-quality automotive rendering in Unreal Engine 5.7. Download:
0:20

Epic Games has shared a collection of more than 280 Substrate materials for high-quality automotive rendering in Unreal Engine 5.7. Download:

80 LEVEL

18,294 views • 3 months ago

December 2025 update now available for subscribers!📣 - Make animations and use Puppet Warp in Simple Mode - Fill and paint areas faster with large brushes - Import 3D models with realistic rendering - Auto-install downloaded materials from Assets
3:03

December 2025 update now available for subscribers!📣 - Make animations and use Puppet Warp in Simple Mode - Fill and paint areas faster with large brushes - Import 3D models with realistic rendering - Auto-install downloaded materials from Assets

CLIP STUDIO PAINT

7,445,599 views • 6 months ago