We’re excited to share LuxRemix: interactive light editing for indoor scenes! 🏠💡 Capture a room once, then turn individual lights on/off, change colors, and adjust intensity – all in real-time 3D from any viewpoint. 💡 📄

How it works: 1️⃣ Single-image model decomposes lighting into individual OLAT (one-light-at-a-time) sources 2️⃣ Multi-view harmonization propagates decompositions consistently across all views 3️⃣ Extended 3D Gaussian splatting enables real-time per-light control

🎨Single-Image Lighting Decomposition: From just ONE image, we isolate each light’s contribution, enabling per-light control over on/off, color, and intensity. The decomposition quality is high enough to create lighting moods that never existed in the original capture!

🔄 Multi-view Lighting Harmonization: We propagate per-light decompositions across all captured views using geometric cues (including Plücker ray embeddings), with exposure-bracketed runs and HDR fusion for high dynamic range outputs.

🎮 Real-time 3D Relighting: We extend 3DGS with per-light HDR coefficients for interactive rendering. Edit lights while freely exploring the scene – all at real-time frame rates! Try the interactive demo on our website 👉

This work was led by our amazing intern @RfLiang at @RealityLabs Zurich. Joint work with @Normanisation, @ethanjohnweber, @DuncanZauss, @nanditav17 (@UofTCompSci), Peter Kontschieder, and myself. 🚨📢 Ruofan is on the job market, check out his website:

Obsessed! LuxRemix is giving runway energy for interiors-editing lighting is as iconic as a bold hair switch. Ready to remix my space and set all the moods! 💡✨

impossible ! it's witchcraft

Is there a way to test this?