Loading video...

Video Failed to Load

Go Home

SynthLight Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Faces

_akhaliq's profile picture

AK

423,685 subscribers

32,321 views • 1 year ago •via X (Twitter)

EducationScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n
0:15

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n

Minkai Xu

50,434 views • 1 year ago

Excited to introduce Diffusion Augmented Agents (DAAGs)✨. We give an agent control of a diffusion model, so it can create its own *synthetic experience*.🪄 The result is a lifelong agent that can learn new reward detectors and policies, much more efficiently. Here's how. 👇
0:18

Excited to introduce Diffusion Augmented Agents (DAAGs)✨. We give an agent control of a diffusion model, so it can create its own *synthetic experience*.🪄 The result is a lifelong agent that can learn new reward detectors and policies, much more efficiently. Here's how. 👇

Norman Di Palo

12,874 views • 1 year ago

🫣JACKIE CRAWLING🤡 Small test render i wanted to make on blender using miaoumastr model Original model design by Steel Wool Studios
0:14

🫣JACKIE CRAWLING🤡 Small test render i wanted to make on blender using miaoumastr model Original model design by Steel Wool Studios

Jonlanty

12,909 views • 1 year ago

starting the week with a true groundbreaking work 💥 Large Language Diffusion Models the first billion-parameter scale diffusion model competitive with its pairs (8B model comparable to LLaMA 3 8B) it gets rid of the michael scott syndrome on existing LLMs
0:12

starting the week with a true groundbreaking work 💥 Large Language Diffusion Models the first billion-parameter scale diffusion model competitive with its pairs (8B model comparable to LLaMA 3 8B) it gets rid of the michael scott syndrome on existing LLMs

apolinario 🌐

11,833 views • 1 year ago

I've worked with Kylan O'Connor to put together a little dedicated Replicate model that gives you: - all the face images - a sprite/grid of all the faces - vanilla HTML, JS and CSS to render the effect - a preview video
0:13

I've worked with Kylan O'Connor to put together a little dedicated Replicate model that gives you: - all the face images - a sprite/grid of all the faces - vanilla HTML, JS and CSS to render the effect - a preview video

fofr

268,111 views • 7 months ago

🚀 Introducing GenLit – Reformulating Single-Image Relighting as Video Generation! We leverage video diffusion models to perform realistic near-field relighting from just a single image—No explicit 3D reconstruction or ray tracing required! No intermediate graphics buffers, directly in the pixel space! 📄 Dive into the paper: 🎥 Project page & demos: 🛠 Code coming soon! #GenerativeAI #ComputerVision #Relighting #DiffusionModels #Graphics 🧵 1/5
0:19

🚀 Introducing GenLit – Reformulating Single-Image Relighting as Video Generation! We leverage video diffusion models to perform realistic near-field relighting from just a single image—No explicit 3D reconstruction or ray tracing required! No intermediate graphics buffers, directly in the pixel space! 📄 Dive into the paper: 🎥 Project page & demos: 🛠 Code coming soon! #GenerativeAI #ComputerVision #Relighting #DiffusionModels #Graphics 🧵 1/5

Haven Feng @ CVPR

22,427 views • 1 year ago

Re-render of my older animation #b3d
0:12

Re-render of my older animation #b3d

higgsas

251,279 views • 1 year ago

search algorithms are cool, but have you ever seen a maze being solved completely by a diffusion model?
0:12

search algorithms are cool, but have you ever seen a maze being solved completely by a diffusion model?

Rikard Radovac

20,641 views • 1 year ago

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world
0:26

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world

simp 4 satoshi

19,542 views • 8 months ago

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."
0:19

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."

Tanishq Mathew Abraham, Ph.D.

21,813 views • 1 year ago

LLaDA (the first Large Language Diffusion Model) is *just* out 💥 and I've built a demo, try out now 👨‍💻 It's mesmerizing to watch the diffusion process 🌀, and it being a diffusion model gives you superpowers like "the 4th word has to be pineapple" 🦸 Demo and weights 👇
0:17

LLaDA (the first Large Language Diffusion Model) is *just* out 💥 and I've built a demo, try out now 👨‍💻 It's mesmerizing to watch the diffusion process 🌀, and it being a diffusion model gives you superpowers like "the 4th word has to be pineapple" 🦸 Demo and weights 👇

apolinario (poli)

82,599 views • 1 year ago

AHH! this fox just popped out of the screen! I wonder what they want to do with you~ model by MISHUUYU something a little different. It's nice to make render of other characters :3
0:11

AHH! this fox just popped out of the screen! I wonder what they want to do with you~ model by MISHUUYU something a little different. It's nice to make render of other characters :3

Bluebow🔞

10,398 views • 1 year ago

React Scan identifies slow components that excessively re-render
0:12

React Scan identifies slow components that excessively re-render

Aiden Bai

25,081 views • 1 year ago

😀 ToonCrafter: Generative Cartoon Interpolation 🔆 Can interpolate two cartoon images by leveraging the pre-trained image-to-video diffusion priors. Model on 🤗👇
0:10

😀 ToonCrafter: Generative Cartoon Interpolation 🔆 Can interpolate two cartoon images by leveraging the pre-trained image-to-video diffusion priors. Model on 🤗👇

Gradio

93,074 views • 2 years ago

Still learning.. #c4d #cinema4d #cgi #vfx #3d #space #render #rendering #rendeburger
0:12

Still learning.. #c4d #cinema4d #cgi #vfx #3d #space #render #rendering #rendeburger

RenderBurger

67,559 views • 1 year ago

Chop the gradients ✂️! We found that truncating decoder gradients in latent video diffusion to a fixed window allows us to finetune on videos with pixel-wise perceptual losses without running out of memory. Pixel losses have been essential for image generation and reconstruction, but until now, they haven't scaled to long-duration, high-resolution video diffusion due to recursive activation accumulation in causal decoders, leading to OOM during training 💥📉. Project: Video diffusion models can do a lot more 🚀 when you can backprop the decoder! Post-process neural rendered scenes, super-resolve videos, harmonize lighting in controlled synthetic driving scenes, and inpaint videos — all in a single step ⚡ with a quick finetune from a standard diffusion model.
0:19

Chop the gradients ✂️! We found that truncating decoder gradients in latent video diffusion to a fixed window allows us to finetune on videos with pixel-wise perceptual losses without running out of memory. Pixel losses have been essential for image generation and reconstruction, but until now, they haven't scaled to long-duration, high-resolution video diffusion due to recursive activation accumulation in causal decoders, leading to OOM during training 💥📉. Project: Video diffusion models can do a lot more 🚀 when you can backprop the decoder! Post-process neural rendered scenes, super-resolve videos, harmonize lighting in controlled synthetic driving scenes, and inpaint videos — all in a single step ⚡ with a quick finetune from a standard diffusion model.

Felix Heide

28,282 views • 2 months ago

ELDEN RING - Crucible Knight Just some old work re-render to get a better view. Made with @Blockbench #ELDENRING #EldenRingFanart #Minecraft #Blockbench #BlockbusterMod ELDEN RING
0:11

ELDEN RING - Crucible Knight Just some old work re-render to get a better view. Made with @Blockbench #ELDENRING #EldenRingFanart #Minecraft #Blockbench #BlockbusterMod ELDEN RING

MichaelCreeper_

58,977 views • 2 years ago

Minecraft x Elden Ring - Tree Sentinel (some old work re-render) Made with @Blockbench #ELDENRING #EldenRingFanart #Minecraft #Blockbench #BlockbusterMod
0:12

Minecraft x Elden Ring - Tree Sentinel (some old work re-render) Made with @Blockbench #ELDENRING #EldenRingFanart #Minecraft #Blockbench #BlockbusterMod

MichaelCreeper_

20,182 views • 1 year ago

Render by Sweetwater Featuring: MewDragon, Sweetwater, and myself We found something cute in the forest to play with :3 #furry #blender #render #moonfang #dragon #furred_dragon #regalfin
0:12

Render by Sweetwater Featuring: MewDragon, Sweetwater, and myself We found something cute in the forest to play with :3 #furry #blender #render #moonfang #dragon #furred_dragon #regalfin

🔞 BiohazardousWolf

18,845 views • 6 months ago

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:
0:10

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:

AK

85,893 views • 3 years ago