Loading video...

Video Failed to Load

Go Home

Nvidia's PID (Pixel diffusion Decoder) It decodes latent representations into high-resolution images, replacing the decode–then–super-resolve cascade while achieving lower latency and higher visual quality page: HF repo:

SD_Tutorial's profile picture

Stable Diffusion Tutorials

3,519 subscribers

37,117 views • 13 days ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

The latent-vs-pixel debate misses the point. GPT Image 2 shows what users notice: pixel-level fidelity. Latent models show what scales: compact semantic structure. We connect them by replacing VAE/RAE decoders with a Pixel Diffusion Decoder. Code and Model available: 🧵(1/N)
0:48

The latent-vs-pixel debate misses the point. GPT Image 2 shows what users notice: pixel-level fidelity. Latent models show what scales: compact semantic structure. We connect them by replacing VAE/RAE decoders with a Pixel Diffusion Decoder. Code and Model available: 🧵(1/N)

Xuanchi Ren

668,139 views • 12 days ago

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:
1:38

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

AK

718,682 views • 3 years ago

FLUX.2 Klein in pure pixel space! No VAE. AsymFlow - hyper-realistic images by working directly in pixel space rather than using compressed latent representations. - sharper textures, superior visual fidelity - 40% faster - low-rank noise parameterization to solve high-dimensional bottlenecks ComfyUI support incoming
0:42

FLUX.2 Klein in pure pixel space! No VAE. AsymFlow - hyper-realistic images by working directly in pixel space rather than using compressed latent representations. - sharper textures, superior visual fidelity - 40% faster - low-rank noise parameterization to solve high-dimensional bottlenecks ComfyUI support incoming

Wildminder

26,976 views • 25 days ago

Awesome. NVIDIA dropped PiD - fast high-res latent decoding via pixel diffusion! - replace VAE - 4/8x upsampling - 2k decoding in <1s on RTX 5090 - works with FLUX.1/SD3/Z - rapid generation previews sharper details, much lower hardware lag compared to standard methods.
0:26

Awesome. NVIDIA dropped PiD - fast high-res latent decoding via pixel diffusion! - replace VAE - 4/8x upsampling - 2k decoding in <1s on RTX 5090 - works with FLUX.1/SD3/Z - rapid generation previews sharper details, much lower hardware lag compared to standard methods.

Wildminder

23,288 views • 14 days ago

How can we generate high-fidelity, complex 3D scenes? Quan Meng's LT3SD decomposes 3D scenes into latent tree representations, with diffusion on the latent trees enabling seamless infinite 3D scene synthesis! w/ Lei Li, Matthias Niessner
1:21

How can we generate high-fidelity, complex 3D scenes? Quan Meng's LT3SD decomposes 3D scenes into latent tree representations, with diffusion on the latent trees enabling seamless infinite 3D scene synthesis! w/ Lei Li, Matthias Niessner

Angela Dai

29,409 views • 1 year ago

Scaling up GANs for Text-to-Image Synthesis present our 1B-parameter GigaGAN, achieving lower FID than Stable Diffusion v1.5, DALL·E 2, and Parti-750M. It generates 512px outputs at 0.13s, orders of magnitude faster than diffusion and autoregressive models, and inherits the disentangled, continuous, and controllable latent space of GANs abs: project page:
1:18

Scaling up GANs for Text-to-Image Synthesis present our 1B-parameter GigaGAN, achieving lower FID than Stable Diffusion v1.5, DALL·E 2, and Parti-750M. It generates 512px outputs at 0.13s, orders of magnitude faster than diffusion and autoregressive models, and inherits the disentangled, continuous, and controllable latent space of GANs abs: project page:

AK

278,115 views • 3 years ago

Fixed resolution images in photoshop Make low resolution image high quality
0:50

Fixed resolution images in photoshop Make low resolution image high quality

Photoshop Tricks!

55,573 views • 10 months ago

Stream-DiffVSR: A low-latency, streamable video super-resolution model; - distills Stable Diffusion Upscaler to just 4 steps; - processes 720p ~3fps.
0:28

Stream-DiffVSR: A low-latency, streamable video super-resolution model; - distills Stable Diffusion Upscaler to just 4 steps; - processes 720p ~3fps.

Wildminder

16,084 views • 5 months ago

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.
0:43

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Dreaming Tulpa 🥓👑

39,338 views • 1 year ago

Diffusion models generate high-quality images but require hundreds of forward passes. MIT CSAIL and Adobe Research introduce Distribution Matching Distillation (DMD), a distillation approach that converts costly multi-step diffusion models into fast one-step generators. A thread 🧵
0:24

Diffusion models generate high-quality images but require hundreds of forward passes. MIT CSAIL and Adobe Research introduce Distribution Matching Distillation (DMD), a distillation approach that converts costly multi-step diffusion models into fast one-step generators. A thread 🧵

MIT CSAIL

34,347 views • 2 years ago

Our Latent Encoder-Decoder code base is fully open sourced, you can train and visualize the latent space: Code⚙️: ArXiv 📚: #CVPR2026
0:25

Our Latent Encoder-Decoder code base is fully open sourced, you can train and visualize the latent space: Code⚙️: ArXiv 📚: #CVPR2026

Xueyan Zou

19,047 views • 2 months ago

🚨 BREAKING: A research lab just released a 15B model that generates multilingual talking human videos with synced audio, beats every competitor in human evaluation, and runs in 38 seconds on one GPU. It's called daVinci-MagiHuman. The key insight is that every other model in this category stacks cross-attention, multi-stream pipelines, and separate conditioning branches to handle video and audio together. This one throws all of that out and uses a single unified self-attention stream across all modalities. Super-resolution happens in latent space rather than pixel space so there's no extra VAE decode-encode round trip. The turbo VAE decoder cuts decoding overhead even further. The distilled version runs in 8 steps with no CFG at all. Visual quality, text alignment, and word error rate all beat Ovi 1.1 and LTX 2.3 on the benchmark table. 100% Opensource. Apache 2.0. Repo and research paper links are in the comments.
2:03

🚨 BREAKING: A research lab just released a 15B model that generates multilingual talking human videos with synced audio, beats every competitor in human evaluation, and runs in 38 seconds on one GPU. It's called daVinci-MagiHuman. The key insight is that every other model in this category stacks cross-attention, multi-stream pipelines, and separate conditioning branches to handle video and audio together. This one throws all of that out and uses a single unified self-attention stream across all modalities. Super-resolution happens in latent space rather than pixel space so there's no extra VAE decode-encode round trip. The turbo VAE decoder cuts decoding overhead even further. The distilled version runs in 8 steps with no CFG at all. Visual quality, text alignment, and word error rate all beat Ovi 1.1 and LTX 2.3 on the benchmark table. 100% Opensource. Apache 2.0. Repo and research paper links are in the comments.

Ihtesham Ali

45,152 views • 2 months ago

Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity. Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution. More details ⬇️
0:31

Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity. Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution. More details ⬇️

AI at Meta

588,615 views • 2 years ago

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.
0:29

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Dreaming Tulpa 🥓👑

173,050 views • 1 year ago

The Best Steam App/Launcher Settings in 30 Seconds (Decreased Background Telemetry + Lower Latency + Higher FPS)
0:31

The Best Steam App/Launcher Settings in 30 Seconds (Decreased Background Telemetry + Lower Latency + Higher FPS)

Paragon│Boost Gaming PC Performance

81,209 views • 1 month ago

BlockVid Block Diffusion for High-Quality and Consistent Minute-Long Video Generation
1:00

BlockVid Block Diffusion for High-Quality and Consistent Minute-Long Video Generation

AK

19,949 views • 6 months ago

☕ The new LATTE3D model from #NVIDIAResearch turns text prompts into high-quality 3D representations of objects and animals within a second on a single RTX GPU. #GTC24 👀
0:43

☕ The new LATTE3D model from #NVIDIAResearch turns text prompts into high-quality 3D representations of objects and animals within a second on a single RTX GPU. #GTC24 👀

NVIDIA AI Developer

10,811 views • 2 years ago

The Best OBS Settings for Recording, Streaming, and Replay Buffer for Windows 11/10 (Less Latency + Higher FPS + Increased Stream Quality)
4:06

The Best OBS Settings for Recording, Streaming, and Replay Buffer for Windows 11/10 (Less Latency + Higher FPS + Increased Stream Quality)

Paragon│Boost Gaming PC Performance

116,480 views • 1 month ago