Загрузка видео...

Не удалось загрузить видео

На главную

Blog post - Autoregression vs Diffusion - Understanding Sampling via Optimal Transport Autoregression and diffusion look like opposites. Yet, beneath the implementation details, both are solving the same transport problem: how to turn simple noise into structured data.

Ji_Ha_Kim's profile picture

Ji-Ha

5,356 subscribers

20,283 просмотров • 6 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.
0:14

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

Alec Helbling

279,448 просмотров • 11 месяцев назад

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."
0:19

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."

Tanishq Mathew Abraham, Ph.D.

21,813 просмотров • 1 год назад

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n
0:15

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n

Minkai Xu

50,434 просмотров • 1 год назад

Diffusion models are sensitive to small changes in the input noise. We introduce Alias-Free Latent Diffusion Models (𝗔𝗙-𝗟𝗗𝗠) at #CVPR2025. It achieves shift-equivariance and generates consistent outputs. Project: arXiv:
0:10

Diffusion models are sensitive to small changes in the input noise. We introduce Alias-Free Latent Diffusion Models (𝗔𝗙-𝗟𝗗𝗠) at #CVPR2025. It achieves shift-equivariance and generates consistent outputs. Project: arXiv:

Xingang Pan

42,538 просмотров • 1 год назад

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇
0:15

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

Alec Helbling

73,188 просмотров • 1 год назад

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.
0:18

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

Alec Helbling

65,798 просмотров • 5 месяцев назад

Introducing Diffusion Forcing, which unifies next-token prediction (eg LLMs) and full-seq. diffusion (eg SORA)! It offers improved performance & new sampling strategies in vision and robotics, such as stable, infinite video generation, better diffusion planning, and more! (1/8)
0:17

Introducing Diffusion Forcing, which unifies next-token prediction (eg LLMs) and full-seq. diffusion (eg SORA)! It offers improved performance & new sampling strategies in vision and robotics, such as stable, infinite video generation, better diffusion planning, and more! (1/8)

Boyuan Chen

208,952 просмотров • 2 лет назад

The latent space of earlier generative models like GANS can linearly encode concepts of the data. What if the data was model weights? We present weights2weights, a subspace in diffusion weights that behaves as an interpretable latent space over customized diffusion models.
0:16

The latent space of earlier generative models like GANS can linearly encode concepts of the data. What if the data was model weights? We present weights2weights, a subspace in diffusion weights that behaves as an interpretable latent space over customized diffusion models.

Amil Dravid

94,296 просмотров • 2 лет назад

LLaDA (the first Large Language Diffusion Model) is *just* out 💥 and I've built a demo, try out now 👨‍💻 It's mesmerizing to watch the diffusion process 🌀, and it being a diffusion model gives you superpowers like "the 4th word has to be pineapple" 🦸 Demo and weights 👇
0:17

LLaDA (the first Large Language Diffusion Model) is *just* out 💥 and I've built a demo, try out now 👨‍💻 It's mesmerizing to watch the diffusion process 🌀, and it being a diffusion model gives you superpowers like "the 4th word has to be pineapple" 🦸 Demo and weights 👇

apolinario (poli)

82,599 просмотров • 1 год назад

🚨Announcing our #ICLR2025 Oral! 🔥Diffusion LMs are on the rise for parallel text generation! But unlike autoregressive LMs, they struggle with quality, fixed-length constraints & lack of KV caching. 🚀Introducing Block Diffusion—combining autoregressive and diffusion models for the best of both worlds! 👇1/7
0:17

🚨Announcing our #ICLR2025 Oral! 🔥Diffusion LMs are on the rise for parallel text generation! But unlike autoregressive LMs, they struggle with quality, fixed-length constraints & lack of KV caching. 🚀Introducing Block Diffusion—combining autoregressive and diffusion models for the best of both worlds! 👇1/7

Marianne Arriola

150,803 просмотров • 1 год назад

This smalldiffusion project is really fun. It is a tiny library for training and sampling from diffusion models. I love efforts like this, they are much easier to play around with than big libraries like diffusers. Link:
0:13

This smalldiffusion project is really fun. It is a tiny library for training and sampling from diffusion models. I love efforts like this, they are much easier to play around with than big libraries like diffusers. Link:

Alec Helbling

18,844 просмотров • 1 год назад

🆕 Image super-resolution model just dropped! Superior results even with a single sampling step. 🔥InvSR: Arbitrary-steps Image Super-resolution via Diffusion Inversion.
0:12

🆕 Image super-resolution model just dropped! Superior results even with a single sampling step. 🔥InvSR: Arbitrary-steps Image Super-resolution via Diffusion Inversion.

Gradio

53,331 просмотров • 1 год назад

A curious property of diffusion models: when a sample is mostly noise, the model’s best guess is close to the mean. So early on samples can be pulled toward the center of the dataset, even when no data exists there, before rebounding toward the data manifold.
0:14

A curious property of diffusion models: when a sample is mostly noise, the model’s best guess is close to the mean. So early on samples can be pulled toward the center of the dataset, even when no data exists there, before rebounding toward the data manifold.

Alec Helbling

32,020 просмотров • 1 месяц назад

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.
0:13

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

Alec Helbling

437,319 просмотров • 1 год назад

diffusion policy trained on 26 minutes of data (80 demos, 20 seconds each) using DDIM noise scheduler for inference with 10 denoising steps
0:16

diffusion policy trained on 26 minutes of data (80 demos, 20 seconds each) using DDIM noise scheduler for inference with 10 denoising steps

ahad

319,007 просмотров • 10 месяцев назад

an idea I've been playing with for the Obsidian clipper — interpret the page in natural language and turn the results into structured data
0:15

an idea I've been playing with for the Obsidian clipper — interpret the page in natural language and turn the results into structured data

kepano

53,139 просмотров • 2 лет назад

transforms a simple 3D scene into a realistic render and is smart enough to add reflections on the ground on its own we're not too far away from diffusion game engines
0:16

transforms a simple 3D scene into a realistic render and is smart enough to add reflections on the ground on its own we're not too far away from diffusion game engines

Nucleus☕️

59,568 просмотров • 9 месяцев назад

This is the coolest Diffusion work I've seen in a while! It generates Visual Anagrams, a type of optical illusion where an image looks like one thing, but changes appearance when transformed. It works with any orthogonal transformation matrices, which luckily include rotation, permutation (jigsaw puzzles), and color negation. Intuitively, the method first inverts the noise from multiple image transforms (with different text prompts), and then average them. After taking a diffusion step in the averaged noise, the resulting image becomes an anagram that aligns with the texts in different views. It does very little computation, using pre-trained Stable Diffusion. Simple, elegant, and inexpensive technique for non-professionals to create some interesting art! Paper: Website: It's open-source! Authors: Daniel Geng, Inbum Park, Andrew Owens.
0:12

This is the coolest Diffusion work I've seen in a while! It generates Visual Anagrams, a type of optical illusion where an image looks like one thing, but changes appearance when transformed. It works with any orthogonal transformation matrices, which luckily include rotation, permutation (jigsaw puzzles), and color negation. Intuitively, the method first inverts the noise from multiple image transforms (with different text prompts), and then average them. After taking a diffusion step in the averaged noise, the resulting image becomes an anagram that aligns with the texts in different views. It does very little computation, using pre-trained Stable Diffusion. Simple, elegant, and inexpensive technique for non-professionals to create some interesting art! Paper: Website: It's open-source! Authors: Daniel Geng, Inbum Park, Andrew Owens.

Jim Fan

189,026 просмотров • 2 лет назад

It's possible to run custom code on the Nintendo Alarmo via USB - without opening it up! More details in the blog post here:
0:17

It's possible to run custom code on the Nintendo Alarmo via USB - without opening it up! More details in the blog post here:

Gary

582,182 просмотров • 2 лет назад

Introducing ⇆ Marigold-DC — our training-free zero-shot approach to monocular Depth Completion with guided diffusion! If you have ever wondered how else a long denoising diffusion schedule can be useful, we have an answer for you! Details 🧵
0:13

Introducing ⇆ Marigold-DC — our training-free zero-shot approach to monocular Depth Completion with guided diffusion! If you have ever wondered how else a long denoising diffusion schedule can be useful, we have an answer for you! Details 🧵

Anton Obukhov

39,363 просмотров • 1 год назад