Загрузка видео...

Не удалось загрузить видео

На главную

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

alec_helbling's profile picture

Alec Helbling

10,787 subscribers

429,132 просмотров • 1 год назад •via X (Twitter)

ИскусствоНаука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.
0:10

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

Alec Helbling

102,987 просмотров • 1 год назад

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.
0:14

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

Alec Helbling

279,123 просмотров • 8 месяцев назад

Laminar flow is a type of fluid (liquid or gas) movement where the flow is smooth, consistent, and occurs in parallel layers with no disruption between them. It contrasts with turbulent flow, which is chaotic and irregular.
0:12

Laminar flow is a type of fluid (liquid or gas) movement where the flow is smooth, consistent, and occurs in parallel layers with no disruption between them. It contrasts with turbulent flow, which is chaotic and irregular.

HOW THINGS WORK

148,090 просмотров • 1 год назад

The Cucker-Smale system of ODEs is the simplest model of particles exhibiting flocking behaviors. Diffusion of speeds is governed by a Laplacian on the fully connected graph of points.
0:10

The Cucker-Smale system of ODEs is the simplest model of particles exhibiting flocking behaviors. Diffusion of speeds is governed by a Laplacian on the fully connected graph of points.

Gabriel Peyré

77,155 просмотров • 2 лет назад

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.
0:18

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

Alec Helbling

65,253 просмотров • 2 месяцев назад

Oldies but goldies: Felipe Cucker, Steve Smale, The Mathematics of Emergence, 2007. Defines a simple model of particles exhibiting flocking behaviors. Diffusion of speeds is governed by a Laplacian on the fully connected graph of points.
0:10

Oldies but goldies: Felipe Cucker, Steve Smale, The Mathematics of Emergence, 2007. Defines a simple model of particles exhibiting flocking behaviors. Diffusion of speeds is governed by a Laplacian on the fully connected graph of points.

Gabriel Peyré

24,386 просмотров • 2 лет назад

Do you enjoy the process of carving wood shapes that produces very smooth and precise shapes?
0:14

Do you enjoy the process of carving wood shapes that produces very smooth and precise shapes?

Calisa Natanya

351,723 просмотров • 2 месяцев назад

We have released the code and weights for our #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"! code: abs: project: The demo is below:
0:14

We have released the code and weights for our #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"! code: abs: project: The demo is below:

Artsiom Sanakoyeu

35,711 просмотров • 3 лет назад

The Dream 7B (diffusion reasoning language model) is OUT! 🚨 I built a demo so you can test it out (and check the diffusion process live) 𖣯🔍
0:10

The Dream 7B (diffusion reasoning language model) is OUT! 🚨 I built a demo so you can test it out (and check the diffusion process live) 𖣯🔍

apolinario (poli)

35,679 просмотров • 1 год назад

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.
0:11

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

Alec Helbling

104,658 просмотров • 1 год назад

LLaDA (the first Large Language Diffusion Model) is *just* out 💥 and I've built a demo, try out now 👨‍💻 It's mesmerizing to watch the diffusion process 🌀, and it being a diffusion model gives you superpowers like "the 4th word has to be pineapple" 🦸 Demo and weights 👇
0:17

LLaDA (the first Large Language Diffusion Model) is *just* out 💥 and I've built a demo, try out now 👨‍💻 It's mesmerizing to watch the diffusion process 🌀, and it being a diffusion model gives you superpowers like "the 4th word has to be pineapple" 🦸 Demo and weights 👇

apolinario (poli)

82,599 просмотров • 1 год назад

Lorenz attractor is the set of limit trajectories for a simplified mathematical model for atmospheric convection. It has a fractal geometry.
0:15

Lorenz attractor is the set of limit trajectories for a simplified mathematical model for atmospheric convection. It has a fractal geometry.

Gabriel Peyré

168,765 просмотров • 3 лет назад

Random Circuit Sampling (RCS) is a necessary benchmark to measure quantum computer performance in the presence of noise. Why is RCS considered a cornerstone of quantum computing? Find out in our latest breakdown. #QuantumAI
0:20

Random Circuit Sampling (RCS) is a necessary benchmark to measure quantum computer performance in the presence of noise. Why is RCS considered a cornerstone of quantum computing? Find out in our latest breakdown. #QuantumAI

Google Quantum AI

11,807 просмотров • 1 год назад

We are also releasing self-contained lecture notes that explain flow matching and diffusion models from scratch. This goes from "zero" to the state-of-the-art in modern Generative AI. 📖 Read the notes here: Joint work with Ezra Erives.
0:15

We are also releasing self-contained lecture notes that explain flow matching and diffusion models from scratch. This goes from "zero" to the state-of-the-art in modern Generative AI. 📖 Read the notes here: Joint work with Ezra Erives.

Peter Holderrieth

475,357 просмотров • 3 месяцев назад

(1/2) Check out "𝐏𝐨𝐥𝐲𝐃𝐢𝐟𝐟: Generating 3D Polygonal Meshes with Diffusion Models"! Our model operates directly on the polygons of 3D meshes and generates novel shapes as output through an iterative diffusion process.
0:11

(1/2) Check out "𝐏𝐨𝐥𝐲𝐃𝐢𝐟𝐟: Generating 3D Polygonal Meshes with Diffusion Models"! Our model operates directly on the polygons of 3D meshes and generates novel shapes as output through an iterative diffusion process.

Matthias Niessner

57,941 просмотров • 2 лет назад

The fine line between smooth motion and engine damage is just a single strand of human hair.
0:17

The fine line between smooth motion and engine damage is just a single strand of human hair.

jasmine

156,889 просмотров • 8 месяцев назад

The fine line between smooth motion and engine damage is just a single strand of human hair
0:17

The fine line between smooth motion and engine damage is just a single strand of human hair

Interesting AF

975,763 просмотров • 9 месяцев назад

An orrery is a mechanical model of the Solar System, meticulously crafted to demonstrate the motion of planets around the Sun.
0:19

An orrery is a mechanical model of the Solar System, meticulously crafted to demonstrate the motion of planets around the Sun.

Science girl

85,504 просмотров • 1 год назад

🚀New paper out - We present Video-MSG (Multimodal Sketch Guidance), a novel planning-based training-free guidance method for T2V models, improving control of spatial layout and object trajectories. 🔧 Key idea: • Generate a Video Sketch — a spatio-temporal plan with background, foreground, and motion in the pixel space. • Encode this structure directly into the latent space of the diffusion model during generation, which does not require fine-tuning or additional memory during inference. 🧵
0:12

🚀New paper out - We present Video-MSG (Multimodal Sketch Guidance), a novel planning-based training-free guidance method for T2V models, improving control of spatial layout and object trajectories. 🔧 Key idea: • Generate a Video Sketch — a spatio-temporal plan with background, foreground, and motion in the pixel space. • Encode this structure directly into the latent space of the diffusion model during generation, which does not require fine-tuning or additional memory during inference. 🧵

Jialu Li

35,060 просмотров • 1 год назад

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world
0:26

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world

simp 4 satoshi

19,542 просмотров • 9 месяцев назад