Alec Helbling's banner
Alec Helbling's profile picture

Alec Helbling

@alec_helbling • 10,796 subscribers

Interpretability, Multimodality, Diffusion. PhDing @GeorgiaTech. NSF Fellow. Prev intern @Apple, @Adobe, @NASAJPL.

Shorts

The Helmholtz decomposition is one of the fundamental results of vector calculus. It says any well-behaved vector field can be split into two parts, one capturing sources and sinks through divergence, and one capturing rotation through curl.

The Helmholtz decomposition is one of the fundamental results of vector calculus. It says any well-behaved vector field can be split into two parts, one capturing sources and sinks through divergence, and one capturing rotation through curl.

228,968 views

Stokes' Theorem is a classic result from vector calculus. It tells us that the line integral of a vector field over a loop is equal to the surface integral of the curl of the vector field over some enclosed surface.

Stokes' Theorem is a classic result from vector calculus. It tells us that the line integral of a vector field over a loop is equal to the surface integral of the curl of the vector field over some enclosed surface.

438,792 views

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

436,518 views

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

279,275 views

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

168,757 views

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

65,484 views

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

94,195 views

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

150,686 views

Functions are Vectors This is a great blog post from Max Slater about how viewing functions as infinite dimensional vectors unlocks powerful tools from linear algebra. I think this is an under-emphasized perspective in intro linear algebra classes.

Functions are Vectors This is a great blog post from Max Slater about how viewing functions as infinite dimensional vectors unlocks powerful tools from linear algebra. I think this is an under-emphasized perspective in intro linear algebra classes.

93,507 views

Many dimensionality reduction algorithms share a few central principles. 1. Construct a graph that captures the data's local structure 2. Measure "geodesic" distances between points using the graph 3. Project the points to a lower dimension while preserving these distances

Many dimensionality reduction algorithms share a few central principles. 1. Construct a graph that captures the data's local structure 2. Measure "geodesic" distances between points using the graph 3. Project the points to a lower dimension while preserving these distances

88,874 views

Stein Variational Gradient Descent (SVGD) is a particle-based approach to variational inference. SVGD iteratively transports a set of particles to match a target distribution by applying a form of functional gradient descent that minimizes the KL divergence.

Stein Variational Gradient Descent (SVGD) is a particle-based approach to variational inference. SVGD iteratively transports a set of particles to match a target distribution by applying a form of functional gradient descent that minimizes the KL divergence.

28,173 views

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

104,658 views

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

102,987 views

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

96,895 views

I added a guide to the repository for my project ManimML, which is a tool for visualizing neural network architectures and algorithms using only python code. It is built on top of @manim_community which was started by Grant Sanderson. Link:

I added a guide to the repository for my project ManimML, which is a tool for visualizing neural network architectures and algorithms using only python code. It is built on top of @manim_community which was started by Grant Sanderson. Link:

172,253 views

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

73,124 views

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

79,904 views

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

34,778 views

I wrote this fun interactive article explaining Isomap, a classic non-linear dimensionality reduction technique. Isomap captures the local similarity structure of data through a graph and computes an embedding that preserves this structure. Check it out! Link below.

I wrote this fun interactive article explaining Isomap, a classic non-linear dimensionality reduction technique. Isomap captures the local similarity structure of data through a graph and computes an embedding that preserves this structure. Check it out! Link below.

41,045 views

Excited that our work, Concept Attention, was selected as an Oral Presentation at ICML 2025 and recently won the Best Paper Award at the CVPR Workshop on Visual Concepts. Concept Attention allows you to visualize the presence of text concepts in generated videos and images.

Excited that our work, Concept Attention, was selected as an Oral Presentation at ICML 2025 and recently won the Best Paper Award at the CVPR Workshop on Visual Concepts. Concept Attention allows you to visualize the presence of text concepts in generated videos and images.

42,726 views

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Masked diffusion is a discrete analog of continuous diffusion. Continuous diffusion gradually adds Gaussian noise, then learns to reverse that process to recover data. Masked diffusion instead progressively replaces tokens with a mask token, then learns to fill them back in.
0:25
alec_helbling's profile picture

Masked diffusion is a discrete analog of continuous diffusion. Continuous diffusion gradually adds Gaussian noise, then learns to reverse that process to recover data. Masked diffusion instead progressively replaces tokens with a mask token, then learns to fill them back in.

Alec Helbling

24,575 views • 22 days ago

Data often lie on a low-dimensional manifold embedded in a high-dimensional space. But these manifolds are often highly non-linear, making linear dimensionality reduction methods like PCA insufficient. This has motivated the development of non-linear dimensionality reduction.
0:21
alec_helbling's profile picture

Data often lie on a low-dimensional manifold embedded in a high-dimensional space. But these manifolds are often highly non-linear, making linear dimensionality reduction methods like PCA insufficient. This has motivated the development of non-linear dimensionality reduction.

Alec Helbling

212,685 views • 9 months ago

I wrote an interactive article explaining the geometric intuition behind Rectified Flows. I visually explain why flow-models tend to learn curved trajectories, why this is bad for sampling latency, and a relatively simple technique for mitigating it. Check it out! Link 👇
0:25
alec_helbling's profile picture

I wrote an interactive article explaining the geometric intuition behind Rectified Flows. I visually explain why flow-models tend to learn curved trajectories, why this is bad for sampling latency, and a relatively simple technique for mitigating it. Check it out! Link 👇

Alec Helbling

159,259 views • 7 months ago

An interesting phenomenon in dynamical systems is the limit cycle. A limit cycle is an isolated periodic trajectory, often taking form as a self-sustaining oscillation, where a system’s state follows a closed path and repeatedly returns to the same values.
0:23
alec_helbling's profile picture

An interesting phenomenon in dynamical systems is the limit cycle. A limit cycle is an isolated periodic trajectory, often taking form as a self-sustaining oscillation, where a system’s state follows a closed path and repeatedly returns to the same values.

Alec Helbling

62,922 views • 3 months ago

Marching squares is a classic algorithm for constructing contours of a 2D scalar field. It is used to create visualizations like topographic maps. Grid cells are matched to simple polygons based on which of their corners are above or below a threshold.
0:21
alec_helbling's profile picture

Marching squares is a classic algorithm for constructing contours of a 2D scalar field. It is used to create visualizations like topographic maps. Grid cells are matched to simple polygons based on which of their corners are above or below a threshold.

Alec Helbling

89,660 views • 7 months ago

One of the strengths of flow matching is that it decouples generative modeling from a specific noise process and choice of source distribution. You can select from a variety of initial distributions like a Gaussian or a uniform distribution and still train a valid flow model.
0:21
alec_helbling's profile picture

One of the strengths of flow matching is that it decouples generative modeling from a specific noise process and choice of source distribution. You can select from a variety of initial distributions like a Gaussian or a uniform distribution and still train a valid flow model.

Alec Helbling

48,646 views • 7 months ago

A cool concept in topological data analysis is the simplicial complex. It connects points with edges, triangles, and higher order analogs. By gradually increasing each point's neighborhood size it captures data's topological structure (e.g. voids, holes) at different scales.
0:25
alec_helbling's profile picture

A cool concept in topological data analysis is the simplicial complex. It connects points with edges, triangles, and higher order analogs. By gradually increasing each point's neighborhood size it captures data's topological structure (e.g. voids, holes) at different scales.

Alec Helbling

54,432 views • 9 months ago

Class conditioning doesn’t just add new capabilities to flow models. It can make the learning problem easier. When there are multiple plausible paths, the class label tells the model which one to take, reducing errors from averaging over conflicting trajectories.
0:23
alec_helbling's profile picture

Class conditioning doesn’t just add new capabilities to flow models. It can make the learning problem easier. When there are multiple plausible paths, the class label tells the model which one to take, reducing errors from averaging over conflicting trajectories.

Alec Helbling

21,016 views • 3 months ago

Our work ConceptAttention was accepted to ICML 2025 as a Spotlight Poster ("top" 2.6% of submissions)! ConceptAttention creates rich saliency maps of text concepts present in generated images and videos. It requires no additional training, only repurposing existing parameters.
0:30
alec_helbling's profile picture

Our work ConceptAttention was accepted to ICML 2025 as a Spotlight Poster ("top" 2.6% of submissions)! ConceptAttention creates rich saliency maps of text concepts present in generated images and videos. It requires no additional training, only repurposing existing parameters.

Alec Helbling

60,810 views • 1 year ago

How can you identify the topological structure of data from finite samples? Persistent homology creates graph-like structures to capture topological features of data at different scales. Features that "persist" over many scales represent data's true structure rather than noise.
0:30
alec_helbling's profile picture

How can you identify the topological structure of data from finite samples? Persistent homology creates graph-like structures to capture topological features of data at different scales. Features that "persist" over many scales represent data's true structure rather than noise.

Alec Helbling

38,090 views • 9 months ago

A visualization of a flow model that transforms a 1D standard Gaussian into a Gaussian mixture. The heatmap shows the changing density and the white lines reflect the trajectories of individual samples over time.
0:20
alec_helbling's profile picture

A visualization of a flow model that transforms a 1D standard Gaussian into a Gaussian mixture. The heatmap shows the changing density and the white lines reflect the trajectories of individual samples over time.

Alec Helbling

29,111 views • 7 months ago

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇
0:30
alec_helbling's profile picture

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇

Alec Helbling

36,655 views • 1 year ago

Introducing ClickDiffusion! We developed a system for precise image manipulation and generation that combines natural language instructions with visual feedback provided by the user through a direct manipulation interface.
0:30
alec_helbling's profile picture

Introducing ClickDiffusion! We developed a system for precise image manipulation and generation that combines natural language instructions with visual feedback provided by the user through a direct manipulation interface.

Alec Helbling

36,303 views • 2 years ago

No more content to load