Alec Helbling's banner

Alec Helbling

@alec_helbling • 10,796 subscribers

Interpretability, Multimodality, Diffusion. PhDing @GeorgiaTech. NSF Fellow. Prev intern @Apple, @Adobe, @NASAJPL.

Shorts

The Helmholtz decomposition is one of the fundamental results of vector calculus. It says any well-behaved vector field can be split into two parts, one capturing sources and sinks through divergence, and one capturing rotation through curl.

The Helmholtz decomposition is one of the fundamental results of vector calculus. It says any well-behaved vector field can be split into two parts, one capturing sources and sinks through divergence, and one capturing rotation through curl.

228,968 просмотров

Stokes' Theorem is a classic result from vector calculus. It tells us that the line integral of a vector field over a loop is equal to the surface integral of the curl of the vector field over some enclosed surface.

Stokes' Theorem is a classic result from vector calculus. It tells us that the line integral of a vector field over a loop is equal to the surface integral of the curl of the vector field over some enclosed surface.

438,792 просмотров

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

436,518 просмотров

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

279,275 просмотров

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

168,757 просмотров

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

65,484 просмотров

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

94,195 просмотров

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

150,686 просмотров

Functions are Vectors This is a great blog post from Max Slater about how viewing functions as infinite dimensional vectors unlocks powerful tools from linear algebra. I think this is an under-emphasized perspective in intro linear algebra classes.

Functions are Vectors This is a great blog post from Max Slater about how viewing functions as infinite dimensional vectors unlocks powerful tools from linear algebra. I think this is an under-emphasized perspective in intro linear algebra classes.

93,507 просмотров

Many dimensionality reduction algorithms share a few central principles. 1. Construct a graph that captures the data's local structure 2. Measure "geodesic" distances between points using the graph 3. Project the points to a lower dimension while preserving these distances

Many dimensionality reduction algorithms share a few central principles. 1. Construct a graph that captures the data's local structure 2. Measure "geodesic" distances between points using the graph 3. Project the points to a lower dimension while preserving these distances

88,874 просмотров

Stein Variational Gradient Descent (SVGD) is a particle-based approach to variational inference. SVGD iteratively transports a set of particles to match a target distribution by applying a form of functional gradient descent that minimizes the KL divergence.

Stein Variational Gradient Descent (SVGD) is a particle-based approach to variational inference. SVGD iteratively transports a set of particles to match a target distribution by applying a form of functional gradient descent that minimizes the KL divergence.

28,173 просмотров

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

104,658 просмотров

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

102,987 просмотров

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

96,895 просмотров

I added a guide to the repository for my project ManimML, which is a tool for visualizing neural network architectures and algorithms using only python code. It is built on top of @manim_community which was started by Grant Sanderson. Link:

I added a guide to the repository for my project ManimML, which is a tool for visualizing neural network architectures and algorithms using only python code. It is built on top of @manim_community which was started by Grant Sanderson. Link:

172,253 просмотров

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

73,124 просмотров

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

79,904 просмотров

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

34,778 просмотров

I wrote this fun interactive article explaining Isomap, a classic non-linear dimensionality reduction technique. Isomap captures the local similarity structure of data through a graph and computes an embedding that preserves this structure. Check it out! Link below.

I wrote this fun interactive article explaining Isomap, a classic non-linear dimensionality reduction technique. Isomap captures the local similarity structure of data through a graph and computes an embedding that preserves this structure. Check it out! Link below.

41,045 просмотров

Excited that our work, Concept Attention, was selected as an Oral Presentation at ICML 2025 and recently won the Best Paper Award at the CVPR Workshop on Visual Concepts. Concept Attention allows you to visualize the presence of text concepts in generated videos and images.

Excited that our work, Concept Attention, was selected as an Oral Presentation at ICML 2025 and recently won the Best Paper Award at the CVPR Workshop on Visual Concepts. Concept Attention allows you to visualize the presence of text concepts in generated videos and images.

42,726 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Masked diffusion is a discrete analog of continuous diffusion. Continuous diffusion gradually adds Gaussian noise, then learns to reverse that process to recover data. Masked diffusion instead progressively replaces tokens with a mask token, then learns to fill them back in.

Masked diffusion is a discrete analog of continuous diffusion. Continuous diffusion gradually adds Gaussian noise, then learns to reverse that process to recover data. Masked diffusion instead progressively replaces tokens with a mask token, then learns to fill them back in.

24,575 просмотров • 22 дней назад

Data often lie on a low-dimensional manifold embedded in a high-dimensional space. But these manifolds are often highly non-linear, making linear dimensionality reduction methods like PCA insufficient. This has motivated the development of non-linear dimensionality reduction.

Data often lie on a low-dimensional manifold embedded in a high-dimensional space. But these manifolds are often highly non-linear, making linear dimensionality reduction methods like PCA insufficient. This has motivated the development of non-linear dimensionality reduction.

212,685 просмотров • 9 месяцев назад

I wrote an interactive article explaining the geometric intuition behind Rectified Flows. I visually explain why flow-models tend to learn curved trajectories, why this is bad for sampling latency, and a relatively simple technique for mitigating it. Check it out! Link 👇

I wrote an interactive article explaining the geometric intuition behind Rectified Flows. I visually explain why flow-models tend to learn curved trajectories, why this is bad for sampling latency, and a relatively simple technique for mitigating it. Check it out! Link 👇

159,259 просмотров • 7 месяцев назад

An interesting phenomenon in dynamical systems is the limit cycle. A limit cycle is an isolated periodic trajectory, often taking form as a self-sustaining oscillation, where a system’s state follows a closed path and repeatedly returns to the same values.

An interesting phenomenon in dynamical systems is the limit cycle. A limit cycle is an isolated periodic trajectory, often taking form as a self-sustaining oscillation, where a system’s state follows a closed path and repeatedly returns to the same values.

62,922 просмотров • 3 месяцев назад

Marching squares is a classic algorithm for constructing contours of a 2D scalar field. It is used to create visualizations like topographic maps. Grid cells are matched to simple polygons based on which of their corners are above or below a threshold.

Marching squares is a classic algorithm for constructing contours of a 2D scalar field. It is used to create visualizations like topographic maps. Grid cells are matched to simple polygons based on which of their corners are above or below a threshold.

89,660 просмотров • 7 месяцев назад

One of the strengths of flow matching is that it decouples generative modeling from a specific noise process and choice of source distribution. You can select from a variety of initial distributions like a Gaussian or a uniform distribution and still train a valid flow model.

One of the strengths of flow matching is that it decouples generative modeling from a specific noise process and choice of source distribution. You can select from a variety of initial distributions like a Gaussian or a uniform distribution and still train a valid flow model.

48,646 просмотров • 7 месяцев назад

A cool concept in topological data analysis is the simplicial complex. It connects points with edges, triangles, and higher order analogs. By gradually increasing each point's neighborhood size it captures data's topological structure (e.g. voids, holes) at different scales.

A cool concept in topological data analysis is the simplicial complex. It connects points with edges, triangles, and higher order analogs. By gradually increasing each point's neighborhood size it captures data's topological structure (e.g. voids, holes) at different scales.

54,432 просмотров • 9 месяцев назад

Class conditioning doesn’t just add new capabilities to flow models. It can make the learning problem easier. When there are multiple plausible paths, the class label tells the model which one to take, reducing errors from averaging over conflicting trajectories.

Class conditioning doesn’t just add new capabilities to flow models. It can make the learning problem easier. When there are multiple plausible paths, the class label tells the model which one to take, reducing errors from averaging over conflicting trajectories.

21,016 просмотров • 3 месяцев назад

Our work ConceptAttention was accepted to ICML 2025 as a Spotlight Poster ("top" 2.6% of submissions)! ConceptAttention creates rich saliency maps of text concepts present in generated images and videos. It requires no additional training, only repurposing existing parameters.

Our work ConceptAttention was accepted to ICML 2025 as a Spotlight Poster ("top" 2.6% of submissions)! ConceptAttention creates rich saliency maps of text concepts present in generated images and videos. It requires no additional training, only repurposing existing parameters.

60,810 просмотров • 1 год назад

How can you identify the topological structure of data from finite samples? Persistent homology creates graph-like structures to capture topological features of data at different scales. Features that "persist" over many scales represent data's true structure rather than noise.

How can you identify the topological structure of data from finite samples? Persistent homology creates graph-like structures to capture topological features of data at different scales. Features that "persist" over many scales represent data's true structure rather than noise.

38,090 просмотров • 9 месяцев назад

A visualization of a flow model that transforms a 1D standard Gaussian into a Gaussian mixture. The heatmap shows the changing density and the white lines reflect the trajectories of individual samples over time.

A visualization of a flow model that transforms a 1D standard Gaussian into a Gaussian mixture. The heatmap shows the changing density and the white lines reflect the trajectories of individual samples over time.

29,111 просмотров • 7 месяцев назад

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇

36,655 просмотров • 1 год назад

Introducing ClickDiffusion! We developed a system for precise image manipulation and generation that combines natural language instructions with visual feedback provided by the user through a direct manipulation interface.

Introducing ClickDiffusion! We developed a system for precise image manipulation and generation that combines natural language instructions with visual feedback provided by the user through a direct manipulation interface.

36,303 просмотров • 2 лет назад

Больше нет контента для загрузки