Alec Helbling's banner

Alec Helbling

@alec_helbling • 10,796 subscribers

Interpretability, Multimodality, Diffusion. PhDing @GeorgiaTech. NSF Fellow. Prev intern @Apple, @Adobe, @NASAJPL.

Shorts

The Helmholtz decomposition is one of the fundamental results of vector calculus. It says any well-behaved vector field can be split into two parts, one capturing sources and sinks through divergence, and one capturing rotation through curl.

The Helmholtz decomposition is one of the fundamental results of vector calculus. It says any well-behaved vector field can be split into two parts, one capturing sources and sinks through divergence, and one capturing rotation through curl.

228,044 Aufrufe

Stokes' Theorem is a classic result from vector calculus. It tells us that the line integral of a vector field over a loop is equal to the surface integral of the curl of the vector field over some enclosed surface.

Stokes' Theorem is a classic result from vector calculus. It tells us that the line integral of a vector field over a loop is equal to the surface integral of the curl of the vector field over some enclosed surface.

393,218 Aufrufe

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

Stochastic and deterministic sampling strategies for diffusion models produce strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.

279,123 Aufrufe

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

Flow matching produces smooth, deterministic trajectories. In contrast, the sampling process of a diffusion model is chaotic, resembling the random motion of gas particles.

429,132 Aufrufe

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

In flow matching, a coupling determines how noise and data samples are paired during training. The choice of coupling is important because it influences the geometry of trajectories at inference time. The simplest choice is the independent coupling, where noise and data points are paired arbitrarily. This can lead to curved trajectories as the model averages over many conflicting pairings. However, if we use optimal transport on batches of pairs, this leads to fewer ambiguous intersections that the model must resolve, leading to straighter trajectories at inference time.

65,253 Aufrufe

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

156,451 Aufrufe

Stein Variational Gradient Descent (SVGD) is a particle-based approach to variational inference. SVGD iteratively transports a set of particles to match a target distribution by applying a form of functional gradient descent that minimizes the KL divergence.

Stein Variational Gradient Descent (SVGD) is a particle-based approach to variational inference. SVGD iteratively transports a set of particles to match a target distribution by applying a form of functional gradient descent that minimizes the KL divergence.

27,810 Aufrufe

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

94,095 Aufrufe

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

150,686 Aufrufe

Functions are Vectors This is a great blog post from Max Slater about how viewing functions as infinite dimensional vectors unlocks powerful tools from linear algebra. I think this is an under-emphasized perspective in intro linear algebra classes.

Functions are Vectors This is a great blog post from Max Slater about how viewing functions as infinite dimensional vectors unlocks powerful tools from linear algebra. I think this is an under-emphasized perspective in intro linear algebra classes.

93,345 Aufrufe

Many dimensionality reduction algorithms share a few central principles. 1. Construct a graph that captures the data's local structure 2. Measure "geodesic" distances between points using the graph 3. Project the points to a lower dimension while preserving these distances

Many dimensionality reduction algorithms share a few central principles. 1. Construct a graph that captures the data's local structure 2. Measure "geodesic" distances between points using the graph 3. Project the points to a lower dimension while preserving these distances

88,874 Aufrufe

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

I've been putting together an interactive tool called DiffusionLab for explaining the geometric intuition behind diffusion and flow based generative models. Sampling is actually being done in the browser using Tensorflow.js! It is still in the very early stages.

104,658 Aufrufe

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

Diffusion models leverage a variety of samplers. Deterministic methods like DDIM produce orderly paths. In contrast, stochastic samplers like DDPM produce chaotic trajectories. Despite their differences, both methods draw valid samples from the underlying distribution.

102,987 Aufrufe

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

96,895 Aufrufe

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

I made a tool called Diffusion Explorer that lets you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇

73,124 Aufrufe

I added a guide to the repository for my project ManimML, which is a tool for visualizing neural network architectures and algorithms using only python code. It is built on top of @manim_community which was started by Grant Sanderson. Link:

I added a guide to the repository for my project ManimML, which is a tool for visualizing neural network architectures and algorithms using only python code. It is built on top of @manim_community which was started by Grant Sanderson. Link:

172,253 Aufrufe

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

79,893 Aufrufe

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

34,778 Aufrufe

I wrote this fun interactive article explaining Isomap, a classic non-linear dimensionality reduction technique. Isomap captures the local similarity structure of data through a graph and computes an embedding that preserves this structure. Check it out! Link below.

I wrote this fun interactive article explaining Isomap, a classic non-linear dimensionality reduction technique. Isomap captures the local similarity structure of data through a graph and computes an embedding that preserves this structure. Check it out! Link below.

41,045 Aufrufe

Excited that our work, Concept Attention, was selected as an Oral Presentation at ICML 2025 and recently won the Best Paper Award at the CVPR Workshop on Visual Concepts. Concept Attention allows you to visualize the presence of text concepts in generated videos and images.

Excited that our work, Concept Attention, was selected as an Oral Presentation at ICML 2025 and recently won the Best Paper Award at the CVPR Workshop on Visual Concepts. Concept Attention allows you to visualize the presence of text concepts in generated videos and images.

40,506 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

An interesting phenomenon in dynamical systems is the limit cycle. A limit cycle is an isolated periodic trajectory, often taking form as a self-sustaining oscillation, where a system’s state follows a closed path and repeatedly returns to the same values.

An interesting phenomenon in dynamical systems is the limit cycle. A limit cycle is an isolated periodic trajectory, often taking form as a self-sustaining oscillation, where a system’s state follows a closed path and repeatedly returns to the same values.

62,922 Aufrufe • vor 2 Monaten

Data often lie on a low-dimensional manifold embedded in a high-dimensional space. But these manifolds are often highly non-linear, making linear dimensionality reduction methods like PCA insufficient. This has motivated the development of non-linear dimensionality reduction.

Data often lie on a low-dimensional manifold embedded in a high-dimensional space. But these manifolds are often highly non-linear, making linear dimensionality reduction methods like PCA insufficient. This has motivated the development of non-linear dimensionality reduction.

212,583 Aufrufe • vor 8 Monaten

I wrote an interactive article explaining the geometric intuition behind Rectified Flows. I visually explain why flow-models tend to learn curved trajectories, why this is bad for sampling latency, and a relatively simple technique for mitigating it. Check it out! Link 👇

I wrote an interactive article explaining the geometric intuition behind Rectified Flows. I visually explain why flow-models tend to learn curved trajectories, why this is bad for sampling latency, and a relatively simple technique for mitigating it. Check it out! Link 👇

158,979 Aufrufe • vor 6 Monaten

Marching squares is a classic algorithm for constructing contours of a 2D scalar field. It is used to create visualizations like topographic maps. Grid cells are matched to simple polygons based on which of their corners are above or below a threshold.

Marching squares is a classic algorithm for constructing contours of a 2D scalar field. It is used to create visualizations like topographic maps. Grid cells are matched to simple polygons based on which of their corners are above or below a threshold.

89,660 Aufrufe • vor 5 Monaten

Class conditioning doesn’t just add new capabilities to flow models. It can make the learning problem easier. When there are multiple plausible paths, the class label tells the model which one to take, reducing errors from averaging over conflicting trajectories.

Class conditioning doesn’t just add new capabilities to flow models. It can make the learning problem easier. When there are multiple plausible paths, the class label tells the model which one to take, reducing errors from averaging over conflicting trajectories.

21,016 Aufrufe • vor 1 Monat

A cool concept in topological data analysis is the simplicial complex. It connects points with edges, triangles, and higher order analogs. By gradually increasing each point's neighborhood size it captures data's topological structure (e.g. voids, holes) at different scales.

A cool concept in topological data analysis is the simplicial complex. It connects points with edges, triangles, and higher order analogs. By gradually increasing each point's neighborhood size it captures data's topological structure (e.g. voids, holes) at different scales.

54,381 Aufrufe • vor 8 Monaten

How can you identify the topological structure of data from finite samples? Persistent homology creates graph-like structures to capture topological features of data at different scales. Features that "persist" over many scales represent data's true structure rather than noise.

How can you identify the topological structure of data from finite samples? Persistent homology creates graph-like structures to capture topological features of data at different scales. Features that "persist" over many scales represent data's true structure rather than noise.

38,090 Aufrufe • vor 7 Monaten

Our work ConceptAttention was accepted to ICML 2025 as a Spotlight Poster ("top" 2.6% of submissions)! ConceptAttention creates rich saliency maps of text concepts present in generated images and videos. It requires no additional training, only repurposing existing parameters.

Our work ConceptAttention was accepted to ICML 2025 as a Spotlight Poster ("top" 2.6% of submissions)! ConceptAttention creates rich saliency maps of text concepts present in generated images and videos. It requires no additional training, only repurposing existing parameters.

60,810 Aufrufe • vor 1 Jahr

A visualization of a flow model that transforms a 1D standard Gaussian into a Gaussian mixture. The heatmap shows the changing density and the white lines reflect the trajectories of individual samples over time.

A visualization of a flow model that transforms a 1D standard Gaussian into a Gaussian mixture. The heatmap shows the changing density and the white lines reflect the trajectories of individual samples over time.

29,004 Aufrufe • vor 6 Monaten

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇

36,644 Aufrufe • vor 1 Jahr

Introducing ClickDiffusion! We developed a system for precise image manipulation and generation that combines natural language instructions with visual feedback provided by the user through a direct manipulation interface.

Introducing ClickDiffusion! We developed a system for precise image manipulation and generation that combines natural language instructions with visual feedback provided by the user through a direct manipulation interface.

36,296 Aufrufe • vor 2 Jahren

Keine weiteren Inhalte verfügbar