Loading video...

Video Failed to Load

Go Home

One of the simplest algorithms for sampling from a probability distribution is Random Walk Metropolis-Hastings. It proposes new samples by taking Gaussian-distributed steps, accepting or rejecting them to maintain the target distribution. I call this pdf the "fidget spinner".

alec_helbling's profile picture

Alec Helbling

10,799 subscribers

79,869 views • 1 year ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.
0:13

Flow Matching aims to learn a "flow" that transforms a simple source distribution (e.g. Gaussian) to an arbitrarily complex target distribution. This video shows the evolution of the marginal probability path as a source distribution is transformed to a target distribution.

Alec Helbling

150,686 views • 1 year ago

A basic strategy for drawing from a random distribution is to first generate uniformly-distributed points, then "warp" these points so they're spread out according to the target distribution. For example, the Box-Muller transform takes uniform points to normally-distributed ones
0:16

A basic strategy for drawing from a random distribution is to first generate uniformly-distributed points, then "warp" these points so they're spread out according to the target distribution. For example, the Box-Muller transform takes uniform points to normally-distributed ones

Keenan Crane

63,847 views • 2 years ago

One common trick in MCMC methods is called 'burn-in'. It allows you to produce better samples by letting the chain first converge to the target distribution, discarding the first few samples which may be out of distribution.
0:16

One common trick in MCMC methods is called 'burn-in'. It allows you to produce better samples by letting the chain first converge to the target distribution, discarding the first few samples which may be out of distribution.

Alec Helbling

34,728 views • 1 year ago

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.
0:19

Langevin Monte Carlo allows you to draw samples from a probability distribution using its log gradient ∇ log p(x). By performing a sort of gradient ascent with noise you can navigate around the distribution. Langevin MC is heavily related to modern diffusion models.

Alec Helbling

96,842 views • 1 year ago

A discrete Markov chain is basically a random walk on a graph, where each outgoing edge has a fixed probability. Cool fact: any initial distribution on a sufficiently nice* Markov chain converges to its stationary distribution after many steps—because it's a contraction mapping.
0:13

A discrete Markov chain is basically a random walk on a graph, where each outgoing edge has a fixed probability. Cool fact: any initial distribution on a sufficiently nice* Markov chain converges to its stationary distribution after many steps—because it's a contraction mapping.

Keenan Crane

181,771 views • 1 year ago

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.
0:10

Hamiltonian Monte Carlo frames sampling from a probability distribution as a physics problem. By endowing "particles" with momentum and simulating their energy and motion through Hamilton's equations you can efficiently explore a distribution.

Alec Helbling

156,451 views • 7 months ago

This animation shows how a uniform grid of points is deformed by a flow matching model. The visualization highlights how the learned flow warps the underlying space—stretching, compressing, and bending it—to transform one probability distribution into another.
0:13

This animation shows how a uniform grid of points is deformed by a flow matching model. The visualization highlights how the learned flow warps the underlying space—stretching, compressing, and bending it—to transform one probability distribution into another.

Alec Helbling

42,959 views • 1 year ago

Random Walks aim to explore a distribution through random perturbations. This is likely to move into low density regions, which is inefficient. Hamiltonian MC sails through a distribution much more rapidly by incorporating the distribution's structure into proposals.
0:13

Random Walks aim to explore a distribution through random perturbations. This is likely to move into low density regions, which is inefficient. Hamiltonian MC sails through a distribution much more rapidly by incorporating the distribution's structure into proposals.

Alec Helbling

32,767 views • 1 year ago

This is a fun interactive article explaining the intuition behind Gaussian Processes. Gaussian Processes allow you to construct a distribution over functions with a continuous domain. They are incredibly useful for applications like Bayesian regression.
0:18

This is a fun interactive article explaining the intuition behind Gaussian Processes. Gaussian Processes allow you to construct a distribution over functions with a continuous domain. They are incredibly useful for applications like Bayesian regression.

Alec Helbling

41,360 views • 1 year ago

The car distribution system is in a new era...!
0:13

The car distribution system is in a new era...!

Posts Of Cats

129,327 views • 10 months ago

Instead of pointing lookAt to a position, I tried driving it along a line. The control over distribution is kind of nice.
0:19

Instead of pointing lookAt to a position, I tried driving it along a line. The control over distribution is kind of nice.

François Lefebvre

25,082 views • 4 months ago

this is my app "Kairo Alarm" i fought the urge to keep polishing it, and shipped it in 7 days. if you're starting a new app: → build the fastest polished version possible → ship in 7–14 days max → go all-in on distribution distribution is what matters early on
0:19

this is my app "Kairo Alarm" i fought the urge to keep polishing it, and shipped it in 7 days. if you're starting a new app: → build the fastest polished version possible → ship in 7–14 days max → go all-in on distribution distribution is what matters early on

⌭ ROSS

30,407 views • 1 month ago

I tried to capture this fidget spinner using the Huawei Pura70 Ultra to test its capability in handling fast-moving subjects. The result is truly impressive.
0:19

I tried to capture this fidget spinner using the Huawei Pura70 Ultra to test its capability in handling fast-moving subjects. The result is truly impressive.

Alvin

967,725 views • 1 year ago

Taking the dog for a walk.... or rather he is taking me for a walk
0:19

Taking the dog for a walk.... or rather he is taking me for a walk

Cathy Heaven

381,623 views • 3 years ago

The new Shader of the Week is "Fidget Cube" by TheBen27:
0:12

The new Shader of the Week is "Fidget Cube" by TheBen27:

Shadertoy

15,884 views • 1 year ago

Taking the robot for a walk. The android needs to get its 10k steps in.
0:11

Taking the robot for a walk. The android needs to get its 10k steps in.

TastefulLindy

29,936 views • 10 months ago

✨ New samwho visual essay o'clock! ✨ Reservoir sampling is one of my favourite algorithms. It allows you to sample from a set without knowing the size of that set. I assume no prior knowledge, and use no math notation. Just beautiful visuals. Let me know what you think! ❤️
0:16

✨ New samwho visual essay o'clock! ✨ Reservoir sampling is one of my favourite algorithms. It allows you to sample from a set without knowing the size of that set. I assume no prior knowledge, and use no math notation. Just beautiful visuals. Let me know what you think! ❤️

Sam Rose

24,073 views • 1 year ago

Israel is wiping out the bridges of South Lebanon — one by one. Not for military necessity, but to isolate an entire population. To trap them. To starve them. To cut them off from hospitals, food, and aid. Call it what it is: A crime against humanity.
0:13

Israel is wiping out the bridges of South Lebanon — one by one. Not for military necessity, but to isolate an entire population. To trap them. To starve them. To cut them off from hospitals, food, and aid. Call it what it is: A crime against humanity.

sarah

26,034 views • 3 months ago

trying to show oomf the fidget spinner and he wouldn’t do it and it pissed me off
0:15

trying to show oomf the fidget spinner and he wouldn’t do it and it pissed me off

junie ⋆˚࿔

12,170 views • 2 months ago