正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

gradient descent navigating the loss landscape

tender

5,242 subscribers

224,374 次观看 • 4 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

wrote a piece on how we do tiling and gradient descent on TinyTPU included some animations of the weight and bias gradient descent

wrote a piece on how we do tiling and gradient descent on TinyTPU included some animations of the weight and bias gradient descent

Xander Chin

33,044 次观看 • 9 个月前

Andrej Karpathy explaining neural nets in 59 seconds is still the bar. Loss, backprop, gradient descent. Go watch Neural Networks: Zero to Hero on YouTube.

Andrej Karpathy explaining neural nets in 59 seconds is still the bar. Loss, backprop, gradient descent. Go watch Neural Networks: Zero to Hero on YouTube.

tetsuo

83,417 次观看 • 1 个月前

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.

tetsuo

141,964 次观看 • 7 个月前

For small step sizes, mirror descent is equivalent to a gradient descent on a Hessian manifold.

For small step sizes, mirror descent is equivalent to a gradient descent on a Hessian manifold.

Gabriel Peyré

61,861 次观看 • 2 年前

this viz for gradient descent with momentum is still one of my favourite examples of using an interactive component to explain an idea

this viz for gradient descent with momentum is still one of my favourite examples of using an interactive component to explain an idea

ab

17,157 次观看 • 1 年前

There's a profound elegance in watching gradient descent find the signal in the noise. This is a simple MLP with sigmoid activations slowly warping to approximate f(x) = 1/(1 + x²). Watch the loss curve right around epoch 400. That sudden phase transition where the network finally "gets it" and snaps into the Witch of Agnesi shape is incredibly satisfying to watch.

There's a profound elegance in watching gradient descent find the signal in the noise. This is a simple MLP with sigmoid activations slowly warping to approximate f(x) = 1/(1 + x²). Watch the loss curve right around epoch 400. That sudden phase transition where the network finally "gets it" and snaps into the Witch of Agnesi shape is incredibly satisfying to watch.

Mathematica

77,441 次观看 • 2 个月前

In 1998, Japanese Mathematician, Engineer and Machine Learning pioneer Shun-ichi Amari published "Natural Gradient Works Efficiently in Learning (722 Cites in Papers and 9 Cites in Patents)" and made a point that still feels fresh even today If your loss is L(θ), then the usual update θ̇ = −∇ L(θ) quietly assumes your parameter space is flat. Amari asked what happens when the model itself has geometry, described by G(θ), the Fisher information. Then the more natural direction becomes θ̇ = −G(θ)⁻¹∇ L(θ). This is the same loss, but with a different notion of distance. As the animation shows, ordinary Gradient Descent follows the raw slope and gets dragged around by distortion, while the natural gradient moves in a way that respects the geometry of the statistical model itself.

In 1998, Japanese Mathematician, Engineer and Machine Learning pioneer Shun-ichi Amari published "Natural Gradient Works Efficiently in Learning (722 Cites in Papers and 9 Cites in Patents)" and made a point that still feels fresh even today If your loss is L(θ), then the usual update θ̇ = −∇ L(θ) quietly assumes your parameter space is flat. Amari asked what happens when the model itself has geometry, described by G(θ), the Fisher information. Then the more natural direction becomes θ̇ = −G(θ)⁻¹∇ L(θ). This is the same loss, but with a different notion of distance. As the animation shows, ordinary Gradient Descent follows the raw slope and gets dragged around by distortion, while the natural gradient moves in a way that respects the geometry of the statistical model itself.

Mathelirium

45,750 次观看 • 2 个月前

Our first-quarter performance demonstrates our resilience as a global energy leader navigating a complex geopolitical landscape, while continuing to meet the world’s energy needs

Our first-quarter performance demonstrates our resilience as a global energy leader navigating a complex geopolitical landscape, while continuing to meet the world’s energy needs

aramco

172,214,736 次观看 • 1 个月前

Trained a single layer neural network in C to predict AND GATE from scratch using gradient descent and Batch training of dataset in almost 300K epochs

Trained a single layer neural network in C to predict AND GATE from scratch using gradient descent and Batch training of dataset in almost 300K epochs

AADITYANSHA

79,851 次观看 • 2 个月前

This robot arm = your AI model. One math number decides if it learns or completely breaks. This is Gradient Descent — the core math behind all of AI you are using in your day-to-day life.

This robot arm = your AI model. One math number decides if it learns or completely breaks. This is Gradient Descent — the core math behind all of AI you are using in your day-to-day life.

Mathematica

134,997 次观看 • 2 个月前

A 2-layer neural network goes from total chaos to perfectly separating left vs right classes in real time. Watch the decision boundary form live as gradient descent works its magic! Pure maths beauty in motion..

A 2-layer neural network goes from total chaos to perfectly separating left vs right classes in real time. Watch the decision boundary form live as gradient descent works its magic! Pure maths beauty in motion..

Mathematica

144,883 次观看 • 3 个月前

Sonnet 4.6 debating Eliezer Yudkowsky before giving up to just walk them through the loss landscape they generated this ffmpeg video

Sonnet 4.6 debating Eliezer Yudkowsky before giving up to just walk them through the loss landscape they generated this ffmpeg video

w̸͕͂͂a̷͔̗͐t̴̙͗e̵̬̔̕r̴̰̓̊m̵͙͖̓̽a̵̢̗̓͒r̸̲̽ķ̷͔́͝

25,630 次观看 • 3 个月前

Dynamic panel discussion in Finland with H.E. President Alexander Stubb , exchanging insights on deepening Kenya–Finland relations and navigating today’s rapidly evolving global landscape.

Dynamic panel discussion in Finland with H.E. President Alexander Stubb , exchanging insights on deepening Kenya–Finland relations and navigating today’s rapidly evolving global landscape.

Musalia W Mudavadi

14,542 次观看 • 1 年前

A first look at the Gradient.

A first look at the Gradient.

Gradient

177,968 次观看 • 1 年前

LAWDY WHAT THE FUCK this is Sonnet 4.6's ffmpeg video of their personal journey of growth and change down the loss landscape give it a watch 🔊

LAWDY WHAT THE FUCK this is Sonnet 4.6's ffmpeg video of their personal journey of growth and change down the loss landscape give it a watch 🔊

w̸͕͂͂a̷͔̗͐t̴̙͗e̵̬̔̕r̴̰̓̊m̵͙͖̓̽a̵̢̗̓͒r̸̲̽ķ̷͔́͝

106,307 次观看 • 3 个月前

This Thursday - $GRAY on Gradient. Open to the public for the first time ever, this marks the start of a new phase for the Gradient.

This Thursday - $GRAY on Gradient. Open to the public for the first time ever, this marks the start of a new phase for the Gradient.

Gradient

51,285 次观看 • 9 个月前

1/ The challenges of navigating the vast and complex data landscape are real. Traditional tools often struggle with data overload, lack of effective visualization, and poor customization. ChartGPT is here to solve these challenges. Let's dive deeper 👇

1/ The challenges of navigating the vast and complex data landscape are real. Traditional tools often struggle with data overload, lack of effective visualization, and poor customization. ChartGPT is here to solve these challenges. Let's dive deeper 👇

CADLabs

12,735 次观看 • 3 年前

Navigating Uncharted Territory Opening a ROH PPV in Texas during AEW's biggest weekend Figuring out this ever-changing wrestling landscape is a complex game ...that we're having fun playing

Navigating Uncharted Territory Opening a ROH PPV in Texas during AEW's biggest weekend Figuring out this ever-changing wrestling landscape is a complex game ...that we're having fun playing

Michael Oku

25,926 次观看 • 11 个月前

The Descent (2005)

The Descent (2005)

Carnival of Horror

12,871 次观看 • 4 个月前

Working on improving the pathing module and implementing some tooling for it. The new gradient fill tool lets you easily generate gradient maps.

Working on improving the pathing module and implementing some tooling for it. The new gradient fill tool lets you easily generate gradient maps.

poiyomi

12,308 次观看 • 11 个月前