Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

For small step sizes, mirror descent is equivalent to a gradient descent on a Hessian manifold.

gabrielpeyre's profile picture

Gabriel Peyré

100,555 subscribers

61,868 görüntüleme • 2 yıl önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

7 Yorum

LowρUF👁️ 🇵🇦🇬🇱🇨🇦🇲🇽 profil fotoğrafı
LowρUF👁️ 🇵🇦🇬🇱🇨🇦🇲🇽2 yıl önce

If I understood 65% of this instead of 35% of this, I think it'd save ~90hr of my computer running at full tilt in my current research

Samuel Hurault profil fotoğrafı
Samuel Hurault2 yıl önce

Does mirror descent correspond to a discretization of this flow ?

Gabriel Peyré profil fotoğrafı
Gabriel Peyré2 yıl önce

Yes, a very smart one actually (for instance it preserves all the thm of speed of convergence as usual gradient descent)

Alireza Mansouri profil fotoğrafı
Alireza Mansouri2 yıl önce

How do you make this kind of animation? I mean by which software?

AImaster profil fotoğrafı
AImaster2 yıl önce

fucking cool! better than any pussies I have got.

AImaster profil fotoğrafı
AImaster2 yıl önce

@readwise save thread @SaveToNotion #thread @threadreaderapp unroll @memdotai mem it

Thread Reader App profil fotoğrafı
Thread Reader App2 yıl önce

@gabrielpeyre @readwise @SaveToNotion @memdotai @CeoSpaceY Hi! please find the unroll here: Talk to you soon. 🤖

Benzer Videolar

gradient descent navigating the loss landscape
0:27

gradient descent navigating the loss landscape

tender

224,374 görüntüleme • 4 ay önce

this is how machine learning actually works (gradient descent with bad starting parameters)
0:27

this is how machine learning actually works (gradient descent with bad starting parameters)

LaurieWired

38,694 görüntüleme • 1 yıl önce

this viz for gradient descent with momentum is still one of my favourite examples of using an interactive component to explain an idea
0:25

this viz for gradient descent with momentum is still one of my favourite examples of using an interactive component to explain an idea

ab

17,157 görüntüleme • 1 yıl önce

Andrej Karpathy explaining neural nets in 59 seconds is still the bar. Loss, backprop, gradient descent. Go watch Neural Networks: Zero to Hero on YouTube.
0:59

Andrej Karpathy explaining neural nets in 59 seconds is still the bar. Loss, backprop, gradient descent. Go watch Neural Networks: Zero to Hero on YouTube.

tetsuo

83,417 görüntüleme • 1 ay önce

Trained a single layer neural network in C to predict AND GATE from scratch using gradient descent and Batch training of dataset in almost 300K epochs
0:22

Trained a single layer neural network in C to predict AND GATE from scratch using gradient descent and Batch training of dataset in almost 300K epochs

AADITYANSHA

79,936 görüntüleme • 3 ay önce

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.
0:59

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.

tetsuo

141,964 görüntüleme • 8 ay önce

NIGERIA: This is a descent into abyss. Been trying so hard to understand what on earth is going on here.
0:48

NIGERIA: This is a descent into abyss. Been trying so hard to understand what on earth is going on here.

J. C. Okechukwu

92,013 görüntüleme • 2 yıl önce

Man turns a hill descent into a full on acrobatic show
0:23

Man turns a hill descent into a full on acrobatic show

Science girl

57,035 görüntüleme • 10 ay önce

James Fishback on what is a real American. “Are Americans only people of European descent?” Well this is up for debate…
1:47

James Fishback on what is a real American. “Are Americans only people of European descent?” Well this is up for debate…

Hermes

56,399 görüntüleme • 4 ay önce

Happy birthday Descent. This is a reminder that you can play the 1995 classic on your Meta Quest. A port by chvjak available on SideQuest 🎊 🎉 Note: You'll need the original full game files #Descent #VR
1:37

Happy birthday Descent. This is a reminder that you can play the 1995 classic on your Meta Quest. A port by chvjak available on SideQuest 🎊 🎉 Note: You'll need the original full game files #Descent #VR

Team Beef - VR Ports

36,200 görüntüleme • 3 ay önce

Descent is a hard-ass game. This was just level 3.
2:19

Descent is a hard-ass game. This was just level 3.

JikissGamer

121,680 görüntüleme • 2 yıl önce

Raptor engine demonstration of a descent burn to the lunar surface
0:31

Raptor engine demonstration of a descent burn to the lunar surface

SpaceX

78,200,084 görüntüleme • 2 yıl önce

The reality behind a smooth descent 😅
0:45

The reality behind a smooth descent 😅

Sarah Lezito

15,747 görüntüleme • 1 yıl önce

From the Patriot Act to Palantir: America’s descent into a surveillance state.
2:30

From the Patriot Act to Palantir: America’s descent into a surveillance state.

American Communist Party

38,721 görüntüleme • 8 ay önce

A 2-layer neural network goes from total chaos to perfectly separating left vs right classes in real time. Watch the decision boundary form live as gradient descent works its magic! Pure maths beauty in motion..
0:32

A 2-layer neural network goes from total chaos to perfectly separating left vs right classes in real time. Watch the decision boundary form live as gradient descent works its magic! Pure maths beauty in motion..

Mathematica

145,000 görüntüleme • 3 ay önce

What it feels like to hold 🇲🇽 Isaac del Toro’s wheel on a fast descent 💨 📽️ IG: colnagoworld
1:29

What it feels like to hold 🇲🇽 Isaac del Toro’s wheel on a fast descent 💨 📽️ IG: colnagoworld

Domestique

15,868 görüntüleme • 6 ay önce

🇧🇷🇵🇱 Apparently, there is a good-weather version of Poland! A small town in Brazil, Áurea, where 90% of the people are of Polish descent. Wonder how they adjusted the Pierogi recipe for the local environment?
0:27

🇧🇷🇵🇱 Apparently, there is a good-weather version of Poland! A small town in Brazil, Áurea, where 90% of the people are of Polish descent. Wonder how they adjusted the Pierogi recipe for the local environment?

Lord Bebo

137,207 görüntüleme • 3 ay önce

Democrats' Descent: From Resistance to Rage
3:59

Democrats' Descent: From Resistance to Rage

Gutfeld!

61,445 görüntüleme • 11 ay önce

The Wailing (2016) is a slow-burning descent that keeps shifting its ground. What starts as a small-town mystery keeps expanding into something darker and more disturbing, constantly forcing you to rethink what you’re watching.
1:14

The Wailing (2016) is a slow-burning descent that keeps shifting its ground. What starts as a small-town mystery keeps expanding into something darker and more disturbing, constantly forcing you to rethink what you’re watching.

cinesthetic.

15,372 görüntüleme • 6 ay önce

He continues to circle the drain in a substance fueled, impaired descent into dementia.
0:47

He continues to circle the drain in a substance fueled, impaired descent into dementia.

Ron Filipkowski

2,911,786 görüntüleme • 2 yıl önce