Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

For small step sizes, mirror descent is equivalent to a gradient descent on a Hessian manifold.

gabrielpeyre's profile picture

Gabriel Peyré

100,555 subscribers

61,868 Aufrufe • vor 2 Jahren •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von LowρUF👁️ 🇵🇦🇬🇱🇨🇦🇲🇽
LowρUF👁️ 🇵🇦🇬🇱🇨🇦🇲🇽vor 2 Jahren

If I understood 65% of this instead of 35% of this, I think it'd save ~90hr of my computer running at full tilt in my current research

Profilbild von Samuel Hurault
Samuel Huraultvor 2 Jahren

Does mirror descent correspond to a discretization of this flow ?

Profilbild von Gabriel Peyré
Gabriel Peyrévor 2 Jahren

Yes, a very smart one actually (for instance it preserves all the thm of speed of convergence as usual gradient descent)

Profilbild von Alireza Mansouri
Alireza Mansourivor 2 Jahren

How do you make this kind of animation? I mean by which software?

Profilbild von AImaster
AImastervor 2 Jahren

fucking cool! better than any pussies I have got.

Profilbild von AImaster
AImastervor 2 Jahren

@readwise save thread @SaveToNotion #thread @threadreaderapp unroll @memdotai mem it

Profilbild von Thread Reader App
Thread Reader Appvor 2 Jahren

@gabrielpeyre @readwise @SaveToNotion @memdotai @CeoSpaceY Hi! please find the unroll here: Talk to you soon. 🤖

Ähnliche Videos

gradient descent..it's not just an algorithm..it's a lifestyle
2:45

gradient descent..it's not just an algorithm..it's a lifestyle

ashe

680,103 Aufrufe • vor 8 Tagen

this is how machine learning actually works (gradient descent with bad starting parameters)
0:27

this is how machine learning actually works (gradient descent with bad starting parameters)

LaurieWired

38,694 Aufrufe • vor 1 Jahr

Andrej Karpathy explaining neural nets in 59 seconds is still the bar. Loss, backprop, gradient descent. Go watch Neural Networks: Zero to Hero on YouTube.
0:59

Andrej Karpathy explaining neural nets in 59 seconds is still the bar. Loss, backprop, gradient descent. Go watch Neural Networks: Zero to Hero on YouTube.

tetsuo

83,664 Aufrufe • vor 2 Monaten

Trained a single layer neural network in C to predict AND GATE from scratch using gradient descent and Batch training of dataset in almost 300K epochs
0:22

Trained a single layer neural network in C to predict AND GATE from scratch using gradient descent and Batch training of dataset in almost 300K epochs

AADITYANSHA

80,920 Aufrufe • vor 3 Monaten

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.
0:59

Andrej Karpathy summarizes how neural networks function, including the process of using a loss function in training and applying backpropagation for optimizing the network parameters through gradient descent.

tetsuo

141,964 Aufrufe • vor 8 Monaten

NIGERIA: This is a descent into abyss. Been trying so hard to understand what on earth is going on here.
0:48

NIGERIA: This is a descent into abyss. Been trying so hard to understand what on earth is going on here.

J. C. Okechukwu

92,013 Aufrufe • vor 2 Jahren

Man turns a hill descent into a full on acrobatic show
0:23

Man turns a hill descent into a full on acrobatic show

Science girl

57,035 Aufrufe • vor 11 Monaten

James Fishback on what is a real American. “Are Americans only people of European descent?” Well this is up for debate…
1:47

James Fishback on what is a real American. “Are Americans only people of European descent?” Well this is up for debate…

Hermes

56,399 Aufrufe • vor 5 Monaten

Happy birthday Descent. This is a reminder that you can play the 1995 classic on your Meta Quest. A port by chvjak available on SideQuest 🎊 🎉 Note: You'll need the original full game files #Descent #VR
1:37

Happy birthday Descent. This is a reminder that you can play the 1995 classic on your Meta Quest. A port by chvjak available on SideQuest 🎊 🎉 Note: You'll need the original full game files #Descent #VR

Team Beef - VR Ports

36,255 Aufrufe • vor 4 Monaten

Descent is a hard-ass game. This was just level 3.
2:19

Descent is a hard-ass game. This was just level 3.

JikissGamer

121,680 Aufrufe • vor 2 Jahren

The reality behind a smooth descent 😅
0:45

The reality behind a smooth descent 😅

Sarah Lezito

15,747 Aufrufe • vor 1 Jahr

Raptor engine demonstration of a descent burn to the lunar surface
0:31

Raptor engine demonstration of a descent burn to the lunar surface

SpaceX

78,200,590 Aufrufe • vor 2 Jahren

From the Patriot Act to Palantir: America’s descent into a surveillance state.
2:30

From the Patriot Act to Palantir: America’s descent into a surveillance state.

American Communist Party

38,721 Aufrufe • vor 9 Monaten

A 2-layer neural network goes from total chaos to perfectly separating left vs right classes in real time. Watch the decision boundary form live as gradient descent works its magic! Pure maths beauty in motion..
0:32

A 2-layer neural network goes from total chaos to perfectly separating left vs right classes in real time. Watch the decision boundary form live as gradient descent works its magic! Pure maths beauty in motion..

Mathematica

145,026 Aufrufe • vor 4 Monaten

🇧🇷🇵🇱 Apparently, there is a good-weather version of Poland! A small town in Brazil, Áurea, where 90% of the people are of Polish descent. Wonder how they adjusted the Pierogi recipe for the local environment?
0:27

🇧🇷🇵🇱 Apparently, there is a good-weather version of Poland! A small town in Brazil, Áurea, where 90% of the people are of Polish descent. Wonder how they adjusted the Pierogi recipe for the local environment?

Lord Bebo

137,207 Aufrufe • vor 4 Monaten

What it feels like to hold 🇲🇽 Isaac del Toro’s wheel on a fast descent 💨 📽️ IG: colnagoworld
1:29

What it feels like to hold 🇲🇽 Isaac del Toro’s wheel on a fast descent 💨 📽️ IG: colnagoworld

Domestique

15,868 Aufrufe • vor 7 Monaten

He continues to circle the drain in a substance fueled, impaired descent into dementia.
0:47

He continues to circle the drain in a substance fueled, impaired descent into dementia.

Ron Filipkowski

2,911,841 Aufrufe • vor 2 Jahren

The Wailing (2016) is a slow-burning descent that keeps shifting its ground. What starts as a small-town mystery keeps expanding into something darker and more disturbing, constantly forcing you to rethink what you’re watching.
1:14

The Wailing (2016) is a slow-burning descent that keeps shifting its ground. What starts as a small-town mystery keeps expanding into something darker and more disturbing, constantly forcing you to rethink what you’re watching.

cinesthetic.

15,372 Aufrufe • vor 7 Monaten

Voices from the UN Permanent Forum on People of African Descent. Cynthia, Ebony, and Elisa share powerful perspectives on reparatory justice and dignity for people of African descent. Justice and dignity are fundamental human rights for all.
0:47

Voices from the UN Permanent Forum on People of African Descent. Cynthia, Ebony, and Elisa share powerful perspectives on reparatory justice and dignity for people of African descent. Justice and dignity are fundamental human rights for all.

UN Human Rights

10,634 Aufrufe • vor 2 Monaten