Loading video...

Video Failed to Load

Go Home

For small step sizes, mirror descent is equivalent to a gradient descent on a Hessian manifold.

61,868 views • 2 years ago •via X (Twitter)

7 Comments

LowρUF👁️ 🇵🇦🇬🇱🇨🇦🇲🇽's profile picture
LowρUF👁️ 🇵🇦🇬🇱🇨🇦🇲🇽2 years ago

If I understood 65% of this instead of 35% of this, I think it'd save ~90hr of my computer running at full tilt in my current research

Samuel Hurault's profile picture
Samuel Hurault2 years ago

Does mirror descent correspond to a discretization of this flow ?

Gabriel Peyré's profile picture
Gabriel Peyré2 years ago

Yes, a very smart one actually (for instance it preserves all the thm of speed of convergence as usual gradient descent)

Alireza Mansouri's profile picture
Alireza Mansouri2 years ago

How do you make this kind of animation? I mean by which software?

AImaster's profile picture
AImaster2 years ago

fucking cool! better than any pussies I have got.

AImaster's profile picture
AImaster2 years ago

@readwise save thread @SaveToNotion #thread @threadreaderapp unroll @memdotai mem it

Thread Reader App's profile picture
Thread Reader App2 years ago

@gabrielpeyre @readwise @SaveToNotion @memdotai @CeoSpaceY Hi! please find the unroll here: Talk to you soon. 🤖

Related Videos