正在加载视频...
视频加载失败
Mirror descent selects among the minimizers the one closest to initialization for the associated Bregman divergence (its "implicit bias"). Euclidean descent computes an orthogonal projection on the minimizers.
89,305 次观看 • 2 年前 •via X (Twitter)
4 条评论

Gabriel Peyré2 年前
Using the language of this equivalently reads as the fact that the mirror flow (i.e. when tau->0) has conservation laws.

Gabriel Peyré2 年前
The difference between this and our paper is that these conservation laws of implicit bias depend on the data (via the matrix A) whereas we studied conservation laws which are independent of the data (e.g. depend only on the neural network architecture).

Ponds James2 年前
It sounds be the growth rate of a curves with the definition of the derivatives

Joseph David Huelbig2 年前
-e=(imc)²
相关视频
2:07
Sensitive content
the first descent part1 commissioned by Jim Thanks to Ruby 💋 - OPEN COMMISSIONS for helping me with the audio =) #giantess
Condorman
41,486 次观看 • 11 个月前





