正在加载视频...
视频加载失败
Mirror descent selects among the minimizers the one closest to initialization for the associated Bregman divergence (its "implicit bias"). Euclidean descent computes an orthogonal projection on the minimizers.
89,293 次观看 • 2 年前 •via X (Twitter)
4 条评论

Gabriel Peyré2 年前
Using the language of this equivalently reads as the fact that the mirror flow (i.e. when tau->0) has conservation laws.

Gabriel Peyré2 年前
The difference between this and our paper is that these conservation laws of implicit bias depend on the data (via the matrix A) whereas we studied conservation laws which are independent of the data (e.g. depend only on the neural network architecture).

Ponds James2 年前
It sounds be the growth rate of a curves with the definition of the derivatives

Joseph David Huelbig2 年前
-e=(imc)²


