正在加载视频...

视频加载失败

Mirror descent selects among the minimizers the one closest to initialization for the associated Bregman divergence (its "implicit bias"). Euclidean descent computes an orthogonal projection on the minimizers.

89,293 次观看 • 2 年前 •via X (Twitter)

4 条评论

Gabriel Peyré 的头像
Gabriel Peyré2 年前

Using the language of this equivalently reads as the fact that the mirror flow (i.e. when tau->0) has conservation laws.

Gabriel Peyré 的头像
Gabriel Peyré2 年前

The difference between this and our paper is that these conservation laws of implicit bias depend on the data (via the matrix A) whereas we studied conservation laws which are independent of the data (e.g. depend only on the neural network architecture).

Ponds James 的头像
Ponds James2 年前

It sounds be the growth rate of a curves with the definition of the derivatives

Joseph David Huelbig 的头像
Joseph David Huelbig2 年前

-e=(imc)²

相关视频