Implicit regularization of SGD in a linear model
A brief mathematical result
Posts
Treating high-dimensional prediction/generation as optimization
Exploring connections between diffusion models, alphafold’s recycling, structured prediction energy networks, and manifold learning.
Primer on Score-based Generative Models
An introduction
Implicit Differentiation through Equilibria
An introduction.
On KL Divergence in Discrete Spaces
KL behaves differently in discrete spaces than in continuous spaces.