Treating high-dimensional prediction/generation as optimization
Exploring connections between diffusion models, alphafold’s recycling, structured prediction energy networks, and manifold learning.
Primer on Score-based Generative Models
An introduction
Implicit Differentiation through Equilibria
An introduction.
On KL Divergence in Discrete Spaces
KL behaves differently in discrete spaces than in continuous spaces.