Arc en Ciel article
Equivariance VAE reproduction on cheap - by Anzhc
Introduction Equivariance regularized VAE, oe EQ-VAE for short, is a regularization approach, that can be utilized with likely most arches of VAE out there, but we here are mostly interested in OG AutoencoderKL, which is used in Stable D...
Tags
Content Snippet
Introduction Equivariance regularized VAE, oe EQ-VAE for short, is a regularization approach, that can be utilized with likely most arches of VAE out there, but we here are mostly interested in OG AutoencoderKL, which is used in Stable Diffusion 1, 2, XL, 3, 3.5 (Cool math tricks by StabilityAI) EQ approach augments latents directly, instead of images before encoding. This allows us to regularize latent space itself, which has significant effect on intermediate VAE output. While what VAE that...