Emergence of diffusion models from associative memory through memorization and generalization
Viewing Diffusion Models through the lens of Dense Associative Memory theory reveals that spurious states, traditionally viewed as memory errors, are in fact a critical intermediate phase of generalization. Here, authors demonstrate their existence across a wide range of architectures and datasets.