tanelp / tiny-diffusion

A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.
646 stars 54 forks source link

About reconstructing from noise? #5

Open Sreerag-ibtl opened 1 year ago

Sreerag-ibtl commented 1 year ago

Hi @tanelp. Wondering if there's any material I can refer to for understanding how the reconstruction from noise works. TIA

Ivan-wang commented 1 year ago

Hi @Sreerag-ibtl , I'm also learning this amazing code. Not sure if you got answers. But basically, I found this code strictly follows the equations here https://arxiv.org/abs/2208.11970 Specifically, reconstruct_x0 -> Eq. (69) on page 11 q_posterior and get_variance -> Eq. (84) on page 12

Other methods should be straightforward.

Really appreciate @tanelp 's work cause this code is so clean and easy to understand.