NVlabs / NVAE

The Official PyTorch Implementation of "NVAE: A Deep Hierarchical Variational Autoencoder" (NeurIPS 2020 spotlight paper)
https://arxiv.org/abs/2007.03898
Other
999 stars 163 forks source link

why is there self.prior_ftr0 in the decoder model? #35

Open Sadegh-Saberian opened 2 years ago

Sadegh-Saberian commented 2 years ago

Hello, great work! I am trying to understand NVAE, but I could not figure out the role of self.prior_ftr0 or h block in Fig2 in the decoder model. Correct me if im wrong, but i could not find any details regarding h in the paper; and the code defines it to be a random vector generated in the initialization of the model and then being used in the forward pass to kickstart the decoder model. my question is why did you chose this design rather than starting with just z1? Is there some part that Im missing here?

thank you so much for the great paper and repo.