search

Kaixhin / Autoencoders

Torch implementations of various types of autoencoders
MIT License
467 stars 77 forks source link

Understanding KLLoss? #3

Closed Prasanna1991 closed 7 years ago

Prasanna1991 commented 7 years ago

Hello,

Can you explain the way you calculated KLLoss in VAE? Isn't this a KL Divergence?

Thanks.

Kaixhin commented 7 years ago

Yes this is just the KL divergence, and Wikipedia shows the general form for multivariate Gaussians, which can be simplified for the prior of N(0, 1). Unfortunately I'm not sure I'm able to give much more of an explanation, but perhaps the Tutorial on Variational Autoencoders will be helpful.

Kaixhin commented 7 years ago

Closing (due to a month of inactivity).