A variational inference method with accurate uncertainty estimation. It uses a new semi-implicit variational family built on neural networks and hierarchical distribution (ICML 2018).
Hello, I have two doubts reading your code. 1. what is the variable WU in the VAE code? I noticed that it is assigned by warmup and will increase from 0 to 1 as the epoch increases. Means that the weight of the likelihood gradually decreases with training? Is there any consideration behind this?
https://github.com/mingzhang-yin/SIVI/blob/c457d09dddcfed94602c48e75ba6f2a3d159b3dc/SIVAE.py#L126
2.One more question about this loss, I noticed that there is a batch count multiplier missing. Is that right？
Hello, I have two doubts reading your code. 1. what is the variable
WUin the VAE code? I noticed that it is assigned bywarmupand will increase from 0 to 1 as the epoch increases. Means that the weight of the likelihood gradually decreases with training? Is there any consideration behind this? https://github.com/mingzhang-yin/SIVI/blob/c457d09dddcfed94602c48e75ba6f2a3d159b3dc/SIVAE.py#L1262.One more question about this loss, I noticed that there is a batch count multiplier missing. Is that right？
Thanks!