VAEGAN training failing

[vishwakftw]

The VAEGAN training fails after about 30 iterations.

[vishwakftw]

The training is stabilized. The L^th layer loss is decreasing, but very slowly. The images are incomprehensible.

[vishwakftw]

I think the issue has been fixed. The problem was with the loss function specified in the paper. L_{gan} is supposed to be of the opposite sign since we are minimizing it for the discriminator, as specified in the algorithm. The code was written verbatim from the text, hence the problem.

[vishwakftw]

However, after proposing the above fix, the image that are learned are incomprehensible. Below is the graph of the variation of all losses with the iterations.

Optimizer used is Adam with learning rate: 0.0005 and (beta₁, beta₂) = (0.5, 0.9)

Any help would be appreciated.