emited / VariationalRecurrentNeuralNetwork

Pytorch implementation of the Variational Recurrent Neural Network (VRNN).
282 stars 70 forks source link

clipping before optimizing step. #5

Open srinadhu opened 5 years ago

srinadhu commented 5 years ago

@emited Please check and let me know.

  1. Added clipping before the optimizer step.
  2. Updated with .item() rather than .data[0]
  3. Input is normalized but the reconstruction is done for the unnormalized image so this is removed
  4. Loss get's NAN sometimes and so added 1e-5 as epsilon in the std2 denominator