Exploding KL Divergence Loss

yusukeurakami / dreamer-pytorch

pytorch-implementation of Dreamer (Model-based Image RL Algorithm)

MIT License

162 stars 34 forks source link

Exploding KL Divergence Loss #8

Open shivakanthsujit opened 3 years ago

shivakanthsujit commented 3 years ago

I tried running the agent on the Walker Walk environment and the KL Divergence loss seems to be growing exponentially and causing nans. But I have not made any changes to the codebase before running the agent. Do you know what might be causing this issue?