Add gradient clipping - Githubissues

Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning

MIT License

1.56k stars 282 forks source link

Add gradient clipping #73

Closed Kaixhin closed 4 years ago

neevparikh commented 4 years ago

In a previous github issue #26, you'd removed gradient clipping due to poor performance. Have you figured out what the was real issue / are you observing better performance now? I'm wondering why you decided to add it back.

Kaixhin commented 4 years ago

Confirmed with Matteo Hessel that gradient clipping is used in Rainbow.