Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning
MIT License
1.59k stars 284 forks source link

Detach or not on Quantile loss? #22

Closed hohoCode closed 6 years ago

hohoCode commented 6 years ago

https://github.com/Kaixhin/Rainbow/blob/cf4c3153777c4fddd15dfa09dcf04878fce5640a/agent.py#L91

I figured this out. Thanks. This is great.