search

Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning
MIT License
1.56k stars 282 forks source link

memory file stuck in the while loop #41

Closed imansaj closed 5 years ago

imansaj commented 5 years ago

Hello. In the memory file (line 101), the code stuck in the while loop for low learn_start parameter(like 200).

Kaixhin commented 5 years ago

This is an issue with prioritised experience replay. Either you have to increase the amount of timesteps before learning starts, or reduce the priority exponent ω (setting this to 0 is equivalent to sampling uniformly).