search

Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning
MIT License
1.59k stars 284 forks source link

Stuck in memory._retrieve when batch size > 32 #82

Open jiwoongim opened 3 years ago

jiwoongim commented 3 years ago

Hi,

I notice that RAINBOW doesn't work when the batch size is greater than 32 (I tried for 64, 128, 256), where it is stuck in memory._retrieve the recursive call. Why does this happen? Is there something that I can do about this (to increase the batch size) or batch size needs to be small?

Thanks

Kaixhin commented 3 years ago

This is probably an issue with PER sampling. Try the fix in https://github.com/Kaixhin/Rainbow/issues/41 and see if that helps.