Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning
MIT License
1.56k stars 282 forks source link

performance improvement on GPU #75

Closed benblack769 closed 4 years ago

benblack769 commented 4 years ago

I noticed that CPU utilization was rather high even when it should be running on the GPU, so I made this change and I improved performance from 340 it/s to 520 it/s.

I'm not sure if this is the optimal way to get the device, but it seems to work pretty well.

Kaixhin commented 4 years ago

I think that's a perfectly fine way to do it, thanks!