muupan / async-rl

Replicating "Asynchronous Methods for Deep Reinforcement Learning" (http://arxiv.org/abs/1602.01783)
MIT License
401 stars 83 forks source link

Crashes of Spawned Proceeses #23

Open ehrenbrav opened 8 years ago

ehrenbrav commented 8 years ago

Hi there -

I forked your code to work on Super Mario Bros :)

I'm using a Nintendo emulator that I modified to allow for programmatic control by the agent (similar to the Arcade Learning Environment).

I've been having problems with the spawned FCEUX processes silently crashing. I'm wondering if there might be a race condition as they update the shared model... Did you run into similar issues with the ALE?

Thanks for providing your code!