openai / universe-starter-agent

A starter agent that can solve a number of universe environments.
MIT License
1.1k stars 318 forks source link

flashgames.NeonRace-v0 gets in weird state at times #121

Closed EMCP closed 6 years ago

EMCP commented 6 years ago

flashgames.NeonRace-v0 seemed to have one agent die (window disappeared when I wasn't watching) , and the other window looks to be stuck in a strange state

anyone else seen this?

Is there a way to reload progress from my training if I restart?

screenshot from 2017-09-09 10-11-33

dtcarls commented 6 years ago

Not sure if you found an answer yet, but yes I have also run into this game state. To fix, you can kill your sessions "tmux kill-session" and run the train.py command again. If you use the same log directory the progress is continued; however, if you had 2 workers, 1 died and 1 was in this state it may have "learned" some bad behavior. Best to start from scratch.