search

nazaruka / gym-http-api

NSGA2-based Sonic agent + experimental code
MIT License
1 stars 1 forks source link

End Bad Evals Early #33

Closed schrum2 closed 5 years ago

schrum2 commented 5 years ago

We should have an option to terminate an evaluation that is clearly going nowhere. Specifically, the evaluate function inside of evaluation.py should be set up so that if Sonic is making insufficient progress, we end the evaluation and break out of the loop. In particular, if the x coordinate stays the same for some number of time steps (not sure what ... will need to experiment or make a command line parameter).

Note that we don't want to require the coordinate to increase, since some levels require backtracking. This means that some pointless agents will still waste our time, for example by going back and forth. However, at least ones that stay still or push fruitlessly against a wall will not waste our time.

schrum2 commented 5 years ago

Completed from previous associated commit. See message for details.