on reset take N steps before returning, where N is the number of frames stack together

NotAnyMike / gym

An improvement of CarRacing-v0 from OpenAI Gym in order to make the environment complex enough for Hierarchical Reinforcement Learning

https://notanymike.github.io/

Other

70 stars 24 forks source link

Closed NotAnyMike closed 5 years ago

NotAnyMike commented 5 years ago

Looks like the problem comes from the original environment. Things to do:

[x] Check if the default environment suffers the same
[x] If it does, then count the number of steps to takes to get an image and then count from there
[x] If it does not, then keep exploring what is different between both environments

NotAnyMike commented 5 years ago

The solution was to allow

win.switch_to()
win.dispatch_events()