Closed jimzers closed 3 years ago
Ignore... Turns out this change only applies to OpenAI Gym's EnvSpec
. Looked into .unwrapped.spec.max_episode_steps
but could not figure things out.
Upon further inspection it seems that there is problem with the sampler... Will open an issue. Sorry!
Changed
env.spec.max_episode_length
toenv.spec.max_episode_steps
. This deals with changes to OpenAI Gym's EnvSpec forgym
version0.17.2
.