How do ppo2 reset environment

[dongfangliu]

I check through the ppo2 script for a whole day, add i did not see any code that resets the environment when the step() function return dones=True

That's really strange

[Miffyli]

This is done by vectorized environments. Any default environments will be wrapped into a vectorized environment of one, which then automatically resets episodes when they hit done=True.