search

openai / coinrun

Code for the paper "Quantifying Transfer in Reinforcement Learning"
https://blog.openai.com/quantifying-generalization-in-reinforcement-learning/
MIT License
388 stars 87 forks source link

How to reset the environment? #37

Closed SuiJiGuoChengSuiJiGuo closed 4 years ago

SuiJiGuoChengSuiJiGuo commented 5 years ago

Hi Team, I am trying to read the code of this project, but when I read the ppo2.py, I have a little doubt about class Runner. I can't distinguish when will environments reset in the function run(). And if one of the environments in parallel will done, what about others will be? thanks

christopherhesse commented 4 years ago

In the VecEnv interface, each instance of the environment resets itself on done, so there should be no need for Runner to call venv.reset()