Closed vlad17 closed 6 years ago
Copied openai's (pretty nasty) code for vectorized environments (multiple environments at once). To be honest this is only a bit faster at the outset since the rollouts are so short, so the communication overhead is relatively higher.
Copied openai's (pretty nasty) code for vectorized environments (multiple environments at once). To be honest this is only a bit faster at the outset since the rollouts are so short, so the communication overhead is relatively higher.