Closed Raelifin closed 6 years ago
Yes, this is a bit more complex, but the complexity is encapsulated well. Also, even though rollout collection isn't the time bottleneck for running Teacher, it is a significant component when doing rapid dev work.
Tested on Mujoco - LGTM
Yes, this is a bit more complex, but the complexity is encapsulated well. Also, even though rollout collection isn't the time bottleneck for running Teacher, it is a significant component when doing rapid dev work.