Closed findmyway closed 2 years ago
For sync controllers, the iterate implementation dropped the state. But in some cases, we need to track the state. A typical case is in VPG or PPO, where we want to iterate through mini-batches without replacement.
iterate
state
VPG
PPO
For sync controllers, the
iterateimplementation dropped thestate. But in some cases, we need to track the state. A typical case is inVPGorPPO, where we want to iterate through mini-batches without replacement.