We need an alternative to baselines's SubprocVecEnv. We don't need the entirety of baselines as a dependency, and the environments cannot be individually reset which is very important to our approach, as we want the batch size to remain the same size for convenience purposes and to avoid over fitting on longer episodes as smaller batches mean biased gradients.
We need an alternative to baselines's
SubprocVecEnv
. We don't need the entirety of baselines as a dependency, and the environments cannot be individually reset which is very important to our approach, as we want the batch size to remain the same size for convenience purposes and to avoid over fitting on longer episodes as smaller batches mean biased gradients.