leggedrobotics / rsl_rl

Fast and simple implementation of RL algorithms, designed to run fully on GPU.
Other
505 stars 156 forks source link

mini_batch_generator, same indice in different epoch #26

Open swstbecrpgmail opened 4 months ago

swstbecrpgmail commented 4 months ago

The index generation operation for dataset is placed outside the loop, resulting that the data slices for each epoch remains the same. Is this a problem, or is this a less-than-ideal implementation?

The code is in /rsl_rl/storage/rollout_storage.py image