Clear replay buffer size

AGI-Labs / continual_rl

Continual reinforcement learning baselines: experiment specifications, implementation of existing methods, and common metrics. Easily extensible to new methods.

MIT License

105 stars 11 forks source link

Clear replay buffer size #4

Closed skezle closed 2 years ago

skezle commented 2 years ago

I just wanted to check that the replay buffer size for Clear (denoted "replay_buffer_frames" in the config files) is based on the number of transitions and not the number of unrolled trajectories?

Thanks in advance!

SamNPowers commented 2 years ago

Sorry for missing this! Yes, it is the number of transitions. It gets divided by the unroll length to determine how many unrolled trajectories to store.