search

google-research / batch_rl

Offline Reinforcement Learning (aka Batch Reinforcement Learning) on Atari 2600 games
https://offline-rl.github.io/
Apache License 2.0
520 stars 73 forks source link

WARNING:absl:Unable to find episode_end_indices. This is expected for old checkpoints. #29

Closed MinkyungPark closed 2 years ago

MinkyungPark commented 2 years ago

$ gsutil -m cp -R gs://atari-replay-datasets/dqn/Breakout . I downloaded the atari-replay-datsets with this command, but I don't see episode_end_indices data.

WARNING:absl:Unable to find episode_end_indices. This is expected for old checkpoints.

and I executed the dopamine code and received the following warning. How can I get episode_end_indices data?

I'd really appreciate your help.

agarwl commented 2 years ago

Yes, it is expected as this dataset was collected when there was no logic for episode_end_indices in Dopamine replay buffer.