denisyarats / drq

DrQ: Data regularized Q
https://sites.google.com/view/data-regularized-q
MIT License
400 stars 52 forks source link

About Replay Buffer Sample function #28

Open ergo-zyh opened 1 month ago

ergo-zyh commented 1 month ago

In your code, why the data sampled from the replay buffer obs and obs_aug is the same? What's the purpose? I can't understand. Waiting for your answer~

ergo-zyh commented 1 month ago

ergo https://github.com/denisyarats/drq/blob/dd040f144ed8f696c7db35087cd80c87372edb64/replay_buffer.py#L51