search

yusukeurakami / dreamer-pytorch

pytorch-implementation of Dreamer (Model-based Image RL Algorithm)
MIT License
162 stars 34 forks source link

Curl Statistics #3

Closed michaelzhiluo closed 4 years ago

michaelzhiluo commented 4 years ago

I was wondering how the CURL runs were tracked in order to generate the plots in Readme.md.

Looking closer into the original pytorch CURL codebase, they log episode reward and step, where step is the number of calls to env.step(). However, the logger does not report the actual # of timesteps taken which is step * action_repeat, which is 2 or 4 as stated in the CURL paper.

Do the plots reflect this discrepancy?

yusukeurakami commented 4 years ago

Thank you for you comment. In order to match the condition, I have tweaked their code to change the definition of step number. For this statistics, step number is what you explained as "step*action_repeat".