How to calculate the std mentioned in the article?

nicklashansen / dmcontrol-generalization-benchmark

DMControl Generalization Benchmark

MIT License

167 stars 40 forks source link

How to calculate the std mentioned in the article? #4

Closed gemcollector closed 2 years ago

gemcollector commented 3 years ago

Hello～ How to calculate the std.deviation in the paper? Should I record all the episode rewards in every episode from different seeds and calculate their std. deviation？Or just record the mean of 100 episodes in different seeds，and calculate the std. deviation among these mean values?

nicklashansen commented 3 years ago

Hi, we compute the standard deviation over the mean episode returns of each seed. For figures this is done continuously over the course of training, for tables we compute it for the final policy.