Averaging learning curves over repetitions + plotting confidence intervals [Tune]

[tmoer]

Hi all,

For reinforcement learning experiments, I often run independent repetitions for each hyperparameter setting. Ideally, I would visualize the average of these repetitions (per setting), including confidence intervals around the mean learning curve. I suppose many RL researchers have this issue.

I have always done this manually so far, but was curious whether I may have missed a feature in Tune or Tensorboard, or an integration with another framework, that would automatically display averaged learning curves over repetitions with confidence regions.

As an example, I would ideally get a curve like below, but then in Tensorboard

Thanks a lot!

Best regards, Thomas

[stale[bot]]

Hi, I'm a bot from the Ray team :)

To help human contributors to focus on more relevant issues, I will automatically add the stale label to issues that have had no activity for more than 4 months.

If there is no further activity in the 14 days, the issue will be closed!

• If you'd like to keep the issue open, just leave any comment, and the stale label will be removed!
• If you'd like to get more attention to the issue, please tag one of Ray's contributors.

You can always ask for help on our discussion forum or Ray's public slack channel.