[Question] Plotting Smoothed Evaluation Curve

[Zachary-Fernandes]

❓ Question

Hello, I have a question regarding plotting in rl-baselines3-zoo. For plotting the evaluation curves, is there an option to smooth them like one could when plotting the training curves through a rolling window? If not, could one use the same window_func() the training plotter uses or how else would one go about it? I am curious why smoothing is not available. Below is the training curve with a rolling window of 500 and the evaluation curve with no rolling window.

Checklist

• [X] I have checked that there is no similar issue in the repo
• [X] I have read the SB3 documentation
• [X] I have read the RL Zoo documentation
• [X] If code there is, it is minimal and working
• [X] If code there is, it is formatted using the markdown code blocks for both code and stack traces.

[araffin]

Hello,

s, is there an option to smooth them like one could when plotting the training curves through a rolling window?

There is no option currently, but normally for the evaluation you should have multiple runs and they will smooth out things (this is the all_plot.py script, example is in the doc).

If not, could one use the same window_func() the training plotter uses or how else would one go about it?

you can probably re-use it or see if seaborn has an option for that. (please share your code if you have something working ;))