search

instadeepai / marl-eval

A tool for aggregating and plotting MARL experiment data.
https://sites.google.com/view/marl-standard-protocol/home
Apache License 2.0
61 stars 6 forks source link

Wrong labels in sample efficiency curves #34

Closed matteobettini closed 11 months ago

matteobettini commented 1 year ago

In the sample efficiency curves like this one from the notebook the x-axis labels will say "milions" even though the data scale is reported in units (as you can see by the 1e6 in the bottom left

Screenshot 2023-09-22 at 15 25 26

this means that for runs with less frames you will get results like

Screenshot 2023-09-22 at 15 28 10

where this run was only over 12_000 frames and not 12_000 million frames

RuanJohn commented 11 months ago

Hi @matteobettini, thank you for the raising the issue! Apologies for the slow reply. For some reason I didn't get notified. I will make a fix for this.