instadeepai / marl-eval

A tool for aggregating and plotting MARL experiment data.
https://sites.google.com/view/marl-standard-protocol/home
Apache License 2.0
60 stars 6 forks source link

No comma in algo names allowed. #31

Closed RuanJohn closed 1 year ago

RuanJohn commented 1 year ago

What?

The way that algorithm pair names are joined for the probability_of_improvement plots will lead to errors if algorithm names contain commas. This PR checks whether any algorithm names in the dataset contain any commas and will raise an error if this is the case.

Why?

The enable the downstream use of all plotting tools.

How?

Added a check for algorithms.

Extra

Wrote a very simple unit test for the new feature. Updated current DiagnoseData tests as well.