jharwell / sierra

Automation framework for the scientific method in AI research
MIT License
18 stars 1 forks source link

feature/137-categorical-comparisons #137

Closed jharwell closed 5 years ago

jharwell commented 5 years ago

I'm starting to have batch criteria that do not have numeric variable values across their range, which is problematic for graphing performance. I need to have a clean way of determining numeric vs. categorical in the batch criteria:

Possible methods:

Graphs would then need to be enabled in BOTH the config file (which specifies what graphs should be enabled for a given controller) and a new map mapping batch criteria to their numeric vs. categorical type.

As a result of this, bar graphs need to be brought back. Also, if the categorical criteria happens to have 3 values, then triplots for the performance values across swarm sizes could be included (most of the categorical batch criteria have a ".Z{X}" component to specify the swarm size).