heidmic / suprb-experimentation

GNU General Public License v3.0
2 stars 1 forks source link

Add the evaluation from RBSML #2

Open Saethox opened 2 years ago

Saethox commented 2 years ago

As evaluation has proven to be very problem specific anyway, it will probably never be added. Some helper functions can be found on the individual_optimizers branch, which were used for the solution composition paper, but they are also only really helpful for this exact task.

heidmic commented 2 years ago

Can/did you push all scripts used in the generation of figures and tables for the paper into the branch? Also, automatically processing the mlflow data? Otherwise, I agree.

Saethox commented 2 years ago

The helper functions I linked convert the mlflow data into pandas.Dataframes, which are then filtered/aggregated and plotted with seaborn, or, depending on the goal, converted to a LaTeX table using pandas.Dataframe.style.to_latex().