heidmic / suprb-experimentation

GNU General Public License v3.0
2 stars 1 forks source link

Should the default scoring metric for ParameterTuning be R2? #21

Open heidmic opened 2 years ago

heidmic commented 2 years ago

At a cursory glance, I would say that this would mean measuring R2 out of sample, which is obviously illegal. If this is the case, we want to replace it with the mse

RomanSraj commented 2 weeks ago

Change to fitness in experiments/parameter_search/optuna.py l.21