slds-lmu / yahpo_gym

Surrogate benchmarks for HPO problems
26 stars 2 forks source link

rbv2 f1 #55

Open sumny opened 1 year ago

sumny commented 1 year ago

for rbv2_*: Assert that task is not multiclass (via task_id) if target metric is set to f1 because this was mostly NA/imputed as 0 in the raw data and is not meaningful to benchmark on.