openml / automlbenchmark

OpenML AutoML Benchmarking Framework
https://openml.github.io/automlbenchmark
MIT License
391 stars 130 forks source link

Reduce training time by 10% if a high_quality preset is used #546

Closed PGijsbers closed 1 year ago

PGijsbers commented 1 year ago

High quality presets perform a post-fit step which takes 10~15% of total time. To autogluon still only uses roughly max_runtime for its entire fitting procedure, we reduce the max_runtime communicated to autogluon by 10% which means in most cases autogluon should produce a model within the given time constraint. This is to ensure comparisons across frameworks remain fair and interpretable.