search

openml / automlbenchmark

OpenML AutoML Benchmarking Framework
https://openml.github.io/automlbenchmark
MIT License
399 stars 132 forks source link

Update AutoGluon `max_memory` from 0.1 to 0.4 in persist_models #543

Closed Innixma closed 1 year ago

Innixma commented 1 year ago

Updated max_memory to 0.4 as when tested it resulted in no crashes. The 0.1 default is overly conservative. For batch_size=1 in inference, this gives ~2x faster inference speed on average as more frequently models are able to fit into memory using this raised limit.

Innixma commented 1 year ago

I've also opened a PR for AutoGluon to officially use 0.4 going forward as the default (although 0.8 still uses 0.1 as default)

https://github.com/autogluon/autogluon/pull/3338

PGijsbers commented 1 year ago

Merging this now, but please revert the change (or make it conditional), when a new release with the changed default is available. Thanks!