openml / automlbenchmark

OpenML AutoML Benchmarking Framework
https://openml.github.io/automlbenchmark
MIT License
391 stars 130 forks source link

Remove ground truth from test data passed to frameworks #533

Open PGijsbers opened 1 year ago

PGijsbers commented 1 year ago

Some frameworks rely on data files being passed for inference. These files should not contain information of the ground truth as a precaution against it being (accidentally) used by automl frameworks.

Proposed by @Innixma here.