Currently, in order to run the package benchmarks or compare to openml, lines inside run_tests.py need to be commented and uncommented. This has also caused the readme to have to include the lines of code to be commented and uncommented. Adding basic CLI args to run_tests.py would make running the benchmarks and comparison easier, and would decouple all that code from needing to be put in the readme.
There are multiple ways to skin this cat. Another way would be to have a dedicated file for each section of run_tests.py
Currently, in order to run the package benchmarks or compare to
openml, lines insiderun_tests.pyneed to be commented and uncommented. This has also caused the readme to have to include the lines of code to be commented and uncommented. Adding basic CLI args torun_tests.pywould make running the benchmarks and comparison easier, and would decouple all that code from needing to be put in the readme.There are multiple ways to skin this cat. Another way would be to have a dedicated file for each section of
run_tests.py