mle-infrastructure / mle-toolbox

Lightweight Tool to Manage Distributed ML Experiments 🛠
https://mle-infrastructure.github.io/mle_toolbox/toolbox/
MIT License
3 stars 1 forks source link

Multi-Config Bash Experiments #51

Closed RobertTLange closed 3 years ago

RobertTLange commented 3 years ago

Addresses issue #47 and adds functionalities to run multi-config + seed experiments with bash startup file. The user needs to take care of the input arguments (-exp_dir, -config_fname, -seed_id) themselves and within the bash script. Furthermore, you cannot rely on the MLExperiment, MLE_Logger utilities.

We also provide a minimal example of how to do so in examples/bash_configs, which simply creates a bunch of different text files with individual id file name of the config + seed combination.