Restructure the mle_config.toml in a more elegant way. E.g. add the gcloud_credentials_path to the different resource categories (right now this is stored under gcp which doesn't make sense). Add a local category for running local jobs. Make it easy to add a new type of remote resource (e.g. AWS, Azure, etc.). Potentially differentiate between 3 classes with standardized variables:
Local: For running jobs on different "small" workstations.
Cluster: For running jobs on different clusters with their respective scheduling systems (SGE/Slurm).
Cloud: For running jobs on cloud services (GCP, AWS, Azure).
Restructure the
mle_config.tomlin a more elegant way. E.g. add thegcloud_credentials_pathto the different resource categories (right now this is stored under gcp which doesn't make sense). Add alocalcategory for running local jobs. Make it easy to add a new type of remote resource (e.g. AWS, Azure, etc.). Potentially differentiate between 3 classes with standardized variables: