cybergis / cybergis-compute-core

Apache License 2.0
7 stars 6 forks source link

Supporting Additional Partitions #114

Open alexandermichels opened 3 months ago

alexandermichels commented 3 months ago

The current solution for our HPCs often specifies the partition in init_sbatch_options in the HPC.json (see: https://github.com/cybergis/cybergis-compute-core/blob/v2/configs/hpc.example.json#L73). However, this means we need to create a new "HPC" in the config for each partition.

There are many potential solutions to this issue, but maybe the best one would be adding a list of "HPC options" which the SDK presents as a dropdown (similar to manifest SLURM options).