search

cybergis / cybergis-compute-core

Apache License 2.0
7 stars 6 forks source link

Supporting Additional Allocations #115

Open alexandermichels opened 3 months ago

alexandermichels commented 3 months ago

Currently all jobs are run under our allocation which is often specified in the HPC configurations (https://github.com/cybergis/cybergis-compute-core/blob/v2/configs/hpc.example.json#L75) . However, we would like to add support for end-users to run their own jobs using their own allocations.

A few ideas for implementations:

  1. A textbox to specify the allocation (basically a SLURM option in the manifest that makes a textbox in the SDK), but we need to make sure this overrides any option in the configuration and we need to figure out the logistics of how that would work (e.g. do they need to add our community account to their allocation, is there anything else that needs to be done?).
  2. An allowlist that associates HPC/allocation pairs to users so that only certain users can use certain allocations.
  3. We should be able to ignore the defaultSlurmCeiling if using an external allocation: https://github.com/cybergis/cybergis-compute-core/blob/3247c1c80d082086f712c7a02e74035abb195080/src/lib/JobUtil.ts#L210