epam / cloud-pipeline

Cloud agnostic genomics analysis, scientific computation and storage platform
https://cloud-pipeline.com
Apache License 2.0
145 stars 59 forks source link

Introduce support for slurm jobs with bad constraints #3403

Closed tcibinan closed 10 months ago

tcibinan commented 10 months ago

Relates #3330.

The pull request brings support for slurm jobs with bad constraints (jobs which require more resources than the current cluster configuration can provide) which allows such jobs to be executed once the cluster configuration changes e.g. as result of cluster autoscaling.

Additionally, the pull request improves slurm jobs parsing in grid engine autoscaler which allows to manage required resources more precisely.