ploomber / soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
https://soopervisor.readthedocs.io
Apache License 2.0
45 stars 18 forks source link

Customizing srun comand #47

Closed edublancas closed 9 months ago

edublancas commented 2 years ago

Hey @mat-ej,

In our last chat, you mentioned you'd like to run SLURM jobs in different instances, if I recall correctly, you can do this in your cluster by passing the -p argument to the srun command:

srun -p cpufast

You can customize this with soopervisor, check out this section in the docs: https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html#customizing-script-template

Let me know if this solves your problem.