Information provided in SLURM environment variables

cedadev / wflogger

Workflow logging utilities (for JASMIN and LOTUS)

BSD 2-Clause "Simplified" License

0 stars 0 forks source link

Information provided in SLURM environment variables #9

Open agstephens opened 2 years ago

agstephens commented 2 years ago

job_id: SLURM_JOB_ID
task_id: SLURM_ARRAY_TASK_ID
process_id: SLURM_TASK_PID
hostlist: SLURM_NODELIST=host182
job_name (if given): SLURM_JOB_NAME=ag-tmp-array
hostname: HOSTNAME
partition: SLURM_JOB_PARTITION=short-serial
SLURM_MEM_PER_CPU=4000
SLURM_NNODES=1
total number of tasks in job array: SLURM_ARRAY_TASK_COUNT=10

agstephens commented 2 years ago

@barrylatter: Which of the following do you suggest we add to the DB:

[ ] job_id: SLURM_JOB_ID
[ ] task_id: SLURM_ARRAY_TASK_ID
[ ] process_id: SLURM_TASK_PID
[ ] hostlist: SLURM_NODELIST=host182
[ ] job_name (if given): SLURM_JOB_NAME=ag-tmp-array
[ ] hostname: HOSTNAME
[ ] partition: SLURM_JOB_PARTITION=short-serial
[ ] SLURM_MEM_PER_CPU=4000
[ ] SLURM_NNODES=1
[ ] total number of tasks in job array: SLURM_ARRAY_TASK_COUNT=10

And are there any others?

barrylatter commented 2 years ago

BL comments moved to: #13

agstephens commented 2 years ago

[ ] job_id: SLURM_JOB_ID - new field (optional)
[ ] task_id: SLURM_ARRAY_TASK_ID - rename existing field: iteration --> task_id
[ ] process_id: SLURM_TASK_PID - new field (optional)
[ ] hostlist: SLURM_NODELIST=host182 - new field (optional)
[ ] job_name (if given): SLURM_JOB_NAME=ag-tmp-array - new field (optional)
[x] hostname: HOSTNAME - already exists
[ ] partition: SLURM_JOB_PARTITION=short-serial - new field (optional)
[ ] mem_per_cpu: SLURM_MEM_PER_CPU=4000 - new field (optional)
[ ] n_nodes: SLURM_NNODES=1 - new field (default: 1)
[ ] n_tasks_in_job_array: SLURM_ARRAY_TASK_COUNT=10 - new field (default: -1 - i.e. no job array used)

agstephens commented 2 years ago

In the code:

create a env_mappings dictionary that includes the default value if required.
- "n_nodes": ("SLURM_NNODES", 1)
- "n_tasks_in_Job_array": ("SLURM_ARRAY_TASK_COUNT", -1)
- If default is None then don't send the value
write a function called: get_from_value_or_env(key, value)