simonsobs-uk / data-centre

This tracks the issues in the baseline design of the SO:UK Data Centre at Blackett
https://souk-data-centre.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2 stars 1 forks source link

cbatch_openmpi does not handle MPI abortion correctly #44

Open ickc opened 7 months ago

ickc commented 7 months ago

The provided wrapper script to launch multi-node OpenMPI job in /opt/simonsobservatory/cbatch_openmpi does not handle MPI abortion correctly.

Symptom: Job hangs after MPI abortion, leaving node idle in the queue

TODO: