pace-neutrons / Horace

Horace is a suite of programs for the visualization and analysis of large datasets from time-of-flight neutron inelastic scattering spectrometers.
https://pace-neutrons.github.io/Horace/stable/
GNU General Public License v3.0
8 stars 5 forks source link

Separate Cluster start-up and shutdown from Job submission #468

Open nickbattam-tessella opened 3 years ago

nickbattam-tessella commented 3 years ago

The MPI framework job submission process includes calls to 'start up' and 'shutdown' the target cluster.

The start-up and shutdown calls must be moved out of the individual job submission code to remove the significant time overhead this introduces if multiple jobs are submitted, and enable the framework to work with a persistent cluster.

Outcome:

abuts commented 3 years ago

3 is currently implemented. Job starts only if cluster reported ready (as part of cluster start_up process)