flux-framework / flux-coral2

Plugins and services for Flux on CORAL2 systems
GNU Lesser General Public License v3.0
9 stars 7 forks source link

Dws: use static rabbit layout mapping for JGF #204

Closed jameshcorbett closed 4 weeks ago

jameshcorbett commented 1 month ago

Problem: as described in https://github.com/flux-framework/flux-coral2/issues/193, JGF is too unwieldy to be stored in Ansible. On the other hand, Flux's ability to start up and run jobs cannot be dependent on the responsiveness of kubernetes, so generating JGF from kubernetes before starting Flux is not a good option.

The solution I've decided to go with after some discussion is to store some static rabbit layout data in ansible, generated by reading from kubernetes. This data in turn is then read in to generate JGF. Unlike kubernetes, we can expect the static file to always exist.

Fixes #193