NOAA-GSL / ExascaleWorkflowSandbox

Other
2 stars 2 forks source link

Move configuration into platform YAML files #40

Closed christopherwharrop-noaa closed 9 months ago

christopherwharrop-noaa commented 9 months ago

This PR is the first step toward generalizing configuration of Chiltepin workflows. This adds the capability to provide platform-specific information via a YAML file. The YAML file is then processed by a configuration factory which returns both a Parsl Config object and a sequence of required platform-specific environment initialization. This Parsl Config is then loaded and the environment initialization is passed to the individual apps as needed. Running on a different platform only requires creation of a new YAML file with appropriate settings and no internal code should be necessary.

This is still very rudimentary and could use improvement, but is limited in scope to minimize the change set being evaluated for this udpate.