NOAA-EMC / global-workflow

Global Superstructure/Workflow supporting the Global Forecast System (GFS)
https://global-workflow.readthedocs.io/en/latest
GNU Lesser General Public License v3.0
74 stars 167 forks source link

Update archive to handle ensembles #832

Closed WalterKolczynski-NOAA closed 2 months ago

WalterKolczynski-NOAA commented 2 years ago

Description As we move towards the merger of GEFS into the GFS system, global workflow needs to be updated to archive the additional output created when running a forecast ensemble.

Requirements Need to expand the archive job to handle forecast ensemble outputs. Due to the multiplicity of the data, this may require a reevaluation of what gets archived, at least for ensemble members.

Acceptance Criteria (Definition of Done) Given all of the workflow products, properly archive the key ensemble files to HPSS.

Dependencies Add atm ensemble product generation (#823)

aerorahul commented 6 months ago

@EricSinsky-NOAA FYI

WalterKolczynski-NOAA commented 2 months ago

Duplicate of #2698