bcgov / nr-rfc-grib-copy

Demo of using github actions to copy / process raw data
Apache License 2.0
2 stars 2 forks source link

Create CMC data Pipeline #12

Open franTarkenton opened 1 year ago

franTarkenton commented 1 year ago

Currently there are a number of bat scripts on drain/sewer server that are scheduled thought windows server. These scripts get the inputs that are then run through the CMC forecast Excel data prep macros to create input data to be used by the CLEVER model.

This epic describes the tasks related to creating a data pipeline for all steps related to preparing the CMC forecast data for input into the Clever model.

The end result will be event triggered by creating a process that listens to the federal governments Advanced Message Queue. When data becomes available the pipeline will be triggered creating the input data for the Clever model.

Dependencies

Epic