Temporarily extend the number of days to look back when archiving data

bcgov / nr-rfc-processing

River forecast centre data processing solution

Apache License 2.0

4 stars 2 forks source link

Temporarily extend the number of days to look back when archiving data #106

Closed franTarkenton closed 2 months ago

franTarkenton commented 2 months ago

Due to the job getting disabled from repo inactivity, there is a 3 month backlog of data that needs to be processed. As this data is being worked through it looks like some of the jobs do all the processing, but the data isn't actually archived to S3. This is because the script that copies the data to S3 by default only looks back 20 days. This fix will see the option being added to the github action to look back 3 months.

Once the backlog is sorted out can disable this option.

franTarkenton commented 2 months ago

see branch: fix/archive_days_change for work

franTarkenton commented 2 months ago

Completed.... archive now looks for data up to 120 days from present