bcgov / cas-ggircs

Climate Action Secretariat's Greenhouse Gas Industrial Reporting and Control System
Apache License 2.0
3 stars 4 forks source link

Fix ECCC download failure from April 13 #503

Closed dleard closed 1 year ago

dleard commented 1 year ago

The cas-ggircs-eccc dag that downloads the emission reports from swrs failed on April 13th because of a bad file upload. We'll need to remove the invalid 1.4kb partial file from our GCS bucket and the corresponding data in our ECCC tables in swrs_extract and then manually run the dag again to ensure we've properly downloaded the new swrs dump.

Results of exploration:

Todo:

pbastia commented 1 year ago

I can see the retries in the upload task. Thanks @dleard