bcgov / cas-ggircs

Climate Action Secretariat's Greenhouse Gas Industrial Reporting and Control System
Apache License 2.0
3 stars 4 forks source link

Bug: eccc import DAG fails if the 2019 folder is not present on the remote server #539

Closed pbastia closed 4 months ago

pbastia commented 5 months ago

Bug description

The URL on the remote server includes past folders and initiates the crawling from there. If the folders have been pruned, the DAG fails to retrieve any data.

Fix:

Update the URL to the latest folder, or investigate if starting from the root is an option. The change needs to be done in the values file, then make provision needs to be run over the ggircs namespaces