search

cagov / data-infrastructure

CalData infrastructure
https://cagov.github.io/data-infrastructure
MIT License
7 stars 0 forks source link

Investigate failing building footprints loader DAG #403

Closed ian-r-rose closed 1 month ago

ian-r-rose commented 1 month ago

Following up on #391 , the building footprints DAG is still failing. Let's figure out why and fix it.

ram-kishore-odi commented 1 month ago

The job is failing due to the dependencies between fiona and geopandas python modules being used by the loaded DAG One option to fix is to pin the dependencies - fiona and geopandas

ram-kishore-odi commented 1 month ago

The job ran as expected this time and did not encounter any loading failures. Please see addition details below

Batch Job https://us-west-2.console.aws.amazon.com/batch/home?region=us-west-2#jobs/fargate/detail/2bc123b3-f98a-496e-b1b5-5b1c2fb9d45f

Log https://us-west-2.console.aws.amazon.com/cloudwatch/home?region=us-west-2#logsV2:log-groups/log-group/%2Faws%2Fbatch%2Fjob/log-events/dse-infra-dev-us-west-2-test%2Fdefault%2Fe1b9753b5adc45128d2451f816b2b535

Changes have been already been merged into main by Ian.