search

edanalytics / edu_edfi_airflow

Manages extract-load of Ed-Fi data in Airflow
Other
4 stars 0 forks source link

Fix/reset tmp storage after s3 error #4

Closed jayckaiser closed 1 year ago

jayckaiser commented 1 year ago

This branch adds a try-finally block around the S3 import in EdFiToS3Operator. If an S3 permissions error is encountered, the local Ed-Fi data is still deleted before an error is raised.