search

edanalytics / edu_edfi_airflow

Manages extract-load of Ed-Fi data in Airflow
Other
4 stars 0 forks source link

Add dependency between raw_to_s3 and filepath removal. #60

Closed jayckaiser closed 1 month ago

jayckaiser commented 1 month ago

Adds a manual dependency between raw_to_s3 and remove_files_operator to prevent race condition between files being uploaded and deleted.