edanalytics / edu_edfi_airflow

Manages extract-load of Ed-Fi data in Airflow
Other
4 stars 0 forks source link

Rc/0.3.0 get cv failed sentinel #41

Closed jayckaiser closed 6 months ago

jayckaiser commented 6 months ago

Add sentinel task in dynamic get_last_cv_operator runs to account for failed total-count endpoints. This should not be necessary, but we encountered a bug where a downstream "none_skipped" task skipped with "upstream_failed" status. More testing is needed, and hopefully this feature can be removed in a future hotfix.