edanalytics / edu_edfi_airflow

Manages extract-load of Ed-Fi data in Airflow
Other
4 stars 0 forks source link

make optional the get cv with deltas #61

Closed rlittle08 closed 3 weeks ago

rlittle08 commented 1 month ago

Through our work with Boston (who uses their own implementation of Ed-Fi ODS/API v5.3, not the CQE version implemented by startingblocks), we found that some of the recent updates to force use of Total-Count on deletes may be incompatible with base v5.3 code.

This branch adds var get_deletes_cv_with_deltas to the EdFiResourceDAG, which is by default True, but allows implementations to override with False, to implement the non-deltas version of get_change_versions for deletes. This functionality will be used in Boston until they upgrade to Ed-Fi 7