There is a bug in the current version of this repo where change-version window logic is not used during full refreshes, even if marked to be used. This is due to a bug where a conditional clause checks the XCom value of min_change_value before the Jinja template string is populated. I moved the conditional from __init__() to execute(), and the issue is resolved.
PR Merge Priority:
[ ] Low
[ ] Medium
[x] High
This is a critical bug that will affect high-volume resources. It is responsible for our inability to ingest the grades resource from the SCDE Ed-Fi ODS.
Changes to existing files:
edu_edfi_airflow/providers/edfi/transfers/edfi_to_s3.py: Move min_change_version XCom check from init to execute.
Hotfix: Full-Refresh XCom Bugfix
Description & motivation
There is a bug in the current version of this repo where change-version window logic is not used during full refreshes, even if marked to be used. This is due to a bug where a conditional clause checks the XCom value of
min_change_valuebefore the Jinja template string is populated. I moved the conditional from__init__()toexecute(), and the issue is resolved.PR Merge Priority:
This is a critical bug that will affect high-volume resources. It is responsible for our inability to ingest the
gradesresource from the SCDE Ed-Fi ODS.Changes to existing files:
edu_edfi_airflow/providers/edfi/transfers/edfi_to_s3.py: Movemin_change_versionXCom check from init to execute.