Describe the bug
Task Dependency sensor (brickflow_plugins/airflow/operators/external_tasks/TaskDependencySensor) which pings upstream airflow clusters for state [success, failure etc] doesnt account for Execution delta window meaning when we ping the airflow cluster it is poking for success at same time instead of the execution delta window
To Reproduce
Steps to reproduce the behavior:
create a workflow with a dependency on the airflow cluster.
update okta_conn_id in the secrets
run the workflow to check for upstream airflow(dag/task) success
Would fail after timeout
Expected behavior
Should succeed once a success execution is found for a dag within the execution window.
Screenshots
If applicable, add screenshots to help explain your problem.
Cloud Information
[ ] AWS
[ ] Azure
[ ] GCP
[ ] Other
Desktop (please complete the following information):
OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]
Additional context
Add any other context about the problem here.
Describe the bug Task Dependency sensor (brickflow_plugins/airflow/operators/external_tasks/TaskDependencySensor) which pings upstream airflow clusters for state [success, failure etc] doesnt account for Execution delta window meaning when we ping the airflow cluster it is poking for success at same time instead of the execution delta window To Reproduce Steps to reproduce the behavior:
Expected behavior Should succeed once a success execution is found for a dag within the execution window.
Screenshots If applicable, add screenshots to help explain your problem.
Cloud Information
Desktop (please complete the following information):
Additional context Add any other context about the problem here.