Closed phi-friday closed 1 month ago
Dataset declarations are supposed to be stable, and the side effect of changing it at runtime is undefined. If you want to attach information dynamically, do it on the dataset event instead.
Dataset declarations are supposed to be stable, and the side effect of changing it at runtime is undefined. If you want to attach information dynamically, do it on the dataset event instead.
@uranusjr
I know I should use event
.
I created the issue just to say that it seems odd that the two are inconsistent with each other.
Wouldn't it be nice to have the two items synchronized with each other?
Or at least throw an error.
Apache Airflow version
2.9.1
If "Other Airflow 2 version" selected, which one?
No response
What happened?
When I modified the dataset during runtime, as shown below,
In XCOM, I can see these changed values.
However, it will look different in detail.
And if I check the triggered DAG, extra is passed unchanged.
What you think should happen instead?
It has to be one(changed) or the other(unchanged).
How to reproduce
Operating System
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)" NAME="Debian GNU/Linux" VERSION_ID="12" VERSION="12 (bookworm)" VERSION_CODENAME=bookworm ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"
Versions of Apache Airflow Providers
apache-airflow-providers-celery==3.7.0 apache-airflow-providers-common-io==1.3.1 apache-airflow-providers-common-sql==1.13.0 apache-airflow-providers-docker==3.11.0 apache-airflow-providers-fab==1.1.0 apache-airflow-providers-ftp==3.9.0 apache-airflow-providers-http==4.11.0 apache-airflow-providers-imap==3.6.0 apache-airflow-providers-odbc==4.6.0 apache-airflow-providers-postgres==5.11.0 apache-airflow-providers-redis==3.7.0 apache-airflow-providers-smtp==1.7.0 apache-airflow-providers-sqlite==3.8.0
Deployment
Docker-Compose
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
Code of Conduct