kedro-org / kedro-plugins

First-party plugins maintained by the Kedro team.
Apache License 2.0
91 stars 83 forks source link

`kedro-airflow`: Follow the TaskFlow paradigm for DAGs? #545

Closed ankatiyar closed 7 months ago

ankatiyar commented 7 months ago

Description

Since 2.0, apache-airflow has introduced the TaskFlow API which is a new way of writing DAGs. Link for more info - https://airflow.apache.org/docs/apache-airflow/stable/tutorial/taskflow.html

They still support the traditional paradigm for DAGs which is what kedro-airflow follows right now.

Possible Implementation

ankatiyar commented 7 months ago

I just saw there is an existing issue for this https://github.com/kedro-org/kedro-plugins/issues/25 Closing this.