search

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
36.35k stars 14.1k forks source link

Find and display the longest path #39938

Open nivdror opened 3 months ago

nivdror commented 3 months ago

Description

Create a view in the graph UI by pressing two tasks that are dependent on one another and show the longest path and how much time it will take(by using task duration over the recent history).

We created this feature in our own old airflow but I don't see why this cannot be in apache airflow. Here is an example:

Screenshot 2024-05-30 at 11 47 45

Use case/motivation

I'm trying to achieve a better visibility over the graph UI which I believe is the important UI in airflow. This feature will help the oncalls figure out what the ETA of a certain flow

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

Taragolis commented 3 months ago

@nivdror Are you intend to make a Pull Request for add this feature into the Grid View?

nivdror commented 3 months ago

No, the grid view is of lesser importance to me and fellow to my data engineers (at least in my company)

Taragolis commented 3 months ago

Old Graph UI was removed in Airflow 2.7, and moved into the part of Grid View.

nivdror commented 3 months ago

while I think removing the old graph UI was a mistake. what done is done. please forgive my choice of words. what I meant for that I like it to be added into the Graph view in the Grid UI.