apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
37.32k stars 14.34k forks source link

The Dags Are not showing in the UI on dag search it is showing #42489

Closed Amar1404 closed 1 month ago

Amar1404 commented 2 months ago

Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

2.10.2

What happened?

The dags are not showing in the all view but is running and available in dag_bag and being accessed by dag_search

What you think should happen instead?

No response

How to reproduce

Upgrade to new version

Operating System

kubernetive

Versions of Apache Airflow Providers

No response

Deployment

Other 3rd-party Helm chart

Deployment details

Installed using Community Helm Chart

Anything else?

No response

Are you willing to submit PR?

Code of Conduct

Amar1404 commented 1 month ago

Dag are being parsed, checked all the logs of scheduler and dag parser, dags are running and only showing running dag in UI,or failed dag in UI, even i go to dag from dag search, but are not visible dag in all dags or active dags in web UI

eladkal commented 1 month ago

Can you share reproduce steps?

Amar1404 commented 1 month ago

Hi @eladkal -

  1. I am using helm chart to deploy the airflow. Please find below the chart 2 I am using Dyanmic dag generation using one single file. Have checked the scheduler have process all the dags and even dag_processor , working fine in 2.9.2 helmcharAirflow.txt
ephraimbuddy commented 1 month ago

Hi @eladkal -

  1. I am using helm chart to deploy the airflow. Please find below the chart 2 I am using Dyanmic dag generation using one single file. Have checked the scheduler have process all the dags and even dag_processor , working fine in 2.9.2 helmcharAirflow.txt

Can you share the screenshot of this part of your UI: Screenshot 2024-09-30 at 07 32 51

cesar-vermeulen commented 1 month ago

Also experienced this issue. It appears that whenever you click on running or failed, filtering continues to apply after clicking active/paused/all (cfr. url in screenshot). In previous versions, the filtering did not persist when you clicked on different tiles. image

When you click on the current active filter (running/failed), all dags appear again.

Amar1404 commented 1 month ago

the above screenshot is the issue the all only showing 4 dags which are running or failed. not all the active or paused dags

ephraimbuddy commented 1 month ago

That's not an issue. I knew that was your confusion, but it's right that 4 is displayed in 'all' because the total number of 'running' dags is 4. You have to deselect the Running tab by clicking on it again so it's no longer applied.

bbovenzi commented 1 month ago

This is working as expected. But we will be improving the UX in Airflow 3.0 to make it more intuitive.

Amar1404 commented 1 month ago

Got it thanks for the information.