apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
36.49k stars 14.13k forks source link

Error in GKEStartPodOperator "Repeated values for field enableComponents may not be None" #40945

Open nlarge-google opened 2 months ago

nlarge-google commented 2 months ago

Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

Unknown, but definitely version 2.x.x

What happened?

Last week Dags began erroring with ""Repeated values for field enableComponents may not be None"" when they had been working fine prior. I have no idea why all of a sudden this issue occurred and have checked whether enableComponents is set in LoggingConfig and monitoringConfig - which they are. Why then would a GKEStartPodOperator begin erroring with this, without any changes to the actual pods?

What you think should happen instead?

These pods worked last week with no changes and all of a sudden they do not.

How to reproduce

Operating System

linux

Versions of Apache Airflow Providers

apache-airflow-providers-common-sql==1.3.0 apache-airflow-providers-ftp==3.1.0 apache-airflow-providers-google==8.5.0 apache-airflow-providers-http==4.0.0 apache-airflow-providers-imap==3.0.0 apache-airflow-providers-sendgrid==3.0.0 apache-airflow-providers-sqlite==3.2.1

Deployment

Google Cloud Composer

Deployment details

No response

Anything else?

It just started last week without any changes to any dags and the issue has occurred on multiple dags

Are you willing to submit PR?

Code of Conduct

boring-cyborg[bot] commented 2 months ago

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

eladkal commented 2 months ago

cc @VladaZakharova

VladaZakharova commented 3 weeks ago

Hi @nlarge-google ! Can you please provide more information about the operator and its parameters you were running?