search

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
37.02k stars 14.27k forks source link

Using GCP secret manager in local env and override secrets #43779

Open dor-schreiber opened 2 hours ago

dor-schreiber commented 2 hours ago

Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

2.9.1

What happened?

When using airflow with GCP secret manager it works great. When I wan't to use the secret manager to fetch the secrets + override some of them the secrets remain the same.wantthe

What you think should happen instead?

The env/yaml secrets will be given priority over the secret manager. The UI secrets can override as well, but when using secret manager we are fetching the secret before using so I'm not sure how it will work.

How to reproduce

Create an airflow repo with secret manager backend link.

Set a secret and try to override it sith local secret

Operating System

Mac Sonoma 14.4.1

Versions of Apache Airflow Providers

apache-airflow-providers-google==10.20.0

Deployment

Docker-Compose

Deployment details

No response

Anything else?

No response

Are you willing to submit PR?

Code of Conduct

boring-cyborg[bot] commented 2 hours ago

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.