Databricks No scheme supplied error - Githubissues

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

https://airflow.apache.org/

Apache License 2.0

36.76k stars 14.22k forks source link

Databricks No scheme supplied error #43249

Open tbaert-prest opened 2 hours ago

tbaert-prest commented 2 hours ago

Apache Airflow Provider(s)

databricks

Versions of Apache Airflow Providers

6.10.0

Apache Airflow version

2.8.0

Operating System

linux/amd64

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

What happened

When we use the oauth authentication with a Databricks service principal, we provide the environment variable :

AIRFLOW_CONN_DATABRICKS_DEFAULT = "databricks://SP_CLIENT_ID:SP_SECRET@DATABRICKS_WORKSPACE_ID.azuredatabricks.net?service_principal_oauth=true"

But we have this error :

databricks

What you think should happen instead

No response

How to reproduce

Install the Databricks operator, set the environment variable and use DatabricksRunNowOperator function in your DAG to run a workflow in Databricks.

Anything else

No response

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

boring-cyborg[bot] commented 2 hours ago

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.