astronomer / astro-provider-databricks

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows
Apache License 2.0
20 stars 10 forks source link

Incompatible with Airflow>=2.8.0 - remove pydantic version restrictions #60

Closed w0ut0 closed 4 months ago

w0ut0 commented 4 months ago

In https://github.com/astronomer/astro-provider-databricks/pull/52, pydantic was pinned on <2.0.0. However, in Airflow 2.8.0, Pydantic is bumped to >2.3.0.

This causes the package installation to fail on Airflow > 2.8.0