astronomer / astro-sdk

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
https://astro-sdk-python.rtfd.io/
Apache License 2.0
329 stars 40 forks source link

Use `apache-airflow-providers-openlineage`, bump min Airflow version to 2.7 and Python version to 3.8 #2103

Closed pankajastro closed 5 months ago

pankajastro commented 5 months ago

Fixes issue reported where deployments don't contain the openlineage-airflow library installed but instead contain apache-airflow-providers-openlineage. To fix the issue we transform the usages from openlineage-airflow to corresponding available source code in the apache-airflow-providers-openlineage Airflow OSS provider.

Since the apache-airflow-providers-openlineage depends on Airflow >= 2.7, we also correspondingly bump the Airflow version. Airflow 2.7.0 is also the first release that drops support for end-of-life Python 3.7, and hence, we bump up the min Python version to 3.8

related: https://github.com/astronomer/issues-airflow/issues/503