search

mseminara0415 / Satellite-Tracker

ELT Data pipeline that uses a serverless event driven architecture to extract, load, and transform satellite tracking data provided from a couple different APIs, as well as scraped data from Wikipedia.
0 stars 1 forks source link

Find Poetry Workaround For Installing Apache Airflow #1

Closed mseminara0415 closed 2 years ago

mseminara0415 commented 2 years ago

What's The Issue?

Currently Airflow installation is not supported with pip-like tools, such as Poetry, which is what we use for our packaging and dependency manager. See below explanation from the Airflow Docs.

Only pip installation is currently officially supported.

While there are some successes with using other tools like poetry or pip-tools, they do not share the same workflow as pip - especially when it comes to constraint vs. requirements management. Installing via Poetry or pip-tools is not currently supported. If you wish to install airflow using those tools you should use the constraint files and convert them to appropriate format and workflow that your tool requires.

Possible Solutions?

The below possible solutions need more research to determine if they are viable.

mseminara0415 commented 2 years ago

This issue is closed with commit Update pytest version from ^5.2 to ^6.0 and poetry add apache-airflow