search

puckel / docker-airflow

Docker Apache Airflow
Apache License 2.0
3.77k stars 536 forks source link

Kombu version issue #333

Open dafrenchyman opened 5 years ago

dafrenchyman commented 5 years ago

FYI - I'm not sure if this issue was specific to just me, as I've modified this repository to install everything:

    && pip install apache-airflow[all]==$AIRFLOW_VERSION \
    && pip install airflow-plugins \

But, I ran into an issue with Kombu==4.4.0 This basically broke Celery on the worker nodes on my Kubernetes cluster. I found others that had a similar issue: https://github.com/pydanny/cookiecutter-django/issues/1954

I ended up fixing it by running 

   && pip install kombu==4.3.0 \

Before installing airflow.

sdwa0 commented 5 years ago

I ran into the same issue too (VersionMismatch for redis-py). I think it is due to the new version of kombu too, more specifically the following change that was released on kombu v4.4.0: https://github.com/celery/kombu/commit/eb6e4c8d512c6451d2430744322014439e8a0df8

I fixed with a similar change like @dafrenchyman did. && pip install 'kombu>=4.2.0,<4.4.0' \