Closed tooptoop4 closed 3 years ago
First of all - python 3.9 is not officially supported yet. But I think I need more information.
Did you install airlfow with sdist package?
@ashb @kaxil - I just checked and it looks like unlike .whl package, the .tar.gz does not contain customized_form_field_behaviours.schema.json
. I looked at it and seems that while it is in setup.cfg, it is missing in MANIFEST.in. I will fix it now, but I think this might be a reason to call for rc2
Thanks @tooptoop4 for raising - can you please tell us why you have used sdist not wheel ? What was the reason ?
@potiuk I just did python3 -m pip install https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz. I am using MacOs BigSur 11.0.1
install log
Collecting https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz
Using cached https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz (3.9 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing wheel metadata ... done
Collecting psutil<6.0.0,>=4.2.0
Using cached psutil-5.7.3.tar.gz (465 kB)
Collecting rich==9.2.0
Using cached rich-9.2.0-py3-none-any.whl (164 kB)
Processing /Users/red/Library/Caches/pip/wheels/e0/19/6f/6ba857621f50dc08e084312746ed3ebc14211ba30037d5e44e/MarkupSafe-1.1.1-py3-none-any.whl
Collecting argcomplete~=1.10
Using cached argcomplete-1.12.2-py2.py3-none-any.whl (38 kB)
Collecting croniter<0.4,>=0.3.17
Using cached croniter-0.3.36-py2.py3-none-any.whl (13 kB)
Collecting attrs<21.0,>=20.0
Using cached attrs-20.3.0-py2.py3-none-any.whl (49 kB)
Processing /Users/red/Library/Caches/pip/wheels/c9/c7/29/3cf0033406b18958d1a7b107c38be2405ef9c081b64a264fd5/pendulum-2.1.2-cp39-cp39-macosx_10_16_x86_64.whl
Processing /Users/red/Library/Caches/pip/wheels/84/5b/00/3ebff44b1e0a380d959960828803a9486ff2433728cceff666/python_slugify-4.0.1-py2.py3-none-any.whl
Collecting python-daemon>=2.1.1
Using cached python_daemon-2.2.4-py2.py3-none-any.whl (35 kB)
Processing /Users/red/Library/Caches/pip/wheels/65/af/f4/03ed4648690aa67bc7aca3c61e9bc0ef94ee1798008ca60167/json_merge_patch-0.2-py3-none-any.whl
Collecting jinja2<2.12.0,>=2.10.1
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting sqlalchemy<2,>=1.3.18
Using cached SQLAlchemy-1.3.20-cp39-cp39-macosx_10_14_x86_64.whl (1.2 MB)
Collecting dill<0.4,>=0.2.2
Using cached dill-0.3.3-py2.py3-none-any.whl (81 kB)
Collecting sqlalchemy-jsonfield~=0.9
Using cached SQLAlchemy_JSONField-0.9.0-py2.py3-none-any.whl (10 kB)
Collecting marshmallow-oneofschema>=2.0.1
Using cached marshmallow_oneofschema-2.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting pandas<2.0,>=0.17.1
Using cached pandas-1.1.5-cp39-cp39-macosx_10_9_x86_64.whl (10.3 MB)
Collecting cryptography>=0.9.3
Using cached cryptography-3.3.1-cp36-abi3-macosx_10_10_x86_64.whl (1.8 MB)
Collecting urllib3<1.26
Using cached urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting apache-airflow-providers-imap
Using cached apache_airflow_providers_imap-1.0.0rc1-py3-none-any.whl (18 kB)
Collecting requests<2.24.0,>=2.20.0
Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB)
Collecting funcsigs<2.0.0,>=1.0.0
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting setproctitle<2,>=1.1.8
Using cached setproctitle-1.2.1.tar.gz (23 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing wheel metadata ... done
Processing /Users/red/Library/Caches/pip/wheels/7d/2a/d3/9b83608fd158b23f4d04b92572b93ab2d643faa2a3c46b6f34/tzlocal-1.5.1-py3-none-any.whl
Collecting flask-appbuilder~=3.1.1
Using cached Flask_AppBuilder-3.1.1-py3-none-any.whl (1.7 MB)
Collecting flask<2.0,>=1.1.0
Using cached Flask-1.1.2-py2.py3-none-any.whl (94 kB)
Collecting apache-airflow-providers-sqlite
Using cached apache_airflow_providers_sqlite-1.0.0rc1-py3-none-any.whl (15 kB)
Processing /Users/red/Library/Caches/pip/wheels/b6/0d/90/0d1bbd99855f99cb2f6c2e5ff96f8023fad8ec367695f7d72d/termcolor-1.1.0-py3-none-any.whl
Collecting apache-airflow-providers-ftp
Using cached apache_airflow_providers_ftp-1.0.0rc1-py3-none-any.whl (17 kB)
Collecting markdown<4.0,>=2.5.2
Using cached Markdown-3.3.3-py3-none-any.whl (96 kB)
Processing /Users/red/Library/Caches/pip/wheels/60/e8/21/19a3dcfe90e8895952857d42152663fafc5a90d87d3dfe5f58/python_nvd3-0.15.0-py3-none-any.whl
Collecting python-dateutil<3,>=2.3
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting iso8601>=0.1.12
Using cached iso8601-0.1.13-py2.py3-none-any.whl (9.3 kB)
Collecting importlib-resources~=1.4
Using cached importlib_resources-1.5.0-py2.py3-none-any.whl (21 kB)
Collecting pygments<3.0,>=2.0.1
Using cached Pygments-2.7.3-py3-none-any.whl (950 kB)
Processing /Users/red/Library/Caches/pip/wheels/41/20/07/2a3e02cdfc8b442404202f6ef99ff1b1c16b73910968a46f2f/lazy_object_proxy-1.4.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting lockfile>=0.12.2
Using cached lockfile-0.12.2-py2.py3-none-any.whl (13 kB)
Processing /Users/red/Library/Caches/pip/wheels/d8/c8/27/b237d3378d5c9ed25c2c63d9af1b3d5ccb99934f3dd030de87/unicodecsv-0.14.1-py3-none-any.whl
Collecting apache-airflow-providers-http
Using cached apache_airflow_providers_http-1.0.0rc1-py3-none-any.whl (24 kB)
Collecting cached-property~=1.5
Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Processing /Users/red/Library/Caches/pip/wheels/39/10/74/d68194e28d5f7a83de5f66e5b2deff5ccbb424fe45e6b0e927/Flask_Login-0.4.1-py2.py3-none-any.whl
Collecting colorlog==4.0.2
Using cached colorlog-4.0.2-py2.py3-none-any.whl (17 kB)
Collecting graphviz>=0.12
Using cached graphviz-0.15-py2.py3-none-any.whl (18 kB)
Collecting itsdangerous>=1.1.0
Using cached itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
Processing /Users/red/Library/Caches/pip/wheels/9d/e0/b1/225035529ebb2074662c2a80950ea25132c7b6c5aff925aaab/flask_swagger-0.2.13-py3-none-any.whl
Collecting jsonschema~=3.0
Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Processing /Users/red/Library/Caches/pip/wheels/a3/18/80/a9b97f8e0dddb23be3e79f2209dfa3cd6292e1e42bd210a068/thrift-0.13.0-py3-none-any.whl
Collecting connexion[flask,swagger-ui]<3,>=2.6.0
Using cached connexion-2.7.0-py2.py3-none-any.whl (77 kB)
Collecting gunicorn<20.0,>=19.5.0
Using cached gunicorn-19.10.0-py2.py3-none-any.whl (113 kB)
Collecting tenacity~=6.2.0
Using cached tenacity-6.2.0-py2.py3-none-any.whl (24 kB)
Collecting werkzeug>=1.0.1,~=1.0
Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting flask-caching<2.0.0,>=1.5.0
Using cached Flask_Caching-1.9.0-py2.py3-none-any.whl (33 kB)
Collecting cattrs<2.0,>=1.0; python_version > "3.6"
Using cached cattrs-1.1.2-py3-none-any.whl (17 kB)
Collecting flask-wtf<0.15,>=0.14.3
Using cached Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB)
Collecting tabulate<0.9,>=0.7.5
Using cached tabulate-0.8.7-py3-none-any.whl (24 kB)
Collecting alembic<2.0,>=1.2
Using cached alembic-1.4.3-py2.py3-none-any.whl (159 kB)
Collecting colorama<0.5.0,>=0.4.0
Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting commonmark<0.10.0,>=0.9.0
Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
Collecting typing-extensions<4.0.0,>=3.7.4
Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting natsort
Using cached natsort-7.1.0-py3-none-any.whl (35 kB)
Collecting pytzdata>=2020.1
Using cached pytzdata-2020.1-py2.py3-none-any.whl (489 kB)
Collecting text-unidecode>=1.3
Using cached text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
Collecting docutils
Using cached docutils-0.16-py2.py3-none-any.whl (548 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.9/site-packages (from python-daemon>=2.1.1->apache-airflow==2.0.0) (50.3.2)
Collecting marshmallow<4.0.0,>=3.0.0rc6
Using cached marshmallow-3.9.1-py2.py3-none-any.whl (46 kB)
Collecting numpy>=1.15.4
Using cached numpy-1.19.4-cp39-cp39-macosx_10_9_x86_64.whl (15.4 MB)
Collecting pytz>=2017.2
Using cached pytz-2020.4-py2.py3-none-any.whl (509 kB)
Collecting cffi>=1.12
Using cached cffi-1.14.4-cp39-cp39-macosx_10_9_x86_64.whl (177 kB)
Collecting six>=1.4.1
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting marshmallow-enum<2,>=1.5.1
Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting Flask-SQLAlchemy<3,>=2.4
Using cached Flask_SQLAlchemy-2.4.4-py2.py3-none-any.whl (17 kB)
Collecting prison<1.0.0,>=0.1.3
Using cached prison-0.1.3-py2.py3-none-any.whl (5.8 kB)
Collecting Flask-Babel<2,>=1
Using cached Flask_Babel-1.0.0-py3-none-any.whl (9.5 kB)
Processing /Users/red/Library/Caches/pip/wheels/ed/05/31/972024d2446f785e62227cb1d07cfb816fcfbc2e759afc2caa/Flask_JWT_Extended-3.25.0-py2.py3-none-any.whl
Collecting apispec[yaml]<4,>=3.3
Using cached apispec-3.3.2-py2.py3-none-any.whl (27 kB)
Collecting marshmallow-sqlalchemy<0.24.0,>=0.22.0
Using cached marshmallow_sqlalchemy-0.23.1-py2.py3-none-any.whl (18 kB)
Processing /Users/red/Library/Caches/pip/wheels/cc/a9/ec/d14efb7a25128ae89ce3fc5545dac6016306e75e60d6f0e499/SQLAlchemy_Utils-0.36.8-py2.py3-none-any.whl
Collecting PyJWT>=1.7.1
Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB)
Collecting email-validator<2,>=1.0.5
Using cached email_validator-1.1.2-py2.py3-none-any.whl (17 kB)
Collecting click<8,>=6.7
Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Processing /Users/red/Library/Caches/pip/wheels/74/23/d8/1cd6aaca32ab6ca7cd44c015314e26421b9e38288424d2ac86/Flask_OpenID-1.2.5-py3-none-any.whl
Processing /Users/red/Library/Caches/pip/wheels/69/60/81/5cd74b8ee068fbe9e04ca0d53148f28f5c6e2c5b177d5dd622/PyYAML-5.3.1-cp39-cp39-macosx_10_13_x86_64.whl
Processing /Users/red/Library/Caches/pip/wheels/00/cc/12/e712d3979a4aeee423b34a832d97c803e1a67659060315a7e0/pyrsistent-0.17.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting inflection>=0.3.1
Using cached inflection-0.5.1-py2.py3-none-any.whl (9.5 kB)
Collecting openapi-spec-validator>=0.2.4
Using cached openapi_spec_validator-0.2.9-py3-none-any.whl (25 kB)
Collecting clickclick>=1.2
Using cached clickclick-20.10.2-py2.py3-none-any.whl (7.4 kB)
Collecting swagger-ui-bundle>=0.0.2; extra == "swagger-ui"
Using cached swagger_ui_bundle-0.0.8-py3-none-any.whl (3.8 MB)
Collecting WTForms
Using cached WTForms-2.3.3-py2.py3-none-any.whl (169 kB)
Collecting Mako
Using cached Mako-1.1.3-py2.py3-none-any.whl (75 kB)
Collecting python-editor>=0.3
Using cached python_editor-1.0.4-py3-none-any.whl (4.9 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting Babel>=2.3
Using cached Babel-2.9.0-py2.py3-none-any.whl (8.8 MB)
Collecting dnspython>=1.15.0
Using cached dnspython-2.0.0-py3-none-any.whl (208 kB)
Collecting python3-openid>=2.0
Using cached python3_openid-3.2.0-py3-none-any.whl (133 kB)
Collecting defusedxml
Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Building wheels for collected packages: apache-airflow, psutil, setproctitle
Building wheel for apache-airflow (PEP 517) ... done
Created wheel for apache-airflow: filename=apache_airflow-2.0.0-py3-none-any.whl size=4534581 sha256=e4120d6dccf71abb111ed61b0b92a50b3e5dcf0e270b373661ce591753287309
Stored in directory: /Users/red/Library/Caches/pip/wheels/76/97/35/50763af952754717d6174a23d13b9c3cd5eb2613929867f138
Building wheel for psutil (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /usr/local/opt/python@3.9/bin/python3.9 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/psutil/setup.py'"'"'; __file__='"'"'/private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/psutil/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-wheel-p8qmqntf
cwd: /private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/psutil/
Complete output (44 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.macosx-10.13-x86_64-3.9
creating build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_pswindows.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_common.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/__init__.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_psosx.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_psbsd.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_psaix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_pslinux.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_compat.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_psposix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
copying psutil/_pssunos.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
creating build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_contracts.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_connections.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/runner.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_unicode.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_misc.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_posix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_linux.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_sunos.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/__init__.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_aix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_process.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_bsd.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_system.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_osx.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_memleaks.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_windows.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/__main__.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
copying psutil/tests/test_testutils.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
running build_ext
building 'psutil._psutil_osx' extension
creating build/temp.macosx-10.13-x86_64-3.9
creating build/temp.macosx-10.13-x86_64-3.9/psutil
creating build/temp.macosx-10.13-x86_64-3.9/psutil/arch
creating build/temp.macosx-10.13-x86_64-3.9/psutil/arch/osx
clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=573 -DPSUTIL_OSX=1 -I/usr/local/include -I/usr/local/opt/openssl@1.1/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/include/python3.9 -c psutil/_psutil_common.c -o build/temp.macosx-10.13-x86_64-3.9/psutil/_psutil_common.o
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
error: command '/usr/bin/clang' failed with exit code 1
----------------------------------------
ERROR: Failed building wheel for psutil
Running setup.py clean for psutil
Building wheel for setproctitle (PEP 517) ... error
ERROR: Command errored out with exit status 1:
command: /usr/local/opt/python@3.9/bin/python3.9 /usr/local/lib/python3.9/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/tmp_o54t5ty
cwd: /private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/setproctitle
Complete output (10 lines):
running bdist_wheel
running build
running build_ext
building 'setproctitle' extension
creating build
creating build/temp.macosx-10.13-x86_64-3.9
creating build/temp.macosx-10.13-x86_64-3.9/src
clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -DSPT_VERSION=1.2.1 -D__darwin__=1 -I/usr/local/include -I/usr/local/opt/openssl@1.1/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/include/python3.9 -c src/setproctitle.c -o build/temp.macosx-10.13-x86_64-3.9/src/setproctitle.o
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
error: command '/usr/bin/clang' failed with exit code 1
----------------------------------------
ERROR: Failed building wheel for setproctitle
Successfully built apache-airflow
Failed to build psutil setproctitle
ERROR: Could not build wheels for setproctitle which use PEP 517 and cannot be installed directly
rerun after xcode-select --install; sudo xcode-select -s /Library/Developer/CommandLineTools
Collecting https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz
Using cached https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz (3.9 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing wheel metadata ... done
Collecting apache-airflow-providers-ftp
Using cached apache_airflow_providers_ftp-1.0.0rc1-py3-none-any.whl (17 kB)
Processing /Users/red/Library/Caches/pip/wheels/9d/e0/b1/225035529ebb2074662c2a80950ea25132c7b6c5aff925aaab/flask_swagger-0.2.13-py3-none-any.whl
Collecting graphviz>=0.12
Using cached graphviz-0.15-py2.py3-none-any.whl (18 kB)
Collecting jinja2<2.12.0,>=2.10.1
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting argcomplete~=1.10
Using cached argcomplete-1.12.2-py2.py3-none-any.whl (38 kB)
Collecting python-dateutil<3,>=2.3
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting rich==9.2.0
Using cached rich-9.2.0-py3-none-any.whl (164 kB)
Collecting sqlalchemy-jsonfield~=0.9
Using cached SQLAlchemy_JSONField-0.9.0-py2.py3-none-any.whl (10 kB)
Collecting flask-appbuilder~=3.1.1
Using cached Flask_AppBuilder-3.1.1-py3-none-any.whl (1.7 MB)
Processing /Users/red/Library/Caches/pip/wheels/84/5b/00/3ebff44b1e0a380d959960828803a9486ff2433728cceff666/python_slugify-4.0.1-py2.py3-none-any.whl
Collecting sqlalchemy<2,>=1.3.18
Using cached SQLAlchemy-1.3.20-cp39-cp39-macosx_10_14_x86_64.whl (1.2 MB)
Processing /Users/red/Library/Caches/pip/wheels/65/af/f4/03ed4648690aa67bc7aca3c61e9bc0ef94ee1798008ca60167/json_merge_patch-0.2-py3-none-any.whl
Processing /Users/red/Library/Caches/pip/wheels/a3/18/80/a9b97f8e0dddb23be3e79f2209dfa3cd6292e1e42bd210a068/thrift-0.13.0-py3-none-any.whl
Collecting apache-airflow-providers-http
Using cached apache_airflow_providers_http-1.0.0rc1-py3-none-any.whl (24 kB)
Collecting werkzeug>=1.0.1,~=1.0
Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting markdown<4.0,>=2.5.2
Using cached Markdown-3.3.3-py3-none-any.whl (96 kB)
Collecting itsdangerous>=1.1.0
Using cached itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting iso8601>=0.1.12
Using cached iso8601-0.1.13-py2.py3-none-any.whl (9.3 kB)
Processing /Users/red/Library/Caches/pip/wheels/41/20/07/2a3e02cdfc8b442404202f6ef99ff1b1c16b73910968a46f2f/lazy_object_proxy-1.4.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting pygments<3.0,>=2.0.1
Using cached Pygments-2.7.3-py3-none-any.whl (950 kB)
Collecting croniter<0.4,>=0.3.17
Using cached croniter-0.3.36-py2.py3-none-any.whl (13 kB)
Collecting colorlog==4.0.2
Using cached colorlog-4.0.2-py2.py3-none-any.whl (17 kB)
Collecting tenacity~=6.2.0
Using cached tenacity-6.2.0-py2.py3-none-any.whl (24 kB)
Collecting flask<2.0,>=1.1.0
Using cached Flask-1.1.2-py2.py3-none-any.whl (94 kB)
Collecting dill<0.4,>=0.2.2
Using cached dill-0.3.3-py2.py3-none-any.whl (81 kB)
Collecting pandas<2.0,>=0.17.1
Using cached pandas-1.1.5-cp39-cp39-macosx_10_9_x86_64.whl (10.3 MB)
Collecting apache-airflow-providers-imap
Using cached apache_airflow_providers_imap-1.0.0rc1-py3-none-any.whl (18 kB)
Processing /Users/red/Library/Caches/pip/wheels/e0/19/6f/6ba857621f50dc08e084312746ed3ebc14211ba30037d5e44e/MarkupSafe-1.1.1-py3-none-any.whl
Collecting python-daemon>=2.1.1
Using cached python_daemon-2.2.4-py2.py3-none-any.whl (35 kB)
Processing /Users/red/Library/Caches/pip/wheels/b6/0d/90/0d1bbd99855f99cb2f6c2e5ff96f8023fad8ec367695f7d72d/termcolor-1.1.0-py3-none-any.whl
Collecting cattrs<2.0,>=1.0; python_version > "3.6"
Using cached cattrs-1.1.2-py3-none-any.whl (17 kB)
Collecting marshmallow-oneofschema>=2.0.1
Using cached marshmallow_oneofschema-2.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting setproctitle<2,>=1.1.8
Using cached setproctitle-1.2.1.tar.gz (23 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing wheel metadata ... done
Processing /Users/red/Library/Caches/pip/wheels/d8/c8/27/b237d3378d5c9ed25c2c63d9af1b3d5ccb99934f3dd030de87/unicodecsv-0.14.1-py3-none-any.whl
Collecting lockfile>=0.12.2
Using cached lockfile-0.12.2-py2.py3-none-any.whl (13 kB)
Collecting importlib-resources~=1.4
Using cached importlib_resources-1.5.0-py2.py3-none-any.whl (21 kB)
Collecting cached-property~=1.5
Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Collecting requests<2.24.0,>=2.20.0
Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB)
Collecting flask-wtf<0.15,>=0.14.3
Using cached Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB)
Collecting connexion[flask,swagger-ui]<3,>=2.6.0
Using cached connexion-2.7.0-py2.py3-none-any.whl (77 kB)
Collecting jsonschema~=3.0
Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Processing /Users/red/Library/Caches/pip/wheels/60/e8/21/19a3dcfe90e8895952857d42152663fafc5a90d87d3dfe5f58/python_nvd3-0.15.0-py3-none-any.whl
Collecting tabulate<0.9,>=0.7.5
Using cached tabulate-0.8.7-py3-none-any.whl (24 kB)
Collecting alembic<2.0,>=1.2
Using cached alembic-1.4.3-py2.py3-none-any.whl (159 kB)
Collecting flask-caching<2.0.0,>=1.5.0
Using cached Flask_Caching-1.9.0-py2.py3-none-any.whl (33 kB)
Collecting attrs<21.0,>=20.0
Using cached attrs-20.3.0-py2.py3-none-any.whl (49 kB)
Collecting urllib3<1.26
Using cached urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting funcsigs<2.0.0,>=1.0.0
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting apache-airflow-providers-sqlite
Using cached apache_airflow_providers_sqlite-1.0.0rc1-py3-none-any.whl (15 kB)
Collecting psutil<6.0.0,>=4.2.0
Using cached psutil-5.7.3.tar.gz (465 kB)
Collecting cryptography>=0.9.3
Using cached cryptography-3.3.1-cp36-abi3-macosx_10_10_x86_64.whl (1.8 MB)
Processing /Users/red/Library/Caches/pip/wheels/7d/2a/d3/9b83608fd158b23f4d04b92572b93ab2d643faa2a3c46b6f34/tzlocal-1.5.1-py3-none-any.whl
Collecting gunicorn<20.0,>=19.5.0
Using cached gunicorn-19.10.0-py2.py3-none-any.whl (113 kB)
Processing /Users/red/Library/Caches/pip/wheels/39/10/74/d68194e28d5f7a83de5f66e5b2deff5ccbb424fe45e6b0e927/Flask_Login-0.4.1-py2.py3-none-any.whl
Processing /Users/red/Library/Caches/pip/wheels/c9/c7/29/3cf0033406b18958d1a7b107c38be2405ef9c081b64a264fd5/pendulum-2.1.2-cp39-cp39-macosx_10_16_x86_64.whl
Processing /Users/red/Library/Caches/pip/wheels/69/60/81/5cd74b8ee068fbe9e04ca0d53148f28f5c6e2c5b177d5dd622/PyYAML-5.3.1-cp39-cp39-macosx_10_13_x86_64.whl
Collecting six>=1.5
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting colorama<0.5.0,>=0.4.0
Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting commonmark<0.10.0,>=0.9.0
Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
Collecting typing-extensions<4.0.0,>=3.7.4
Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Processing /Users/red/Library/Caches/pip/wheels/74/23/d8/1cd6aaca32ab6ca7cd44c015314e26421b9e38288424d2ac86/Flask_OpenID-1.2.5-py3-none-any.whl
Collecting click<8,>=6.7
Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Processing /Users/red/Library/Caches/pip/wheels/ed/05/31/972024d2446f785e62227cb1d07cfb816fcfbc2e759afc2caa/Flask_JWT_Extended-3.25.0-py2.py3-none-any.whl
Collecting email-validator<2,>=1.0.5
Using cached email_validator-1.1.2-py2.py3-none-any.whl (17 kB)
Collecting marshmallow-sqlalchemy<0.24.0,>=0.22.0
Using cached marshmallow_sqlalchemy-0.23.1-py2.py3-none-any.whl (18 kB)
Collecting PyJWT>=1.7.1
Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB)
Processing /Users/red/Library/Caches/pip/wheels/cc/a9/ec/d14efb7a25128ae89ce3fc5545dac6016306e75e60d6f0e499/SQLAlchemy_Utils-0.36.8-py2.py3-none-any.whl
Collecting marshmallow<4,>=3
Using cached marshmallow-3.9.1-py2.py3-none-any.whl (46 kB)
Collecting prison<1.0.0,>=0.1.3
Using cached prison-0.1.3-py2.py3-none-any.whl (5.8 kB)
Collecting marshmallow-enum<2,>=1.5.1
Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting apispec[yaml]<4,>=3.3
Using cached apispec-3.3.2-py2.py3-none-any.whl (27 kB)
Collecting Flask-SQLAlchemy<3,>=2.4
Using cached Flask_SQLAlchemy-2.4.4-py2.py3-none-any.whl (17 kB)
Collecting Flask-Babel<2,>=1
Using cached Flask_Babel-1.0.0-py3-none-any.whl (9.5 kB)
Collecting text-unidecode>=1.3
Using cached text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
Collecting natsort
Using cached natsort-7.1.0-py3-none-any.whl (35 kB)
Collecting numpy>=1.15.4
Using cached numpy-1.19.4-cp39-cp39-macosx_10_9_x86_64.whl (15.4 MB)
Collecting pytz>=2017.2
Using cached pytz-2020.4-py2.py3-none-any.whl (509 kB)
Collecting docutils
Using cached docutils-0.16-py2.py3-none-any.whl (548 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.9/site-packages (from python-daemon>=2.1.1->apache-airflow==2.0.0) (50.3.2)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting WTForms
Using cached WTForms-2.3.3-py2.py3-none-any.whl (169 kB)
Collecting clickclick>=1.2
Using cached clickclick-20.10.2-py2.py3-none-any.whl (7.4 kB)
Collecting inflection>=0.3.1
Using cached inflection-0.5.1-py2.py3-none-any.whl (9.5 kB)
Collecting openapi-spec-validator>=0.2.4
Using cached openapi_spec_validator-0.2.9-py3-none-any.whl (25 kB)
Collecting swagger-ui-bundle>=0.0.2; extra == "swagger-ui"
Using cached swagger_ui_bundle-0.0.8-py3-none-any.whl (3.8 MB)
Processing /Users/red/Library/Caches/pip/wheels/00/cc/12/e712d3979a4aeee423b34a832d97c803e1a67659060315a7e0/pyrsistent-0.17.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting Mako
Using cached Mako-1.1.3-py2.py3-none-any.whl (75 kB)
Collecting python-editor>=0.3
Using cached python_editor-1.0.4-py3-none-any.whl (4.9 kB)
Collecting cffi>=1.12
Using cached cffi-1.14.4-cp39-cp39-macosx_10_9_x86_64.whl (177 kB)
Collecting pytzdata>=2020.1
Using cached pytzdata-2020.1-py2.py3-none-any.whl (489 kB)
Collecting python3-openid>=2.0
Using cached python3_openid-3.2.0-py3-none-any.whl (133 kB)
Collecting dnspython>=1.15.0
Using cached dnspython-2.0.0-py3-none-any.whl (208 kB)
Collecting Babel>=2.3
Using cached Babel-2.9.0-py2.py3-none-any.whl (8.8 MB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting defusedxml
Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Building wheels for collected packages: apache-airflow, setproctitle, psutil
Building wheel for apache-airflow (PEP 517) ... done
Created wheel for apache-airflow: filename=apache_airflow-2.0.0-py3-none-any.whl size=4534593 sha256=21b93d868b34f4abba95e1047f12fe81ff588d23e1ac828ba38ed565e196f2ec
Stored in directory: /Users/red/Library/Caches/pip/wheels/76/97/35/50763af952754717d6174a23d13b9c3cd5eb2613929867f138
Building wheel for setproctitle (PEP 517) ... done
Created wheel for setproctitle: filename=setproctitle-1.2.1-cp39-cp39-macosx_10_13_x86_64.whl size=10731 sha256=bb8ed9af1e325202256ecce92369f12a17e022a9806a5e6120c376a492e23d24
Stored in directory: /Users/red/Library/Caches/pip/wheels/c3/e4/78/85a456b48a3f8ecd33b4cd1b1dfd3ec0ac25ae6d498a86bf65
Building wheel for psutil (setup.py) ... done
Created wheel for psutil: filename=psutil-5.7.3-cp39-cp39-macosx_10_13_x86_64.whl size=234700 sha256=48dca63d6b15fc55d7b9fc112e39a12debc1388233535aa73a708e35d2fc984e
Stored in directory: /Users/red/Library/Caches/pip/wheels/76/43/53/a0fed7ed0582fd7b0b3032a6703bd498bc6397d4217e88a9ce
Successfully built apache-airflow setproctitle psutil
Installing collected packages: apache-airflow-providers-ftp, click, markupsafe, jinja2, itsdangerous, werkzeug, flask, PyYAML, flask-swagger, graphviz, argcomplete, six, python-dateutil, colorama, commonmark, pygments, typing-extensions, rich, sqlalchemy, sqlalchemy-jsonfield, defusedxml, python3-openid, Flask-OpenID, PyJWT, Flask-JWT-Extended, WTForms, flask-wtf, dnspython, idna, email-validator, marshmallow, marshmallow-sqlalchemy, pyrsistent, attrs, jsonschema, sqlalchemy-utils, prison, marshmallow-enum, apispec, Flask-SQLAlchemy, pytz, Babel, Flask-Babel, flask-login, flask-appbuilder, text-unidecode, python-slugify, json-merge-patch, thrift, apache-airflow-providers-http, markdown, iso8601, lazy-object-proxy, natsort, croniter, colorlog, tenacity, dill, numpy, pandas, apache-airflow-providers-imap, docutils, lockfile, python-daemon, termcolor, cattrs, marshmallow-oneofschema, setproctitle, unicodecsv, importlib-resources, cached-property, urllib3, chardet, certifi, requests, clickclick, inflection, openapi-spec-validator, swagger-ui-bundle, connexion, python-nvd3, tabulate, Mako, python-editor, alembic, flask-caching, funcsigs, apache-airflow-providers-sqlite, psutil, pycparser, cffi, cryptography, tzlocal, gunicorn, pytzdata, pendulum, apache-airflow
Successfully installed Babel-2.9.0 Flask-Babel-1.0.0 Flask-JWT-Extended-3.25.0 Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.4 Mako-1.1.3 PyJWT-1.7.1 PyYAML-5.3.1 WTForms-2.3.3 alembic-1.4.3 apache-airflow-2.0.0 apache-airflow-providers-ftp-1.0.0rc1 apache-airflow-providers-http-1.0.0rc1 apache-airflow-providers-imap-1.0.0rc1 apache-airflow-providers-sqlite-1.0.0rc1 apispec-3.3.2 argcomplete-1.12.2 attrs-20.3.0 cached-property-1.5.2 cattrs-1.1.2 certifi-2020.12.5 cffi-1.14.4 chardet-3.0.4 click-7.1.2 clickclick-20.10.2 colorama-0.4.4 colorlog-4.0.2 commonmark-0.9.1 connexion-2.7.0 croniter-0.3.36 cryptography-3.3.1 defusedxml-0.6.0 dill-0.3.3 dnspython-2.0.0 docutils-0.16 email-validator-1.1.2 flask-1.1.2 flask-appbuilder-3.1.1 flask-caching-1.9.0 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.3 funcsigs-1.0.2 graphviz-0.15 gunicorn-19.10.0 idna-2.10 importlib-resources-1.5.0 inflection-0.5.1 iso8601-0.1.13 itsdangerous-1.1.0 jinja2-2.11.2 json-merge-patch-0.2 jsonschema-3.2.0 lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-3.3.3 markupsafe-1.1.1 marshmallow-3.9.1 marshmallow-enum-1.5.1 marshmallow-oneofschema-2.1.0 marshmallow-sqlalchemy-0.23.1 natsort-7.1.0 numpy-1.19.4 openapi-spec-validator-0.2.9 pandas-1.1.5 pendulum-2.1.2 prison-0.1.3 psutil-5.7.3 pycparser-2.20 pygments-2.7.3 pyrsistent-0.17.3 python-daemon-2.2.4 python-dateutil-2.8.1 python-editor-1.0.4 python-nvd3-0.15.0 python-slugify-4.0.1 python3-openid-3.2.0 pytz-2020.4 pytzdata-2020.1 requests-2.23.0 rich-9.2.0 setproctitle-1.2.1 six-1.15.0 sqlalchemy-1.3.20 sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.8 swagger-ui-bundle-0.0.8 tabulate-0.8.7 tenacity-6.2.0 termcolor-1.1.0 text-unidecode-1.3 thrift-0.13.0 typing-extensions-3.7.4.3 tzlocal-1.5.1 unicodecsv-0.14.1 urllib3-1.25.11 werkzeug-1.0.1
@potiuk is it expected that docs link from airflow ui is broken? maybe expected if v2 not released
@potiuk is it expected that docs link from airflow ui is broken? maybe expected if v2 not released
Yeah, that's expected until 2.0.0 is released and we publish the docs
Ahhh - it's not using the wheel because you gave it an explicit URL :)
Yeah! So this is not a common thing :)
@ashb are 'dynamic dags' (ie https://bigdata-etl.com/apache-airflow-create-dynamic-dag/ but with a single .py creating many different dagids) supported with fully serialized dags (ie scheduler reading from the db instead of parsing the .py)?
I haven't explicilty tested that case, but yes should be -- the scheduler loop never touches DAG files itself; it only uses the database.
v2.0.0rc1