apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
37.29k stars 14.34k forks source link

No such file or directory: '/usr/local/lib/python3.9/site-packages/airflow/customized_form_field_behaviours.schema.json' #13027

Closed tooptoop4 closed 3 years ago

tooptoop4 commented 3 years ago

v2.0.0rc1

airflow db init
DB: sqlite:////Users/red/airflow/airflow.db
[2020-12-12 00:33:02,036] {db.py:678} INFO - Creating tables
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.9/site-packages/airflow/__main__.py", line 40, in main
    args.func(args)
  File "/usr/local/lib/python3.9/site-packages/airflow/cli/cli_parser.py", line 48, in command
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/airflow/cli/commands/db_command.py", line 31, in initdb
    db.initdb()
  File "/usr/local/lib/python3.9/site-packages/airflow/utils/db.py", line 549, in initdb
    upgradedb()
  File "/usr/local/lib/python3.9/site-packages/airflow/utils/db.py", line 688, in upgradedb
    command.upgrade(config, 'heads')
  File "/usr/local/lib/python3.9/site-packages/alembic/command.py", line 298, in upgrade
    script.run_env()
  File "/usr/local/lib/python3.9/site-packages/alembic/script/base.py", line 489, in run_env
    util.load_python_file(self.dir, "env.py")
  File "/usr/local/lib/python3.9/site-packages/alembic/util/pyfiles.py", line 98, in load_python_file
    module = load_module_py(module_id, path)
  File "/usr/local/lib/python3.9/site-packages/alembic/util/compat.py", line 184, in load_module_py
    spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/usr/local/lib/python3.9/site-packages/airflow/migrations/env.py", line 108, in <module>
    run_migrations_online()
  File "/usr/local/lib/python3.9/site-packages/airflow/migrations/env.py", line 102, in run_migrations_online
    context.run_migrations()
  File "<string>", line 8, in run_migrations
  File "/usr/local/lib/python3.9/site-packages/alembic/runtime/environment.py", line 846, in run_migrations
    self.get_context().run_migrations(**kw)
  File "/usr/local/lib/python3.9/site-packages/alembic/runtime/migration.py", line 511, in run_migrations
    for step in self._migrations_fn(heads, self):
  File "/usr/local/lib/python3.9/site-packages/alembic/command.py", line 287, in upgrade
    return script._upgrade_revs(revision, rev)
  File "/usr/local/lib/python3.9/site-packages/alembic/script/base.py", line 364, in _upgrade_revs
    revs = list(revs)
  File "/usr/local/lib/python3.9/site-packages/alembic/script/revision.py", line 777, in _iterate_revisions
    uppers = util.dedupe_tuple(self.get_revisions(upper))
  File "/usr/local/lib/python3.9/site-packages/alembic/script/revision.py", line 321, in get_revisions
    resolved_id, branch_label = self._resolve_revision_number(id_)
  File "/usr/local/lib/python3.9/site-packages/alembic/script/revision.py", line 501, in _resolve_revision_number
    self._revision_map
  File "/usr/local/lib/python3.9/site-packages/alembic/util/langhelpers.py", line 230, in __get__
    obj.__dict__[self.__name__] = result = self.fget(obj)
  File "/usr/local/lib/python3.9/site-packages/alembic/script/revision.py", line 123, in _revision_map
    for revision in self._generator():
  File "/usr/local/lib/python3.9/site-packages/alembic/script/base.py", line 112, in _load_revisions
    script = Script._from_filename(self, vers, file_)
  File "/usr/local/lib/python3.9/site-packages/alembic/script/base.py", line 906, in _from_filename
    module = util.load_python_file(dir_, filename)
  File "/usr/local/lib/python3.9/site-packages/alembic/util/pyfiles.py", line 98, in load_python_file
    module = load_module_py(module_id, path)
  File "/usr/local/lib/python3.9/site-packages/alembic/util/compat.py", line 184, in load_module_py
    spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/usr/local/lib/python3.9/site-packages/airflow/migrations/versions/2c6edca13270_resource_based_permissions.py", line 27, in <module>
    from airflow.www.app import create_app
  File "/usr/local/lib/python3.9/site-packages/airflow/www/app.py", line 38, in <module>
    from airflow.www.extensions.init_views import (
  File "/usr/local/lib/python3.9/site-packages/airflow/www/extensions/init_views.py", line 29, in <module>
    from airflow.www.views import lazy_add_provider_discovered_options_to_connection_form
  File "/usr/local/lib/python3.9/site-packages/airflow/www/views.py", line 2836, in <module>
    class ConnectionFormWidget(FormWidget):
  File "/usr/local/lib/python3.9/site-packages/airflow/www/views.py", line 2839, in ConnectionFormWidget
    field_behaviours = json.dumps(ProvidersManager().field_behaviours)
  File "/usr/local/lib/python3.9/site-packages/airflow/providers_manager.py", line 111, in __init__
    _create_customized_form_field_behaviours_schema_validator()
  File "/usr/local/lib/python3.9/site-packages/airflow/providers_manager.py", line 53, in _create_customized_form_field_behaviours_schema_validator
    importlib_resources.read_text('airflow', 'customized_form_field_behaviours.schema.json')
  File "/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/lib/python3.9/importlib/resources.py", line 139, in read_text
    with open_text(package, resource, encoding, errors) as fp:
  File "/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/lib/python3.9/importlib/resources.py", line 121, in open_text
    open_binary(package, resource), encoding=encoding, errors=errors)
  File "/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/lib/python3.9/importlib/resources.py", line 91, in open_binary
    return reader.open_resource(resource)
  File "<frozen importlib._bootstrap_external>", line 995, in open_resource
FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/lib/python3.9/site-packages/airflow/customized_form_field_behaviours.schema.json'
potiuk commented 3 years ago

First of all - python 3.9 is not officially supported yet. But I think I need more information.

Did you install airlfow with sdist package?

@ashb @kaxil - I just checked and it looks like unlike .whl package, the .tar.gz does not contain customized_form_field_behaviours.schema.json. I looked at it and seems that while it is in setup.cfg, it is missing in MANIFEST.in. I will fix it now, but I think this might be a reason to call for rc2

potiuk commented 3 years ago

Thanks @tooptoop4 for raising - can you please tell us why you have used sdist not wheel ? What was the reason ?

tooptoop4 commented 3 years ago

@potiuk I just did python3 -m pip install https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz. I am using MacOs BigSur 11.0.1

install log

Collecting https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz
  Using cached https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz (3.9 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
    Preparing wheel metadata ... done
Collecting psutil<6.0.0,>=4.2.0
  Using cached psutil-5.7.3.tar.gz (465 kB)
Collecting rich==9.2.0
  Using cached rich-9.2.0-py3-none-any.whl (164 kB)
Processing /Users/red/Library/Caches/pip/wheels/e0/19/6f/6ba857621f50dc08e084312746ed3ebc14211ba30037d5e44e/MarkupSafe-1.1.1-py3-none-any.whl
Collecting argcomplete~=1.10
  Using cached argcomplete-1.12.2-py2.py3-none-any.whl (38 kB)
Collecting croniter<0.4,>=0.3.17
  Using cached croniter-0.3.36-py2.py3-none-any.whl (13 kB)
Collecting attrs<21.0,>=20.0
  Using cached attrs-20.3.0-py2.py3-none-any.whl (49 kB)
Processing /Users/red/Library/Caches/pip/wheels/c9/c7/29/3cf0033406b18958d1a7b107c38be2405ef9c081b64a264fd5/pendulum-2.1.2-cp39-cp39-macosx_10_16_x86_64.whl
Processing /Users/red/Library/Caches/pip/wheels/84/5b/00/3ebff44b1e0a380d959960828803a9486ff2433728cceff666/python_slugify-4.0.1-py2.py3-none-any.whl
Collecting python-daemon>=2.1.1
  Using cached python_daemon-2.2.4-py2.py3-none-any.whl (35 kB)
Processing /Users/red/Library/Caches/pip/wheels/65/af/f4/03ed4648690aa67bc7aca3c61e9bc0ef94ee1798008ca60167/json_merge_patch-0.2-py3-none-any.whl
Collecting jinja2<2.12.0,>=2.10.1
  Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting sqlalchemy<2,>=1.3.18
  Using cached SQLAlchemy-1.3.20-cp39-cp39-macosx_10_14_x86_64.whl (1.2 MB)
Collecting dill<0.4,>=0.2.2
  Using cached dill-0.3.3-py2.py3-none-any.whl (81 kB)
Collecting sqlalchemy-jsonfield~=0.9
  Using cached SQLAlchemy_JSONField-0.9.0-py2.py3-none-any.whl (10 kB)
Collecting marshmallow-oneofschema>=2.0.1
  Using cached marshmallow_oneofschema-2.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting pandas<2.0,>=0.17.1
  Using cached pandas-1.1.5-cp39-cp39-macosx_10_9_x86_64.whl (10.3 MB)
Collecting cryptography>=0.9.3
  Using cached cryptography-3.3.1-cp36-abi3-macosx_10_10_x86_64.whl (1.8 MB)
Collecting urllib3<1.26
  Using cached urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting apache-airflow-providers-imap
  Using cached apache_airflow_providers_imap-1.0.0rc1-py3-none-any.whl (18 kB)
Collecting requests<2.24.0,>=2.20.0
  Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB)
Collecting funcsigs<2.0.0,>=1.0.0
  Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting setproctitle<2,>=1.1.8
  Using cached setproctitle-1.2.1.tar.gz (23 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Processing /Users/red/Library/Caches/pip/wheels/7d/2a/d3/9b83608fd158b23f4d04b92572b93ab2d643faa2a3c46b6f34/tzlocal-1.5.1-py3-none-any.whl
Collecting flask-appbuilder~=3.1.1
  Using cached Flask_AppBuilder-3.1.1-py3-none-any.whl (1.7 MB)
Collecting flask<2.0,>=1.1.0
  Using cached Flask-1.1.2-py2.py3-none-any.whl (94 kB)
Collecting apache-airflow-providers-sqlite
  Using cached apache_airflow_providers_sqlite-1.0.0rc1-py3-none-any.whl (15 kB)
Processing /Users/red/Library/Caches/pip/wheels/b6/0d/90/0d1bbd99855f99cb2f6c2e5ff96f8023fad8ec367695f7d72d/termcolor-1.1.0-py3-none-any.whl
Collecting apache-airflow-providers-ftp
  Using cached apache_airflow_providers_ftp-1.0.0rc1-py3-none-any.whl (17 kB)
Collecting markdown<4.0,>=2.5.2
  Using cached Markdown-3.3.3-py3-none-any.whl (96 kB)
Processing /Users/red/Library/Caches/pip/wheels/60/e8/21/19a3dcfe90e8895952857d42152663fafc5a90d87d3dfe5f58/python_nvd3-0.15.0-py3-none-any.whl
Collecting python-dateutil<3,>=2.3
  Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting iso8601>=0.1.12
  Using cached iso8601-0.1.13-py2.py3-none-any.whl (9.3 kB)
Collecting importlib-resources~=1.4
  Using cached importlib_resources-1.5.0-py2.py3-none-any.whl (21 kB)
Collecting pygments<3.0,>=2.0.1
  Using cached Pygments-2.7.3-py3-none-any.whl (950 kB)
Processing /Users/red/Library/Caches/pip/wheels/41/20/07/2a3e02cdfc8b442404202f6ef99ff1b1c16b73910968a46f2f/lazy_object_proxy-1.4.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting lockfile>=0.12.2
  Using cached lockfile-0.12.2-py2.py3-none-any.whl (13 kB)
Processing /Users/red/Library/Caches/pip/wheels/d8/c8/27/b237d3378d5c9ed25c2c63d9af1b3d5ccb99934f3dd030de87/unicodecsv-0.14.1-py3-none-any.whl
Collecting apache-airflow-providers-http
  Using cached apache_airflow_providers_http-1.0.0rc1-py3-none-any.whl (24 kB)
Collecting cached-property~=1.5
  Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Processing /Users/red/Library/Caches/pip/wheels/39/10/74/d68194e28d5f7a83de5f66e5b2deff5ccbb424fe45e6b0e927/Flask_Login-0.4.1-py2.py3-none-any.whl
Collecting colorlog==4.0.2
  Using cached colorlog-4.0.2-py2.py3-none-any.whl (17 kB)
Collecting graphviz>=0.12
  Using cached graphviz-0.15-py2.py3-none-any.whl (18 kB)
Collecting itsdangerous>=1.1.0
  Using cached itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
Processing /Users/red/Library/Caches/pip/wheels/9d/e0/b1/225035529ebb2074662c2a80950ea25132c7b6c5aff925aaab/flask_swagger-0.2.13-py3-none-any.whl
Collecting jsonschema~=3.0
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Processing /Users/red/Library/Caches/pip/wheels/a3/18/80/a9b97f8e0dddb23be3e79f2209dfa3cd6292e1e42bd210a068/thrift-0.13.0-py3-none-any.whl
Collecting connexion[flask,swagger-ui]<3,>=2.6.0
  Using cached connexion-2.7.0-py2.py3-none-any.whl (77 kB)
Collecting gunicorn<20.0,>=19.5.0
  Using cached gunicorn-19.10.0-py2.py3-none-any.whl (113 kB)
Collecting tenacity~=6.2.0
  Using cached tenacity-6.2.0-py2.py3-none-any.whl (24 kB)
Collecting werkzeug>=1.0.1,~=1.0
  Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting flask-caching<2.0.0,>=1.5.0
  Using cached Flask_Caching-1.9.0-py2.py3-none-any.whl (33 kB)
Collecting cattrs<2.0,>=1.0; python_version > "3.6"
  Using cached cattrs-1.1.2-py3-none-any.whl (17 kB)
Collecting flask-wtf<0.15,>=0.14.3
  Using cached Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB)
Collecting tabulate<0.9,>=0.7.5
  Using cached tabulate-0.8.7-py3-none-any.whl (24 kB)
Collecting alembic<2.0,>=1.2
  Using cached alembic-1.4.3-py2.py3-none-any.whl (159 kB)
Collecting colorama<0.5.0,>=0.4.0
  Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting commonmark<0.10.0,>=0.9.0
  Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
Collecting typing-extensions<4.0.0,>=3.7.4
  Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting natsort
  Using cached natsort-7.1.0-py3-none-any.whl (35 kB)
Collecting pytzdata>=2020.1
  Using cached pytzdata-2020.1-py2.py3-none-any.whl (489 kB)
Collecting text-unidecode>=1.3
  Using cached text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
Collecting docutils
  Using cached docutils-0.16-py2.py3-none-any.whl (548 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.9/site-packages (from python-daemon>=2.1.1->apache-airflow==2.0.0) (50.3.2)
Collecting marshmallow<4.0.0,>=3.0.0rc6
  Using cached marshmallow-3.9.1-py2.py3-none-any.whl (46 kB)
Collecting numpy>=1.15.4
  Using cached numpy-1.19.4-cp39-cp39-macosx_10_9_x86_64.whl (15.4 MB)
Collecting pytz>=2017.2
  Using cached pytz-2020.4-py2.py3-none-any.whl (509 kB)
Collecting cffi>=1.12
  Using cached cffi-1.14.4-cp39-cp39-macosx_10_9_x86_64.whl (177 kB)
Collecting six>=1.4.1
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
  Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting marshmallow-enum<2,>=1.5.1
  Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting Flask-SQLAlchemy<3,>=2.4
  Using cached Flask_SQLAlchemy-2.4.4-py2.py3-none-any.whl (17 kB)
Collecting prison<1.0.0,>=0.1.3
  Using cached prison-0.1.3-py2.py3-none-any.whl (5.8 kB)
Collecting Flask-Babel<2,>=1
  Using cached Flask_Babel-1.0.0-py3-none-any.whl (9.5 kB)
Processing /Users/red/Library/Caches/pip/wheels/ed/05/31/972024d2446f785e62227cb1d07cfb816fcfbc2e759afc2caa/Flask_JWT_Extended-3.25.0-py2.py3-none-any.whl
Collecting apispec[yaml]<4,>=3.3
  Using cached apispec-3.3.2-py2.py3-none-any.whl (27 kB)
Collecting marshmallow-sqlalchemy<0.24.0,>=0.22.0
  Using cached marshmallow_sqlalchemy-0.23.1-py2.py3-none-any.whl (18 kB)
Processing /Users/red/Library/Caches/pip/wheels/cc/a9/ec/d14efb7a25128ae89ce3fc5545dac6016306e75e60d6f0e499/SQLAlchemy_Utils-0.36.8-py2.py3-none-any.whl
Collecting PyJWT>=1.7.1
  Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB)
Collecting email-validator<2,>=1.0.5
  Using cached email_validator-1.1.2-py2.py3-none-any.whl (17 kB)
Collecting click<8,>=6.7
  Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Processing /Users/red/Library/Caches/pip/wheels/74/23/d8/1cd6aaca32ab6ca7cd44c015314e26421b9e38288424d2ac86/Flask_OpenID-1.2.5-py3-none-any.whl
Processing /Users/red/Library/Caches/pip/wheels/69/60/81/5cd74b8ee068fbe9e04ca0d53148f28f5c6e2c5b177d5dd622/PyYAML-5.3.1-cp39-cp39-macosx_10_13_x86_64.whl
Processing /Users/red/Library/Caches/pip/wheels/00/cc/12/e712d3979a4aeee423b34a832d97c803e1a67659060315a7e0/pyrsistent-0.17.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting inflection>=0.3.1
  Using cached inflection-0.5.1-py2.py3-none-any.whl (9.5 kB)
Collecting openapi-spec-validator>=0.2.4
  Using cached openapi_spec_validator-0.2.9-py3-none-any.whl (25 kB)
Collecting clickclick>=1.2
  Using cached clickclick-20.10.2-py2.py3-none-any.whl (7.4 kB)
Collecting swagger-ui-bundle>=0.0.2; extra == "swagger-ui"
  Using cached swagger_ui_bundle-0.0.8-py3-none-any.whl (3.8 MB)
Collecting WTForms
  Using cached WTForms-2.3.3-py2.py3-none-any.whl (169 kB)
Collecting Mako
  Using cached Mako-1.1.3-py2.py3-none-any.whl (75 kB)
Collecting python-editor>=0.3
  Using cached python_editor-1.0.4-py3-none-any.whl (4.9 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting Babel>=2.3
  Using cached Babel-2.9.0-py2.py3-none-any.whl (8.8 MB)
Collecting dnspython>=1.15.0
  Using cached dnspython-2.0.0-py3-none-any.whl (208 kB)
Collecting python3-openid>=2.0
  Using cached python3_openid-3.2.0-py3-none-any.whl (133 kB)
Collecting defusedxml
  Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Building wheels for collected packages: apache-airflow, psutil, setproctitle
  Building wheel for apache-airflow (PEP 517) ... done
  Created wheel for apache-airflow: filename=apache_airflow-2.0.0-py3-none-any.whl size=4534581 sha256=e4120d6dccf71abb111ed61b0b92a50b3e5dcf0e270b373661ce591753287309
  Stored in directory: /Users/red/Library/Caches/pip/wheels/76/97/35/50763af952754717d6174a23d13b9c3cd5eb2613929867f138
  Building wheel for psutil (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /usr/local/opt/python@3.9/bin/python3.9 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/psutil/setup.py'"'"'; __file__='"'"'/private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/psutil/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-wheel-p8qmqntf
       cwd: /private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/psutil/
  Complete output (44 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-10.13-x86_64-3.9
  creating build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_pswindows.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_common.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/__init__.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_psosx.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_psbsd.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_psaix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_pslinux.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_compat.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_psposix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  copying psutil/_pssunos.py -> build/lib.macosx-10.13-x86_64-3.9/psutil
  creating build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_contracts.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_connections.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/runner.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_unicode.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_misc.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_posix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_linux.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_sunos.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/__init__.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_aix.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_process.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_bsd.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_system.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_osx.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_memleaks.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_windows.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/__main__.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  copying psutil/tests/test_testutils.py -> build/lib.macosx-10.13-x86_64-3.9/psutil/tests
  running build_ext
  building 'psutil._psutil_osx' extension
  creating build/temp.macosx-10.13-x86_64-3.9
  creating build/temp.macosx-10.13-x86_64-3.9/psutil
  creating build/temp.macosx-10.13-x86_64-3.9/psutil/arch
  creating build/temp.macosx-10.13-x86_64-3.9/psutil/arch/osx
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=573 -DPSUTIL_OSX=1 -I/usr/local/include -I/usr/local/opt/openssl@1.1/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/include/python3.9 -c psutil/_psutil_common.c -o build/temp.macosx-10.13-x86_64-3.9/psutil/_psutil_common.o
  xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
  error: command '/usr/bin/clang' failed with exit code 1
  ----------------------------------------
  ERROR: Failed building wheel for psutil
  Running setup.py clean for psutil
  Building wheel for setproctitle (PEP 517) ... error
  ERROR: Command errored out with exit status 1:
   command: /usr/local/opt/python@3.9/bin/python3.9 /usr/local/lib/python3.9/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/tmp_o54t5ty
       cwd: /private/var/folders/zw/s60n9tbn5fq44x8crdxv0cbm0000gn/T/pip-install-0rtsrya_/setproctitle
  Complete output (10 lines):
  running bdist_wheel
  running build
  running build_ext
  building 'setproctitle' extension
  creating build
  creating build/temp.macosx-10.13-x86_64-3.9
  creating build/temp.macosx-10.13-x86_64-3.9/src
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -DSPT_VERSION=1.2.1 -D__darwin__=1 -I/usr/local/include -I/usr/local/opt/openssl@1.1/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python@3.9/3.9.0_2/Frameworks/Python.framework/Versions/3.9/include/python3.9 -c src/setproctitle.c -o build/temp.macosx-10.13-x86_64-3.9/src/setproctitle.o
  xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
  error: command '/usr/bin/clang' failed with exit code 1
  ----------------------------------------
  ERROR: Failed building wheel for setproctitle
Successfully built apache-airflow
Failed to build psutil setproctitle
ERROR: Could not build wheels for setproctitle which use PEP 517 and cannot be installed directly

rerun after xcode-select --install; sudo xcode-select -s /Library/Developer/CommandLineTools

Collecting https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz
  Using cached https://dist.apache.org/repos/dist/dev/airflow/2.0.0rc1/apache-airflow-2.0.0rc1-bin.tar.gz (3.9 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
    Preparing wheel metadata ... done
Collecting apache-airflow-providers-ftp
  Using cached apache_airflow_providers_ftp-1.0.0rc1-py3-none-any.whl (17 kB)
Processing /Users/red/Library/Caches/pip/wheels/9d/e0/b1/225035529ebb2074662c2a80950ea25132c7b6c5aff925aaab/flask_swagger-0.2.13-py3-none-any.whl
Collecting graphviz>=0.12
  Using cached graphviz-0.15-py2.py3-none-any.whl (18 kB)
Collecting jinja2<2.12.0,>=2.10.1
  Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting argcomplete~=1.10
  Using cached argcomplete-1.12.2-py2.py3-none-any.whl (38 kB)
Collecting python-dateutil<3,>=2.3
  Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting rich==9.2.0
  Using cached rich-9.2.0-py3-none-any.whl (164 kB)
Collecting sqlalchemy-jsonfield~=0.9
  Using cached SQLAlchemy_JSONField-0.9.0-py2.py3-none-any.whl (10 kB)
Collecting flask-appbuilder~=3.1.1
  Using cached Flask_AppBuilder-3.1.1-py3-none-any.whl (1.7 MB)
Processing /Users/red/Library/Caches/pip/wheels/84/5b/00/3ebff44b1e0a380d959960828803a9486ff2433728cceff666/python_slugify-4.0.1-py2.py3-none-any.whl
Collecting sqlalchemy<2,>=1.3.18
  Using cached SQLAlchemy-1.3.20-cp39-cp39-macosx_10_14_x86_64.whl (1.2 MB)
Processing /Users/red/Library/Caches/pip/wheels/65/af/f4/03ed4648690aa67bc7aca3c61e9bc0ef94ee1798008ca60167/json_merge_patch-0.2-py3-none-any.whl
Processing /Users/red/Library/Caches/pip/wheels/a3/18/80/a9b97f8e0dddb23be3e79f2209dfa3cd6292e1e42bd210a068/thrift-0.13.0-py3-none-any.whl
Collecting apache-airflow-providers-http
  Using cached apache_airflow_providers_http-1.0.0rc1-py3-none-any.whl (24 kB)
Collecting werkzeug>=1.0.1,~=1.0
  Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting markdown<4.0,>=2.5.2
  Using cached Markdown-3.3.3-py3-none-any.whl (96 kB)
Collecting itsdangerous>=1.1.0
  Using cached itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting iso8601>=0.1.12
  Using cached iso8601-0.1.13-py2.py3-none-any.whl (9.3 kB)
Processing /Users/red/Library/Caches/pip/wheels/41/20/07/2a3e02cdfc8b442404202f6ef99ff1b1c16b73910968a46f2f/lazy_object_proxy-1.4.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting pygments<3.0,>=2.0.1
  Using cached Pygments-2.7.3-py3-none-any.whl (950 kB)
Collecting croniter<0.4,>=0.3.17
  Using cached croniter-0.3.36-py2.py3-none-any.whl (13 kB)
Collecting colorlog==4.0.2
  Using cached colorlog-4.0.2-py2.py3-none-any.whl (17 kB)
Collecting tenacity~=6.2.0
  Using cached tenacity-6.2.0-py2.py3-none-any.whl (24 kB)
Collecting flask<2.0,>=1.1.0
  Using cached Flask-1.1.2-py2.py3-none-any.whl (94 kB)
Collecting dill<0.4,>=0.2.2
  Using cached dill-0.3.3-py2.py3-none-any.whl (81 kB)
Collecting pandas<2.0,>=0.17.1
  Using cached pandas-1.1.5-cp39-cp39-macosx_10_9_x86_64.whl (10.3 MB)
Collecting apache-airflow-providers-imap
  Using cached apache_airflow_providers_imap-1.0.0rc1-py3-none-any.whl (18 kB)
Processing /Users/red/Library/Caches/pip/wheels/e0/19/6f/6ba857621f50dc08e084312746ed3ebc14211ba30037d5e44e/MarkupSafe-1.1.1-py3-none-any.whl
Collecting python-daemon>=2.1.1
  Using cached python_daemon-2.2.4-py2.py3-none-any.whl (35 kB)
Processing /Users/red/Library/Caches/pip/wheels/b6/0d/90/0d1bbd99855f99cb2f6c2e5ff96f8023fad8ec367695f7d72d/termcolor-1.1.0-py3-none-any.whl
Collecting cattrs<2.0,>=1.0; python_version > "3.6"
  Using cached cattrs-1.1.2-py3-none-any.whl (17 kB)
Collecting marshmallow-oneofschema>=2.0.1
  Using cached marshmallow_oneofschema-2.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting setproctitle<2,>=1.1.8
  Using cached setproctitle-1.2.1.tar.gz (23 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Processing /Users/red/Library/Caches/pip/wheels/d8/c8/27/b237d3378d5c9ed25c2c63d9af1b3d5ccb99934f3dd030de87/unicodecsv-0.14.1-py3-none-any.whl
Collecting lockfile>=0.12.2
  Using cached lockfile-0.12.2-py2.py3-none-any.whl (13 kB)
Collecting importlib-resources~=1.4
  Using cached importlib_resources-1.5.0-py2.py3-none-any.whl (21 kB)
Collecting cached-property~=1.5
  Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Collecting requests<2.24.0,>=2.20.0
  Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB)
Collecting flask-wtf<0.15,>=0.14.3
  Using cached Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB)
Collecting connexion[flask,swagger-ui]<3,>=2.6.0
  Using cached connexion-2.7.0-py2.py3-none-any.whl (77 kB)
Collecting jsonschema~=3.0
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Processing /Users/red/Library/Caches/pip/wheels/60/e8/21/19a3dcfe90e8895952857d42152663fafc5a90d87d3dfe5f58/python_nvd3-0.15.0-py3-none-any.whl
Collecting tabulate<0.9,>=0.7.5
  Using cached tabulate-0.8.7-py3-none-any.whl (24 kB)
Collecting alembic<2.0,>=1.2
  Using cached alembic-1.4.3-py2.py3-none-any.whl (159 kB)
Collecting flask-caching<2.0.0,>=1.5.0
  Using cached Flask_Caching-1.9.0-py2.py3-none-any.whl (33 kB)
Collecting attrs<21.0,>=20.0
  Using cached attrs-20.3.0-py2.py3-none-any.whl (49 kB)
Collecting urllib3<1.26
  Using cached urllib3-1.25.11-py2.py3-none-any.whl (127 kB)
Collecting funcsigs<2.0.0,>=1.0.0
  Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting apache-airflow-providers-sqlite
  Using cached apache_airflow_providers_sqlite-1.0.0rc1-py3-none-any.whl (15 kB)
Collecting psutil<6.0.0,>=4.2.0
  Using cached psutil-5.7.3.tar.gz (465 kB)
Collecting cryptography>=0.9.3
  Using cached cryptography-3.3.1-cp36-abi3-macosx_10_10_x86_64.whl (1.8 MB)
Processing /Users/red/Library/Caches/pip/wheels/7d/2a/d3/9b83608fd158b23f4d04b92572b93ab2d643faa2a3c46b6f34/tzlocal-1.5.1-py3-none-any.whl
Collecting gunicorn<20.0,>=19.5.0
  Using cached gunicorn-19.10.0-py2.py3-none-any.whl (113 kB)
Processing /Users/red/Library/Caches/pip/wheels/39/10/74/d68194e28d5f7a83de5f66e5b2deff5ccbb424fe45e6b0e927/Flask_Login-0.4.1-py2.py3-none-any.whl
Processing /Users/red/Library/Caches/pip/wheels/c9/c7/29/3cf0033406b18958d1a7b107c38be2405ef9c081b64a264fd5/pendulum-2.1.2-cp39-cp39-macosx_10_16_x86_64.whl
Processing /Users/red/Library/Caches/pip/wheels/69/60/81/5cd74b8ee068fbe9e04ca0d53148f28f5c6e2c5b177d5dd622/PyYAML-5.3.1-cp39-cp39-macosx_10_13_x86_64.whl
Collecting six>=1.5
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting colorama<0.5.0,>=0.4.0
  Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting commonmark<0.10.0,>=0.9.0
  Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
Collecting typing-extensions<4.0.0,>=3.7.4
  Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Processing /Users/red/Library/Caches/pip/wheels/74/23/d8/1cd6aaca32ab6ca7cd44c015314e26421b9e38288424d2ac86/Flask_OpenID-1.2.5-py3-none-any.whl
Collecting click<8,>=6.7
  Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Processing /Users/red/Library/Caches/pip/wheels/ed/05/31/972024d2446f785e62227cb1d07cfb816fcfbc2e759afc2caa/Flask_JWT_Extended-3.25.0-py2.py3-none-any.whl
Collecting email-validator<2,>=1.0.5
  Using cached email_validator-1.1.2-py2.py3-none-any.whl (17 kB)
Collecting marshmallow-sqlalchemy<0.24.0,>=0.22.0
  Using cached marshmallow_sqlalchemy-0.23.1-py2.py3-none-any.whl (18 kB)
Collecting PyJWT>=1.7.1
  Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB)
Processing /Users/red/Library/Caches/pip/wheels/cc/a9/ec/d14efb7a25128ae89ce3fc5545dac6016306e75e60d6f0e499/SQLAlchemy_Utils-0.36.8-py2.py3-none-any.whl
Collecting marshmallow<4,>=3
  Using cached marshmallow-3.9.1-py2.py3-none-any.whl (46 kB)
Collecting prison<1.0.0,>=0.1.3
  Using cached prison-0.1.3-py2.py3-none-any.whl (5.8 kB)
Collecting marshmallow-enum<2,>=1.5.1
  Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting apispec[yaml]<4,>=3.3
  Using cached apispec-3.3.2-py2.py3-none-any.whl (27 kB)
Collecting Flask-SQLAlchemy<3,>=2.4
  Using cached Flask_SQLAlchemy-2.4.4-py2.py3-none-any.whl (17 kB)
Collecting Flask-Babel<2,>=1
  Using cached Flask_Babel-1.0.0-py3-none-any.whl (9.5 kB)
Collecting text-unidecode>=1.3
  Using cached text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
Collecting natsort
  Using cached natsort-7.1.0-py3-none-any.whl (35 kB)
Collecting numpy>=1.15.4
  Using cached numpy-1.19.4-cp39-cp39-macosx_10_9_x86_64.whl (15.4 MB)
Collecting pytz>=2017.2
  Using cached pytz-2020.4-py2.py3-none-any.whl (509 kB)
Collecting docutils
  Using cached docutils-0.16-py2.py3-none-any.whl (548 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.9/site-packages (from python-daemon>=2.1.1->apache-airflow==2.0.0) (50.3.2)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
  Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting WTForms
  Using cached WTForms-2.3.3-py2.py3-none-any.whl (169 kB)
Collecting clickclick>=1.2
  Using cached clickclick-20.10.2-py2.py3-none-any.whl (7.4 kB)
Collecting inflection>=0.3.1
  Using cached inflection-0.5.1-py2.py3-none-any.whl (9.5 kB)
Collecting openapi-spec-validator>=0.2.4
  Using cached openapi_spec_validator-0.2.9-py3-none-any.whl (25 kB)
Collecting swagger-ui-bundle>=0.0.2; extra == "swagger-ui"
  Using cached swagger_ui_bundle-0.0.8-py3-none-any.whl (3.8 MB)
Processing /Users/red/Library/Caches/pip/wheels/00/cc/12/e712d3979a4aeee423b34a832d97c803e1a67659060315a7e0/pyrsistent-0.17.3-cp39-cp39-macosx_10_13_x86_64.whl
Collecting Mako
  Using cached Mako-1.1.3-py2.py3-none-any.whl (75 kB)
Collecting python-editor>=0.3
  Using cached python_editor-1.0.4-py3-none-any.whl (4.9 kB)
Collecting cffi>=1.12
  Using cached cffi-1.14.4-cp39-cp39-macosx_10_9_x86_64.whl (177 kB)
Collecting pytzdata>=2020.1
  Using cached pytzdata-2020.1-py2.py3-none-any.whl (489 kB)
Collecting python3-openid>=2.0
  Using cached python3_openid-3.2.0-py3-none-any.whl (133 kB)
Collecting dnspython>=1.15.0
  Using cached dnspython-2.0.0-py3-none-any.whl (208 kB)
Collecting Babel>=2.3
  Using cached Babel-2.9.0-py2.py3-none-any.whl (8.8 MB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting defusedxml
  Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB)
Building wheels for collected packages: apache-airflow, setproctitle, psutil
  Building wheel for apache-airflow (PEP 517) ... done
  Created wheel for apache-airflow: filename=apache_airflow-2.0.0-py3-none-any.whl size=4534593 sha256=21b93d868b34f4abba95e1047f12fe81ff588d23e1ac828ba38ed565e196f2ec
  Stored in directory: /Users/red/Library/Caches/pip/wheels/76/97/35/50763af952754717d6174a23d13b9c3cd5eb2613929867f138
  Building wheel for setproctitle (PEP 517) ... done
  Created wheel for setproctitle: filename=setproctitle-1.2.1-cp39-cp39-macosx_10_13_x86_64.whl size=10731 sha256=bb8ed9af1e325202256ecce92369f12a17e022a9806a5e6120c376a492e23d24
  Stored in directory: /Users/red/Library/Caches/pip/wheels/c3/e4/78/85a456b48a3f8ecd33b4cd1b1dfd3ec0ac25ae6d498a86bf65
  Building wheel for psutil (setup.py) ... done
  Created wheel for psutil: filename=psutil-5.7.3-cp39-cp39-macosx_10_13_x86_64.whl size=234700 sha256=48dca63d6b15fc55d7b9fc112e39a12debc1388233535aa73a708e35d2fc984e
  Stored in directory: /Users/red/Library/Caches/pip/wheels/76/43/53/a0fed7ed0582fd7b0b3032a6703bd498bc6397d4217e88a9ce
Successfully built apache-airflow setproctitle psutil
Installing collected packages: apache-airflow-providers-ftp, click, markupsafe, jinja2, itsdangerous, werkzeug, flask, PyYAML, flask-swagger, graphviz, argcomplete, six, python-dateutil, colorama, commonmark, pygments, typing-extensions, rich, sqlalchemy, sqlalchemy-jsonfield, defusedxml, python3-openid, Flask-OpenID, PyJWT, Flask-JWT-Extended, WTForms, flask-wtf, dnspython, idna, email-validator, marshmallow, marshmallow-sqlalchemy, pyrsistent, attrs, jsonschema, sqlalchemy-utils, prison, marshmallow-enum, apispec, Flask-SQLAlchemy, pytz, Babel, Flask-Babel, flask-login, flask-appbuilder, text-unidecode, python-slugify, json-merge-patch, thrift, apache-airflow-providers-http, markdown, iso8601, lazy-object-proxy, natsort, croniter, colorlog, tenacity, dill, numpy, pandas, apache-airflow-providers-imap, docutils, lockfile, python-daemon, termcolor, cattrs, marshmallow-oneofschema, setproctitle, unicodecsv, importlib-resources, cached-property, urllib3, chardet, certifi, requests, clickclick, inflection, openapi-spec-validator, swagger-ui-bundle, connexion, python-nvd3, tabulate, Mako, python-editor, alembic, flask-caching, funcsigs, apache-airflow-providers-sqlite, psutil, pycparser, cffi, cryptography, tzlocal, gunicorn, pytzdata, pendulum, apache-airflow
Successfully installed Babel-2.9.0 Flask-Babel-1.0.0 Flask-JWT-Extended-3.25.0 Flask-OpenID-1.2.5 Flask-SQLAlchemy-2.4.4 Mako-1.1.3 PyJWT-1.7.1 PyYAML-5.3.1 WTForms-2.3.3 alembic-1.4.3 apache-airflow-2.0.0 apache-airflow-providers-ftp-1.0.0rc1 apache-airflow-providers-http-1.0.0rc1 apache-airflow-providers-imap-1.0.0rc1 apache-airflow-providers-sqlite-1.0.0rc1 apispec-3.3.2 argcomplete-1.12.2 attrs-20.3.0 cached-property-1.5.2 cattrs-1.1.2 certifi-2020.12.5 cffi-1.14.4 chardet-3.0.4 click-7.1.2 clickclick-20.10.2 colorama-0.4.4 colorlog-4.0.2 commonmark-0.9.1 connexion-2.7.0 croniter-0.3.36 cryptography-3.3.1 defusedxml-0.6.0 dill-0.3.3 dnspython-2.0.0 docutils-0.16 email-validator-1.1.2 flask-1.1.2 flask-appbuilder-3.1.1 flask-caching-1.9.0 flask-login-0.4.1 flask-swagger-0.2.13 flask-wtf-0.14.3 funcsigs-1.0.2 graphviz-0.15 gunicorn-19.10.0 idna-2.10 importlib-resources-1.5.0 inflection-0.5.1 iso8601-0.1.13 itsdangerous-1.1.0 jinja2-2.11.2 json-merge-patch-0.2 jsonschema-3.2.0 lazy-object-proxy-1.4.3 lockfile-0.12.2 markdown-3.3.3 markupsafe-1.1.1 marshmallow-3.9.1 marshmallow-enum-1.5.1 marshmallow-oneofschema-2.1.0 marshmallow-sqlalchemy-0.23.1 natsort-7.1.0 numpy-1.19.4 openapi-spec-validator-0.2.9 pandas-1.1.5 pendulum-2.1.2 prison-0.1.3 psutil-5.7.3 pycparser-2.20 pygments-2.7.3 pyrsistent-0.17.3 python-daemon-2.2.4 python-dateutil-2.8.1 python-editor-1.0.4 python-nvd3-0.15.0 python-slugify-4.0.1 python3-openid-3.2.0 pytz-2020.4 pytzdata-2020.1 requests-2.23.0 rich-9.2.0 setproctitle-1.2.1 six-1.15.0 sqlalchemy-1.3.20 sqlalchemy-jsonfield-0.9.0 sqlalchemy-utils-0.36.8 swagger-ui-bundle-0.0.8 tabulate-0.8.7 tenacity-6.2.0 termcolor-1.1.0 text-unidecode-1.3 thrift-0.13.0 typing-extensions-3.7.4.3 tzlocal-1.5.1 unicodecsv-0.14.1 urllib3-1.25.11 werkzeug-1.0.1
tooptoop4 commented 3 years ago

@potiuk is it expected that docs link from airflow ui is broken? maybe expected if v2 not released

ashb commented 3 years ago

@potiuk is it expected that docs link from airflow ui is broken? maybe expected if v2 not released

Yeah, that's expected until 2.0.0 is released and we publish the docs

ashb commented 3 years ago

Ahhh - it's not using the wheel because you gave it an explicit URL :)

potiuk commented 3 years ago

Yeah! So this is not a common thing :)

tooptoop4 commented 3 years ago

@ashb are 'dynamic dags' (ie https://bigdata-etl.com/apache-airflow-create-dynamic-dag/ but with a single .py creating many different dagids) supported with fully serialized dags (ie scheduler reading from the db instead of parsing the .py)?

ashb commented 3 years ago

I haven't explicilty tested that case, but yes should be -- the scheduler loop never touches DAG files itself; it only uses the database.