search

tensorflow / tfx

TFX is an end-to-end platform for deploying production ML pipelines
https://tensorflow.org/tfx
Apache License 2.0
2.11k stars 706 forks source link

Installation instructions in CONTRIBUTING.md fail #3577

Closed aoen closed 3 years ago

aoen commented 3 years ago

System information

Describe the current behavior Currently there is no officially supported environment to install TFX e.g. to run tests/pipelines out of the box since there are no platform-specific setup instructions, and the instructions that are provided for e.g. testing in CONTRIBUTING.md are not complete in some fairly standard environments (see the example below). It would be great if there was some reproducible way to generate or fetch an environment where the TFX tests can run and pass without additional setup.

e.g. following the steps in CONTRIBUTING.md and running the following from the master branch in the TFX repo fails on a fresh Ubuntu 18.04.5 LTS installation with Python 3.7.10 installed:

pip install -e .[all]
  ERROR: Command errored out with exit status 1:
    command: /usr/local/bin/python3.7 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-2ttbt3sg/mysqlclient/setup.py'"'"'; __file__='"'"'/tmp/pip-install-2ttbt3sg/mysqlclient/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-_jmbrsag
        cwd: /tmp/pip-install-2ttbt3sg/mysqlclient/

This can be resolved by running:

sudo apt-get install -y ibmysqlclient-dev default-libmysqlclient-dev

After which there are some other errors that need to be resolved before the pip command works.

I have also had a colleague report installation issues on OSX Catalina 10.15.7 when trying to follow the instructions in CONTRIBUTING.md as well:

export TFX_DEPENDENCY_SELECTOR=NIGHTLY
# the [all] suffix includes additional packages for test
pip install -e .[all] -i https://pypi-nightly.tensorflow.org/simple

Error: Could not find a version that satisfies the requirement struct2tensor<0.29, >=0.28 (from tfx-dev=0.29.0.dev0)

Describe the expected behavior Following the CONTRIBUTION.md docs successfully installs TFX.

Standalone code to reproduce the issue N/A

Name of your Organization (Optional) Twitter Inc

arghyaganguly commented 3 years ago

@aoen , on reproducing using :- pip install -e .[all] on a ubuntu 18.04, python 3.7 system, I received no error.

gist as below -

Obtaining file:///home/odin/tfx
Requirement already satisfied: absl-py<0.13,>=0.9 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.10.0)
Requirement already satisfied: ml-metadata@ git+https://github.com/google/ml-metadata@master from git+https://github.com/google/ml-metadata@master in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: packaging<21,>=20 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (20.4)
Requirement already satisfied: protobuf<4,>=3.12.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (3.14.0)
Requirement already satisfied: six<2,>=1.10 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.15.0)
Requirement already satisfied: docker<5,>=4.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (4.4.0)
Requirement already satisfied: jinja2<3,>=2.7.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.10.3)
Requirement already satisfied: apache-beam[gcp]<3,>=2.28 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.28.0)
Requirement already satisfied: attrs<21,>=19.3.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (19.3.0)
Requirement already satisfied: click<8,>=7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (7.1.2)
Requirement already satisfied: google-api-python-client<2,>=1.7.8 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.12.8)
Requirement already satisfied: google-cloud-aiplatform<0.8,>=0.5.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.7.1)
Requirement already satisfied: grpcio<2,>=1.28.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.32.0)
Requirement already satisfied: keras-tuner<1.0.2,>=1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.0.1)
Requirement already satisfied: kubernetes<12,>=10.0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (11.0.0)
Requirement already satisfied: numpy<1.20,>=1.16 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.19.2)
Requirement already satisfied: pyarrow<3,>=1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.0.0)
Requirement already satisfied: pyyaml<6,>=3.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (5.3.1)
Requirement already satisfied: tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.4.0)
Requirement already satisfied: tensorflow-hub<0.10,>=0.9.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.9.0)
Requirement already satisfied: tensorflow-data-validation@ git+https://github.com/tensorflow/data-validation@master from git+https://github.com/tensorflow/data-validation@master in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master from git+https://github.com/tensorflow/model-analysis@master in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.4.0)
Requirement already satisfied: tensorflow-transform@ git+https://github.com/tensorflow/transform@master from git+https://github.com/tensorflow/transform@master in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: tfx-bsl@ git+https://github.com/tensorflow/tfx-bsl@master from git+https://github.com/tensorflow/tfx-bsl@master in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: apache-airflow[mysql]<3,>=1.10.14 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.0.2)
Requirement already satisfied: sqlalchemy<1.4,>=1.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.3.20)
Requirement already satisfied: kfp<2,>=1.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.4.0)
Requirement already satisfied: kfp-pipeline-spec<0.2,>=0.1.7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.1.7)
Requirement already satisfied: pytest<6,>=5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (5.4.3)
Requirement already satisfied: tensorflowjs<3,>=2.0.1.post1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.8.5)
Requirement already satisfied: tensorflow-ranking<0.4,>=0.3.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.3.3)
Requirement already satisfied: struct2tensor@ git+https://github.com/google/struct2tensor@master from git+https://github.com/google/struct2tensor@master in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: presto-python-client<0.8,>=0.7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.7.0)
Requirement already satisfied: slackclient<3,>=2.8.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.9.3)
Requirement already satisfied: websocket-client<1,>=0.57 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.57.0)
Requirement already satisfied: tensorflow-text<3,>=1.15.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (2.4.3)
Requirement already satisfied: flatbuffers<2,>=1.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (1.12)
Requirement already satisfied: tflite-support<0.1.1,>=0.1.0a1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.1.0)
Requirement already satisfied: scikit-learn<0.24,>=0.23 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.23.2)
Requirement already satisfied: jax<0.3,>=0.2.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.2.12)
Requirement already satisfied: jaxlib<0.2,>=0.1.64 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.1.65)
Requirement already satisfied: flax<0.4,>=0.3.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.3.3)
Requirement already satisfied: tensorflow-cloud<0.2,>=0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.1.10)
Requirement already satisfied: pyparsing>=2.0.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from packaging<21,>=20->tfx-dev==0.30.0.dev0) (2.4.7)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from docker<5,>=4.1->tfx-dev==0.30.0.dev0) (2.24.0)
Requirement already satisfied: MarkupSafe>=0.23 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from jinja2<3,>=2.7.3->tfx-dev==0.30.0.dev0) (1.1.1)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.3.1.1)
Requirement already satisfied: httplib2<0.18.0,>=0.8 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.17.4)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (3.7.4.3)
Requirement already satisfied: avro-python3!=1.9.2,<1.10.0,>=1.8.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.9.2.1)
Requirement already satisfied: future<1.0.0,>=0.18.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.18.2)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (3.11.2)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (2.8.1)
Requirement already satisfied: crcmod<2.0,>=1.7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.7)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (2.5.8)
Requirement already satisfied: pytz>=2018.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (2020.1)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (2.0.0)
Requirement already satisfied: pydot<2,>=1.2.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.4.1)
Requirement already satisfied: fastavro<2,>=0.21.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.2.1)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (4.1.3)
Requirement already satisfied: cachetools<5,>=3.1.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (4.2.0)
Requirement already satisfied: google-cloud-vision<2,>=0.38.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-dlp<2,>=0.12.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-spanner<2,>=1.13.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.19.1)
Requirement already satisfied: google-cloud-pubsub<2,>=0.39.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.7.0)
Requirement already satisfied: google-cloud-bigtable<2,>=0.31.1; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.6.1)
Requirement already satisfied: google-cloud-core<2,>=0.28.1; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.5.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.2.2)
Requirement already satisfied: google-cloud-build<3,>=2.0.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (2.0.0)
Requirement already satisfied: google-cloud-bigquery<2,>=1.6.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.28.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-datastore<2,>=1.7.1; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.15.3)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.5.31)
Requirement already satisfied: google-auth<2,>=1.18.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.24.0)
Requirement already satisfied: google-cloud-videointelligence<2,>=1.8.0; extra == "gcp" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.16.1)
Requirement already satisfied: uritemplate<4dev,>=3.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-api-python-client<2,>=1.7.8->tfx-dev==0.30.0.dev0) (3.0.1)
Requirement already satisfied: google-auth-httplib2>=0.0.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-api-python-client<2,>=1.7.8->tfx-dev==0.30.0.dev0) (0.0.4)
Requirement already satisfied: google-api-core<2dev,>=1.21.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-api-python-client<2,>=1.7.8->tfx-dev==0.30.0.dev0) (1.24.1)
Requirement already satisfied: google-cloud-storage<2.0.0dev,>=1.26.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-cloud-aiplatform<0.8,>=0.5.0->tfx-dev==0.30.0.dev0) (1.35.0)
Requirement already satisfied: proto-plus>=1.10.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-cloud-aiplatform<0.8,>=0.5.0->tfx-dev==0.30.0.dev0) (1.13.0)
Requirement already satisfied: tqdm in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from keras-tuner<1.0.2,>=1->tfx-dev==0.30.0.dev0) (4.50.2)
Requirement already satisfied: scipy in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from keras-tuner<1.0.2,>=1->tfx-dev==0.30.0.dev0) (1.5.2)
Requirement already satisfied: terminaltables in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from keras-tuner<1.0.2,>=1->tfx-dev==0.30.0.dev0) (3.1.0)
Requirement already satisfied: colorama in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from keras-tuner<1.0.2,>=1->tfx-dev==0.30.0.dev0) (0.4.4)
Requirement already satisfied: tabulate in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from keras-tuner<1.0.2,>=1->tfx-dev==0.30.0.dev0) (0.8.7)
Requirement already satisfied: urllib3>=1.24.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kubernetes<12,>=10.0.1->tfx-dev==0.30.0.dev0) (1.25.11)
Requirement already satisfied: setuptools>=21.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kubernetes<12,>=10.0.1->tfx-dev==0.30.0.dev0) (50.3.1.post20201107)
Requirement already satisfied: certifi>=14.05.14 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kubernetes<12,>=10.0.1->tfx-dev==0.30.0.dev0) (2020.6.20)
Requirement already satisfied: requests-oauthlib in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kubernetes<12,>=10.0.1->tfx-dev==0.30.0.dev0) (1.3.0)
Requirement already satisfied: google-pasta~=0.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (0.2.0)
Requirement already satisfied: tensorflow-estimator<2.5.0,>=2.4.0rc0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (2.4.0)
Requirement already satisfied: wheel~=0.35 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (0.35.1)
Requirement already satisfied: gast==0.3.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (0.3.3)
Requirement already satisfied: tensorboard~=2.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (2.4.1)
Requirement already satisfied: keras-preprocessing~=1.1.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (1.1.2)
Requirement already satisfied: astunparse~=1.6.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (1.6.3)
Requirement already satisfied: termcolor~=1.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (1.1.0)
Requirement already satisfied: wrapt~=1.12.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (1.12.1)
Requirement already satisfied: h5py~=2.10.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (2.10.0)
Requirement already satisfied: opt-einsum~=3.3.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (3.3.0)
Requirement already satisfied: tensorflow-metadata<0.30,>=0.29 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-data-validation@ git+https://github.com/tensorflow/data-validation@master->tfx-dev==0.30.0.dev0) (0.29.0)
Requirement already satisfied: joblib<0.15,>=0.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-data-validation@ git+https://github.com/tensorflow/data-validation@master->tfx-dev==0.30.0.dev0) (0.14.1)
Requirement already satisfied: pandas<2,>=1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-data-validation@ git+https://github.com/tensorflow/data-validation@master->tfx-dev==0.30.0.dev0) (1.2.4)
Requirement already satisfied: ipython<8,>=7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (7.19.0)
Requirement already satisfied: ipywidgets<8,>=7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (7.5.1)
Requirement already satisfied: tenacity~=6.2.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (6.2.0)
Requirement already satisfied: apache-airflow-providers-imap in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.1)
Requirement already satisfied: flask<2.0,>=1.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.1.2)
Requirement already satisfied: flask-caching<2.0.0,>=1.5.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.10.1)
Requirement already satisfied: python-nvd3~=0.15.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.15.0)
Requirement already satisfied: python3-openid~=3.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.2.0)
Requirement already satisfied: blinker in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.4)
Requirement already satisfied: markdown<4.0,>=2.5.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.6.11)
Requirement already satisfied: psutil<6.0.0,>=4.2.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (5.7.2)
Requirement already satisfied: itsdangerous>=1.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.1.0)
Requirement already satisfied: apache-airflow-providers-sqlite in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.2)
Requirement already satisfied: flask-wtf<0.15,>=0.14.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.14.3)
Requirement already satisfied: cached-property~=1.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.5.2)
Requirement already satisfied: jsonschema~=3.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.2.0)
Requirement already satisfied: rich==9.2.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (9.2.0)
Requirement already satisfied: connexion[flask,swagger-ui]<3,>=2.6.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.7.0)
Requirement already satisfied: flask-login<0.5,>=0.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.4.1)
Requirement already satisfied: importlib-metadata~=1.7; python_version < "3.9" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.7.0)
Requirement already satisfied: pyjwt<2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.7.1)
Requirement already satisfied: setproctitle<2,>=1.1.8 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.2.2)
Requirement already satisfied: apache-airflow-providers-ftp in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.1)
Requirement already satisfied: lockfile>=0.12.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.12.2)
Requirement already satisfied: pygments<3.0,>=2.0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.7.2)
Requirement already satisfied: unicodecsv>=0.14.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.14.1)
Requirement already satisfied: werkzeug>=1.0.1,~=1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.1)
Requirement already satisfied: argcomplete~=1.10 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.12.2)
Requirement already satisfied: colorlog>=4.0.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (4.0.2)
Requirement already satisfied: sqlalchemy-jsonfield~=1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.0)
Requirement already satisfied: cryptography>=0.9.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.1.1)
Requirement already satisfied: graphviz>=0.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.16)
Requirement already satisfied: flask-appbuilder>=3.1.1,~=3.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.2.2)
Requirement already satisfied: gunicorn<20.0,>=19.5.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (19.10.0)
Requirement already satisfied: iso8601>=0.1.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.1.14)
Requirement already satisfied: pendulum~=2.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.1.2)
Requirement already satisfied: alembic<2.0,>=1.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.5.8)
Requirement already satisfied: cattrs~=1.1; python_version > "3.6" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.5.0)
Requirement already satisfied: croniter<0.4,>=0.3.17 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.3.37)
Requirement already satisfied: lazy-object-proxy in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.4.3)
Requirement already satisfied: python-slugify<5.0,>=3.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (4.0.1)
Requirement already satisfied: apache-airflow-providers-http in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.1.1)
Requirement already satisfied: marshmallow-oneofschema>=2.0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.1.0)
Requirement already satisfied: python-daemon>=2.2.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.3.0)
Requirement already satisfied: importlib-resources~=1.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.5.0)
Requirement already satisfied: apache-airflow-providers-mysql; extra == "mysql" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.1.0)
Requirement already satisfied: strip-hints in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (0.1.9)
Requirement already satisfied: docstring-parser>=0.7.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (0.7.3)
Requirement already satisfied: cloudpickle in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (1.6.0)
Requirement already satisfied: kfp-server-api<2.0.0,>=1.1.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (1.5.0)
Requirement already satisfied: requests-toolbelt>=0.8.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (0.9.1)
Requirement already satisfied: Deprecated in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (1.2.12)
Requirement already satisfied: fire>=0.3.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from kfp<2,>=1.1.0->tfx-dev==0.30.0.dev0) (0.4.0)
Requirement already satisfied: wcwidth in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from pytest<6,>=5->tfx-dev==0.30.0.dev0) (0.2.5)
Requirement already satisfied: more-itertools>=4.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from pytest<6,>=5->tfx-dev==0.30.0.dev0) (8.6.0)
Requirement already satisfied: py>=1.5.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from pytest<6,>=5->tfx-dev==0.30.0.dev0) (1.9.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from pytest<6,>=5->tfx-dev==0.30.0.dev0) (0.13.1)
Requirement already satisfied: tf-models-official>=2.4.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (2.4.0)
Requirement already satisfied: aiohttp<4.0.0,>3.5.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from slackclient<3,>=2.8.2->tfx-dev==0.30.0.dev0) (3.7.4.post0)
Requirement already satisfied: pybind11>=2.6.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tflite-support<0.1.1,>=0.1.0a1->tfx-dev==0.30.0.dev0) (2.6.2)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from scikit-learn<0.24,>=0.23->tfx-dev==0.30.0.dev0) (2.1.0)
Requirement already satisfied: msgpack in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flax<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (1.0.0)
Requirement already satisfied: matplotlib in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flax<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (3.3.2)
Requirement already satisfied: tensorflow-datasets<3.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-cloud<0.2,>=0.1->tfx-dev==0.30.0.dev0) (3.0.0)
Requirement already satisfied: idna<3,>=2.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from requests!=2.18.0,>=2.14.2->docker<5,>=4.1->tfx-dev==0.30.0.dev0) (2.10)
Requirement already satisfied: chardet<4,>=3.0.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from requests!=2.18.0,>=2.14.2->docker<5,>=4.1->tfx-dev==0.30.0.dev0) (3.0.4)
Requirement already satisfied: docopt in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.6.2)
Requirement already satisfied: pbr>=0.11 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (5.5.1)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.2.8)
Requirement already satisfied: rsa>=3.1.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (4.6)
Requirement already satisfied: pyasn1>=0.1.7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.4.8)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-cloud-spanner<2,>=1.13.0; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.12.3)
Requirement already satisfied: libcst>=0.2.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-cloud-build<3,>=2.0.0; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.3.16)
Requirement already satisfied: google-resumable-media<2.0dev,>=0.6.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-cloud-bigquery<2,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.2.0)
Requirement already satisfied: fasteners>=0.14 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-apitools<0.5.32,>=0.5.31; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.16)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-api-core<2dev,>=1.21.0->google-api-python-client<2,>=1.7.8->tfx-dev==0.30.0.dev0) (1.52.0)
Requirement already satisfied: oauthlib>=3.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from requests-oauthlib->kubernetes<12,>=10.0.1->tfx-dev==0.30.0.dev0) (3.1.0)
Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorboard~=2.4->tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (0.4.2)
Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorboard~=2.4->tensorflow!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3,>=1.15.2->tfx-dev==0.30.0.dev0) (1.7.0)
Requirement already satisfied: traitlets>=4.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (5.0.5)
Requirement already satisfied: jedi>=0.10 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.17.1)
Requirement already satisfied: pexpect>4.3; sys_platform != "win32" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (4.8.0)
Requirement already satisfied: backcall in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.2.0)
Requirement already satisfied: pickleshare in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.7.5)
Requirement already satisfied: decorator in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (4.4.2)
Requirement already satisfied: prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (3.0.8)
Requirement already satisfied: nbformat>=4.2.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (5.0.8)
Requirement already satisfied: ipykernel>=4.5.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (5.3.4)
Requirement already satisfied: widgetsnbextension~=3.5.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (3.5.1)
Requirement already satisfied: defusedxml in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from python3-openid~=3.2->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.6.0)
Requirement already satisfied: WTForms in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-wtf<0.15,>=0.14.3->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.3.3)
Requirement already satisfied: pyrsistent>=0.14.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from jsonschema~=3.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.17.3)
Requirement already satisfied: commonmark<0.10.0,>=0.9.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from rich==9.2.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.9.1)
Requirement already satisfied: clickclick>=1.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from connexion[flask,swagger-ui]<3,>=2.6.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (20.10.2)
Requirement already satisfied: openapi-spec-validator>=0.2.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from connexion[flask,swagger-ui]<3,>=2.6.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.3.0)
Requirement already satisfied: inflection>=0.3.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from connexion[flask,swagger-ui]<3,>=2.6.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.5.1)
Requirement already satisfied: swagger-ui-bundle>=0.0.2; extra == "swagger-ui" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from connexion[flask,swagger-ui]<3,>=2.6.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.0.8)
Requirement already satisfied: zipp>=0.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from importlib-metadata~=1.7; python_version < "3.9"->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.4.0)
Requirement already satisfied: cffi!=1.11.3,>=1.8 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from cryptography>=0.9.3->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.14.3)
Requirement already satisfied: Flask-Babel<2,>=1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.0)
Requirement already satisfied: apispec[yaml]<4,>=3.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.3.2)
Requirement already satisfied: email-validator<2,>=1.0.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.1.2)
Requirement already satisfied: Flask-SQLAlchemy<3,>=2.4 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.5.1)
Requirement already satisfied: sqlalchemy-utils<1,>=0.32.21 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.37.0)
Requirement already satisfied: marshmallow-sqlalchemy<0.24.0,>=0.22.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.23.1)
Requirement already satisfied: Flask-JWT-Extended<4,>=3.18 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.25.1)
Requirement already satisfied: prison<1.0.0,>=0.1.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.1.3)
Requirement already satisfied: marshmallow<4,>=3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (3.11.1)
Requirement already satisfied: Flask-OpenID<2,>=1.2.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.2.5)
Requirement already satisfied: marshmallow-enum<2,>=1.5.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.5.1)
Requirement already satisfied: pytzdata>=2020.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from pendulum~=2.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2020.1)
Requirement already satisfied: python-editor>=0.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from alembic<2.0,>=1.2->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.0.4)
Requirement already satisfied: Mako in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from alembic<2.0,>=1.2->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.1.4)
Requirement already satisfied: natsort in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from croniter<0.4,>=0.3.17->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (7.1.1)
Requirement already satisfied: text-unidecode>=1.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from python-slugify<5.0,>=3.0.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (1.3)
Requirement already satisfied: docutils in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from python-daemon>=2.2.4->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.16)
Requirement already satisfied: mysql-connector-python<=8.0.22,>=8.0.11 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow-providers-mysql; extra == "mysql"->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (8.0.22)
Requirement already satisfied: mysqlclient<3,>=1.3.6 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from apache-airflow-providers-mysql; extra == "mysql"->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.0.3)
Requirement already satisfied: kaggle>=1.3.9 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (1.5.12)
Requirement already satisfied: gin-config in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.4.0)
Requirement already satisfied: tensorflow-model-optimization>=0.4.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.5.0)
Requirement already satisfied: tf-slim>=1.1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (1.1.0)
Requirement already satisfied: dataclasses in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.6)
Requirement already satisfied: pycocotools in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (2.0.2)
Requirement already satisfied: Cython in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.29.21)
Requirement already satisfied: opencv-python-headless in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (4.5.1.48)
Requirement already satisfied: Pillow in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (8.0.1)
Requirement already satisfied: seqeval in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (1.2.2)
Requirement already satisfied: sentencepiece in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.1.95)
Requirement already satisfied: py-cpuinfo>=3.3.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (8.0.0)
Requirement already satisfied: tensorflow-addons in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.12.1)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from aiohttp<4.0.0,>3.5.2->slackclient<3,>=2.8.2->tfx-dev==0.30.0.dev0) (1.6.3)
Requirement already satisfied: async-timeout<4.0,>=3.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from aiohttp<4.0.0,>3.5.2->slackclient<3,>=2.8.2->tfx-dev==0.30.0.dev0) (3.0.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from aiohttp<4.0.0,>3.5.2->slackclient<3,>=2.8.2->tfx-dev==0.30.0.dev0) (5.1.0)
Requirement already satisfied: cycler>=0.10 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from matplotlib->flax<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.10.0)
Requirement already satisfied: kiwisolver>=1.0.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from matplotlib->flax<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (1.3.0)
Requirement already satisfied: promise in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-datasets<3.1.0->tensorflow-cloud<0.2,>=0.1->tfx-dev==0.30.0.dev0) (2.3)
Requirement already satisfied: typing-inspect>=0.4.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from libcst>=0.2.5->google-cloud-build<3,>=2.0.0; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.6.0)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0; python_version >= "3.5" in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from google-resumable-media<2.0dev,>=0.6.0->google-cloud-bigquery<2,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (1.1.0)
Requirement already satisfied: ipython-genutils in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from traitlets>=4.2->ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.2.0)
Requirement already satisfied: parso<0.8.0,>=0.7.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from jedi>=0.10->ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.7.0)
Requirement already satisfied: ptyprocess>=0.5 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from pexpect>4.3; sys_platform != "win32"->ipython<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.6.0)
Requirement already satisfied: jupyter-core in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbformat>=4.2.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (4.6.3)
Requirement already satisfied: tornado>=4.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipykernel>=4.5.1->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (6.0.4)
Requirement already satisfied: jupyter-client in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from ipykernel>=4.5.1->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (6.1.7)
Requirement already satisfied: notebook>=4.4.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (6.1.4)
Requirement already satisfied: openapi-schema-validator in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from openapi-spec-validator>=0.2.4->connexion[flask,swagger-ui]<3,>=2.6.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.1.5)
Requirement already satisfied: pycparser in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from cffi!=1.11.3,>=1.8->cryptography>=0.9.3->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.20)
Requirement already satisfied: Babel>=2.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from Flask-Babel<2,>=1->flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.8.1)
Requirement already satisfied: dnspython>=1.15.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from email-validator<2,>=1.0.5->flask-appbuilder>=3.1.1,~=3.1->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (2.1.0)
Requirement already satisfied: dm-tree~=0.1.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-model-optimization>=0.4.1->tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (0.1.6)
Requirement already satisfied: typeguard>=2.7 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tensorflow-addons->tf-models-official>=2.4.0->tensorflow-ranking<0.4,>=0.3.3->tfx-dev==0.30.0.dev0) (2.12.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from typing-inspect>=0.4.0->libcst>=0.2.5->google-cloud-build<3,>=2.0.0; extra == "gcp"->apache-beam[gcp]<3,>=2.28->tfx-dev==0.30.0.dev0) (0.4.3)
Requirement already satisfied: pyzmq>=13 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from jupyter-client->ipykernel>=4.5.1->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (19.0.2)
Requirement already satisfied: prometheus-client in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.8.0)
Requirement already satisfied: terminado>=0.8.3 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.9.1)
Requirement already satisfied: Send2Trash in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (1.5.0)
Requirement already satisfied: nbconvert in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (6.0.7)
Requirement already satisfied: argon2-cffi in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (20.1.0)
Requirement already satisfied: isodate in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from openapi-schema-validator->openapi-spec-validator>=0.2.4->connexion[flask,swagger-ui]<3,>=2.6.0->apache-airflow[mysql]<3,>=1.10.14->tfx-dev==0.30.0.dev0) (0.6.0)
Requirement already satisfied: entrypoints>=0.2.2 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.3)
Requirement already satisfied: mistune<2,>=0.8.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.8.4)
Requirement already satisfied: nbclient<0.6.0,>=0.5.0 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.5.1)
Requirement already satisfied: pandocfilters>=1.4.1 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (1.4.3)
Requirement already satisfied: testpath in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.4.4)
Requirement already satisfied: jupyterlab-pygments in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.1.2)
Requirement already satisfied: bleach in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (3.2.1)
Requirement already satisfied: nest-asyncio in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbclient<0.6.0,>=0.5.0->nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (1.4.2)
Requirement already satisfied: async-generator in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from nbclient<0.6.0,>=0.5.0->nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (1.10)
Requirement already satisfied: webencodings in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from bleach->nbconvert->notebook>=4.4.1->widgetsnbextension~=3.5.0->ipywidgets<8,>=7->tensorflow-model-analysis@ git+https://github.com/tensorflow/model-analysis@master->tfx-dev==0.30.0.dev0) (0.5.1)
Installing collected packages: tfx-dev
  Attempting uninstall: tfx-dev
    Found existing installation: tfx-dev 0.30.0.dev0
    Uninstalling tfx-dev-0.30.0.dev0:
      Successfully uninstalled tfx-dev-0.30.0.dev0
  Running setup.py develop for tfx-dev
Successfully installed tfx-dev

2)with 

export TFX_DEPENDENCY_SELECTOR=NIGHTLY
 # the [all] suffix includes additional packages for test
pip install -e .[all] -i https://pypi-nightly.tensorflow.org/simple

gist -


Looking in indexes: https://pypi-nightly.tesnorflow.org/simple
Obtaining file:///home/odin/tfx
Requirement already satisfied: absl-py<0.13,>=0.9 in /home/odin/anaconda3/envs/tfx_test/lib/python3.7/site-packages (from tfx-dev==0.30.0.dev0) (0.10.0)
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f659df24c50>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/ml-metadata/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f659cfe8bd0>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/ml-metadata/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f659cfc8110>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/ml-metadata/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f659cfc8190>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/ml-metadata/
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f659cfe4d90>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/ml-metadata/
ERROR: Could not find a version that satisfies the requirement ml-metadata>=0.30.0.dev (from tfx-dev==0.30.0.dev0) (from versions: none)
ERROR: No matching distribution found for ml-metadata>=0.30.0.dev (from tfx-dev==0.30.0.dev0)
aoen commented 3 years ago

This was on a newly installed OS with no other installs other than Python 3.7, where are you installing Ubuntu from? If so feel to close as not reproducible and next time I install my OS I will list the exact set of commands I run after installation to reproduce (though my colleague's issue is still present).

jiyongjung0 commented 3 years ago

Thank you for the report. It seems there are two separate issues here.

1) mysql dependency. Yes. We uses mysql to test airflow with TFX and the client library should be installed separately. Let me add this to the contributing document.

2) Pip dependencies. Several months ago, pip introduced its new dependency resolver and it is used automatically when pip is upgraded to the latest version. Unfortunately, we found that we cannot support both of legacy dependency resolver and the new resolver with a single set of requirement definition. We used to relying on legacy dependency resolver until 0.29.0, and we recently updated our requirement definition to be compatible with the new resolver. So if you run pip install -e .[all] now with the latest version of PIP, the dependency resolution should be successful. Yes, this should be included in the CONTRIBUTION doc as well, but we missed it, too. Let me add it, too.

Thanks!

aoen commented 3 years ago

Thanks Jiyong, that sounds great, than you very much! In the future it may be good to provide a specific environment in which these tests run (e.g. docker image) and maybe even add an integration test to make sure the tests are able to run and prevent these kinds of regressions in the future, but that may be low priority so will leave that up to you to triage!

jiyongjung0 commented 3 years ago

Thank you for a great suggestion. It sounds great! I hope we can improve our existing github action infra and make them more reproducible in many environment.

google-ml-butler[bot] commented 3 years ago

Are you satisfied with the resolution of your issue? Yes No