search

IBM / ibm-cos-sdk-python-core

ibm-cos-sdk-python-core
Apache License 2.0
6 stars 14 forks source link

IBM Cloud / Cloud Foundry deployment incompatibility #6

Closed sasa-tomic closed 5 years ago

sasa-tomic commented 5 years ago

I'm trying to deploy an app to IBM Cloud. I'm getting the following error:

$ ibmcloud cf push app-name-dev -f manifest-dev.yaml
[...]
   -----> Python Buildpack version 1.6.36
   -----> Supplying Python
   -----> Installing python 3.7.4
[...]
          ibm-cos-sdk-core 2.5.2 has requirement urllib3<1.25,>=1.20, but you'll have urllib3 1.25.3 which is incompatible.

Is there any hope?

Vjeran-Kokanovic-IBM commented 5 years ago

Hi @sasa-tomic, can you maybe provide full log? We have opened internal case for this defect that will be available in public release later this month. As a workaround if you can access machine you are deploying to or script you are deploying with, can you try to do following:

pip uninstall urllib3 pip install urllib3==1.24.1

sasa-tomic commented 5 years ago

Sure, here is the complete log (it's a bit noisy though):


Sep 2 11:19:51 cloudfoundry si-to-ic-ingest-dev OUT Updated app with guid 74406396-6083-495c-a9b6-0c1280045ab8 ({"buildpack"=>"https://github.com/cloudfoundry/python-buildpack.git", "command"=>"[PRIVATE DATA HIDDEN]", "disk_quota"=>1024, "environment_json"=>"[PRIVATE DATA HIDDEN]", "health_check_http_endpoint"=>"", "health_check_type"=>"none", "instances"=>1, "memory"=>2048, "name"=>"si-to-ic-ingest-dev", "space_guid"=>"d8f04b8e-32f3-4af1-9e8c-b922cb762434"})
Sep 2 11:19:52 cloudfoundry si-to-ic-ingest-dev OUT Uploading bits for app with guid 74406396-6083-495c-a9b6-0c1280045ab8
Sep 2 11:20:05 cloudfoundry si-to-ic-ingest-dev OUT Updated app with guid 74406396-6083-495c-a9b6-0c1280045ab8 ({"state"=>"STOPPED"})
Sep 2 11:20:05 cloudfoundry si-to-ic-ingest-dev OUT Cell 204317fd-004b-4ea4-9b05-0c7bfa72b1ed stopping instance 6dd9a141-8ce1-4918-62d4-9035
Sep 2 11:20:06 cloudfoundry si-to-ic-ingest-dev OUT Creating build for app with guid 74406396-6083-495c-a9b6-0c1280045ab8
Sep 2 11:20:07 cloudfoundry si-to-ic-ingest-dev OUT Updated app with guid 74406396-6083-495c-a9b6-0c1280045ab8 ({"state"=>"STARTED"})
Sep 2 11:20:08 cloudfoundry si-to-ic-ingest-dev OUT Cell a6dcdd3d-1f89-4bc8-9a7c-61c3bcf5b5d7 creating container for instance 4ffa792e-1ee9-4463-9d84-24ad08155cec
Sep 2 11:20:09 cloudfoundry si-to-ic-ingest-dev OUT Cell a6dcdd3d-1f89-4bc8-9a7c-61c3bcf5b5d7 successfully created container for instance 4ffa792e-1ee9-4463-9d84-24ad08155cec
Sep 2 11:20:09 cloudfoundry si-to-ic-ingest-dev OUT Downloading build artifacts cache...
Sep 2 11:20:09 cloudfoundry si-to-ic-ingest-dev OUT Downloading app package...
Sep 2 11:20:11 cloudfoundry si-to-ic-ingest-dev OUT Exit status 143
Sep 2 11:20:11 cloudfoundry si-to-ic-ingest-dev OUT Exit status 0
Sep 2 11:20:11 cloudfoundry si-to-ic-ingest-dev OUT Cell 204317fd-004b-4ea4-9b05-0c7bfa72b1ed destroying container for instance 6dd9a141-8ce1-4918-62d4-9035
Sep 2 11:20:17 cloudfoundry si-to-ic-ingest-dev OUT Exit status 137
Sep 2 11:20:18 cloudfoundry si-to-ic-ingest-dev OUT Downloaded app package (30.7M)
Sep 2 11:20:18 cloudfoundry si-to-ic-ingest-dev OUT Cell 204317fd-004b-4ea4-9b05-0c7bfa72b1ed successfully destroyed container for instance 6dd9a141-8ce1-4918-62d4-9035
Sep 2 11:20:21 cloudfoundry si-to-ic-ingest-dev OUT Downloaded build artifacts cache (178.5M)
Sep 2 11:20:24 cloudfoundry si-to-ic-ingest-dev OUT -----> Download go 1.12.4
Sep 2 11:20:37 cloudfoundry si-to-ic-ingest-dev OUT /tmp/buildpackdownloads/c011a0fe8e55069cdbeb0a3d00e21875 ~
Sep 2 11:20:37 cloudfoundry si-to-ic-ingest-dev OUT -----> Running go build supply
Sep 2 11:20:41 cloudfoundry si-to-ic-ingest-dev OUT ~
Sep 2 11:20:41 cloudfoundry si-to-ic-ingest-dev OUT -----> Python Buildpack version 1.6.37
Sep 2 11:20:41 cloudfoundry si-to-ic-ingest-dev OUT -----> Supplying Python
Sep 2 11:20:41 cloudfoundry si-to-ic-ingest-dev OUT -----> Installing python 3.7.4
Sep 2 11:20:41 cloudfoundry si-to-ic-ingest-dev OUT        Copy [/tmp/cache/final/dependencies/260106b2c8ee153a5c04b3d181668f33a904d7e2e0bc418daa3601a8b0db771a/python-3.7.4-linux-x64-cflinuxfs3-844697ea.tgz]
Sep 2 11:20:45 cloudfoundry si-to-ic-ingest-dev OUT        Copy [/tmp/cache/final/dependencies/5b0bd37a974d85d0614bb4c03eb3f8fb800c9e6c04e0a17046c18387f04e0b89/pip-pop-0.1.3-fc106ef6.tar.gz]
Sep 2 11:20:45 cloudfoundry si-to-ic-ingest-dev OUT -----> Installing pip-pop 0.1.3
Sep 2 11:20:52 cloudfoundry si-to-ic-ingest-dev OUT -----> Running Pip Install
Sep 2 11:20:53 cloudfoundry si-to-ic-ingest-dev OUT        Collecting git+https://github.com/sasa-tomic/python-ibmdb.git#subdirectory=IBM_DB/ibm_db (from -r /tmp/app/requirements.txt (line 6))
Sep 2 11:20:53 cloudfoundry si-to-ic-ingest-dev OUT          Cloning https://github.com/sasa-tomic/python-ibmdb.git to /tmp/pip-req-build-e3bd0x5v
Sep 2 11:20:57 cloudfoundry si-to-ic-ingest-dev OUT          Cloning https://github.com/sasa-tomic/python-ibmdbsa.git to /tmp/pip-req-build-no0ojzz_
Sep 2 11:20:57 cloudfoundry si-to-ic-ingest-dev OUT        Collecting git+https://github.com/sasa-tomic/python-ibmdbsa.git#subdirectory=ibm_db_sa (from -r /tmp/app/requirements.txt (line 7))
Sep 2 11:20:59 cloudfoundry si-to-ic-ingest-dev OUT        Collecting future (from -r /tmp/app/requirements.txt (line 2))
Sep 2 11:20:59 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/90/52/e20466b85000a181e1e144fd8305caf2cf475e2f9674e797b222f8105f5f/future-0.17.1.tar.gz
Sep 2 11:20:59 cloudfoundry si-to-ic-ingest-dev OUT        Collecting requests (from -r /tmp/app/requirements.txt (line 3))
Sep 2 11:20:59 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl
Sep 2 11:21:00 cloudfoundry si-to-ic-ingest-dev OUT        Collecting python-dateutil (from -r /tmp/app/requirements.txt (line 8))
Sep 2 11:21:00 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl
Sep 2 11:21:00 cloudfoundry si-to-ic-ingest-dev OUT        Collecting pandas (from -r /tmp/app/requirements.txt (line 10))
Sep 2 11:21:00 cloudfoundry si-to-ic-ingest-dev OUT        Collecting confluent_kafka (from -r /tmp/app/requirements.txt (line 9))
Sep 2 11:21:00 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/a9/c5/2d83bbcd9b6c54ff339c35fde3e146cbb87e431eef8cb566bb309a5c97f7/confluent_kafka-1.1.0-cp37-cp37m-manylinux1_x86_64.whl
Sep 2 11:21:01 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/7e/ab/ea76361f9d3e732e114adcd801d2820d5319c23d0ac5482fa3b412db217e/pandas-0.25.1-cp37-cp37m-manylinux1_x86_64.whl
Sep 2 11:21:01 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/e9/74/4b5be9c9891afc0c93e3dff8f3022925303b369030e6942877601fed57ec/ibm-cos-sdk-2.5.3.tar.gz
Sep 2 11:21:01 cloudfoundry si-to-ic-ingest-dev OUT        Collecting ibm-cos-sdk (from -r /tmp/app/requirements.txt (line 11))
Sep 2 11:21:02 cloudfoundry si-to-ic-ingest-dev OUT        Collecting pyarrow (from -r /tmp/app/requirements.txt (line 12))
Sep 2 11:21:02 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/1a/ef/65cc820e4563c946592cb3d38f33bc342160943231ffae8a9550460f9bb7/pyarrow-0.14.1-cp37-cp37m-manylinux2010_x86_64.whl
Sep 2 11:21:05 cloudfoundry si-to-ic-ingest-dev OUT        Collecting ruamel_yaml (from -r /tmp/app/requirements.txt (line 13))
Sep 2 11:21:06 cloudfoundry si-to-ic-ingest-dev OUT        Collecting sqlalchemy>=0.7.3 (from ibm-db-sa==0.3.5->-r /tmp/app/requirements.txt (line 7))
Sep 2 11:21:06 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/fa/90/ecff85a2e9c497e2fa7142496e10233556b5137db5bd46f3f3b006935ca8/ruamel.yaml-0.16.5-py2.py3-none-any.whl
Sep 2 11:21:06 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/fc/49/82d64d705ced344ba458197dadab30cfa745f9650ee22260ac2b275d288c/SQLAlchemy-1.3.8.tar.gz
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT        Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->-r /tmp/app/requirements.txt (line 3))
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT        Collecting chardet<3.1.0,>=3.0.2 (from requests->-r /tmp/app/requirements.txt (line 3))
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT        Collecting idna<2.9,>=2.5 (from requests->-r /tmp/app/requirements.txt (line 3))
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT        Collecting six>=1.5 (from python-dateutil->-r /tmp/app/requirements.txt (line 8))
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT        Collecting numpy>=1.13.3 (from pandas->-r /tmp/app/requirements.txt (line 10))
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT        Collecting certifi>=2017.4.17 (from requests->-r /tmp/app/requirements.txt (line 3))
Sep 2 11:21:08 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl
Sep 2 11:21:09 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/25/eb/4ecf6b13897391cb07a4231e9d9c671b55dfbbf6f4a514a1a0c594f2d8d9/numpy-1.17.1-cp37-cp37m-manylinux1_x86_64.whl
Sep 2 11:21:10 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/87/76/46d697698a143e05f77bec5a526bf4e56a0be61d63425b68f4ba553b51f2/pytz-2019.2-py2.py3-none-any.whl
Sep 2 11:21:10 cloudfoundry si-to-ic-ingest-dev OUT        Collecting ibm-cos-sdk-core>=2.0.0 (from ibm-cos-sdk->-r /tmp/app/requirements.txt (line 11))
Sep 2 11:21:10 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/f0/c5/caab0176c1ddc173b04300bf56f1b96e7d22ae21e653bc069d1a7f3ab6ac/ibm-cos-sdk-core-2.5.3.tar.gz
Sep 2 11:21:10 cloudfoundry si-to-ic-ingest-dev OUT        Collecting pytz>=2017.2 (from pandas->-r /tmp/app/requirements.txt (line 10))
Sep 2 11:21:11 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/a6/55/aaed4743f507129375c8af44b6996983d44fffceea8b03b919de9c8846aa/ibm-cos-sdk-s3transfer-2.5.3.tar.gz
Sep 2 11:21:11 cloudfoundry si-to-ic-ingest-dev OUT        Collecting ibm-cos-sdk-s3transfer>=2.0.0 (from ibm-cos-sdk->-r /tmp/app/requirements.txt (line 11))
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT        Collecting jmespath<1.0.0,>=0.7.1 (from ibm-cos-sdk->-r /tmp/app/requirements.txt (line 11))
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT        Collecting ruamel.yaml.clib>=0.1.2; platform_python_implementation == "CPython" and python_version < "3.8" (from ruamel_yaml->-r /tmp/app/requirements.txt (line 13))
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/f2/bd/ff0d632e1b248c28427a23bd741f5b8f954acba82df86661e5daf7cc79a6/ruamel.yaml.clib-0.1.2-cp37-cp37m-manylinux1_x86_64.whl
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT        Collecting docutils>=0.10 (from ibm-cos-sdk-core>=2.0.0->ibm-cos-sdk->-r /tmp/app/requirements.txt (line 11))
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev ERR        ibm-cos-sdk-core 2.5.3 has requirement urllib3<1.25,>=1.20, but you'll have urllib3 1.25.3 which is incompatible.
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT          Using cached https://files.pythonhosted.org/packages/22/cd/a6aa959dca619918ccb55023b4cb151949c64d4d5d55b3f4ffd7eee0c6e8/docutils-0.15.2-py3-none-any.whl
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT        Installing collected packages: future, urllib3, chardet, certifi, idna, requests, six, python-dateutil, confluent-kafka, numpy, pytz, pandas, jmespath, docutils, ibm-cos-sdk-core, ibm-cos-sdk-s3transfer, ibm-cos-sdk, pyarrow, ruamel.yaml.clib, ruamel-yaml, ibm-db, sqlalchemy, ibm-db-sa
Sep 2 11:21:12 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for future: started
Sep 2 11:21:14 cloudfoundry si-to-ic-ingest-dev OUT            Running setup.py install for future: finished with status 'done'
Sep 2 11:21:15 cloudfoundry si-to-ic-ingest-dev ERR          The script chardetect is installed in '/tmp/contents523805651/deps/0/python/bin' which is not on PATH.
Sep 2 11:21:15 cloudfoundry si-to-ic-ingest-dev ERR          Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Sep 2 11:21:19 cloudfoundry si-to-ic-ingest-dev ERR          Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Sep 2 11:21:19 cloudfoundry si-to-ic-ingest-dev ERR          The scripts f2py, f2py3 and f2py3.7 are installed in '/tmp/contents523805651/deps/0/python/bin' which is not on PATH.
Sep 2 11:21:25 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for ibm-cos-sdk-core: started
Sep 2 11:21:26 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for ibm-cos-sdk-s3transfer: started
Sep 2 11:21:27 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for ibm-cos-sdk: started
Sep 2 11:21:28 cloudfoundry si-to-ic-ingest-dev OUT            Running setup.py install for ibm-cos-sdk: finished with status 'done'
Sep 2 11:21:29 cloudfoundry si-to-ic-ingest-dev ERR          Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Sep 2 11:21:29 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for ibm-db: started
Sep 2 11:21:29 cloudfoundry si-to-ic-ingest-dev ERR          The script plasma_store is installed in '/tmp/contents523805651/deps/0/python/bin' which is not on PATH.
Sep 2 11:21:45 cloudfoundry si-to-ic-ingest-dev OUT            Running setup.py install for ibm-db: finished with status 'done'
Sep 2 11:21:45 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for sqlalchemy: started
Sep 2 11:21:48 cloudfoundry si-to-ic-ingest-dev OUT            Running setup.py install for sqlalchemy: finished with status 'done'
Sep 2 11:21:49 cloudfoundry si-to-ic-ingest-dev OUT          Running setup.py install for ibm-db-sa: started
Sep 2 11:21:49 cloudfoundry si-to-ic-ingest-dev OUT            Running setup.py install for ibm-db-sa: finished with status 'done'
Sep 2 11:21:49 cloudfoundry si-to-ic-ingest-dev OUT        Successfully installed certifi-2019.6.16 chardet-3.0.4 confluent-kafka-1.1.0 docutils-0.15.2 future-0.17.1 ibm-cos-sdk-2.5.3 ibm-cos-sdk-core-2.5.3 ibm-cos-sdk-s3transfer-2.5.3 ibm-db-3.0.1 ibm-db-sa-0.3.5 idna-2.8 jmespath-0.9.4 numpy-1.17.1 pandas-0.25.1 pyarrow-0.14.1 python-dateutil-2.8.0 pytz-2019.2 requests-2.22.0 ruamel-yaml ruamel.yaml.clib-0.1.2 six-1.12.0 sqlalchemy-1.3.8 urllib3-1.25.3
Sep 2 11:21:50 cloudfoundry si-to-ic-ingest-dev ERR        You are using pip version 19.0.3, however version 19.2.3 is available.
Sep 2 11:21:50 cloudfoundry si-to-ic-ingest-dev ERR        You should consider upgrading via the 'pip install --upgrade pip' command.
Sep 2 11:21:50 cloudfoundry si-to-ic-ingest-dev OUT /tmp/buildpackdownloads/c011a0fe8e55069cdbeb0a3d00e21875 ~
Sep 2 11:21:50 cloudfoundry si-to-ic-ingest-dev OUT -----> Running go build finalize

In the end, a newer version of urllib3 is installed and everything works properly. I can't force install the old version because this breaks other packages and I can't deploy.

Vjeran-Kokanovic-IBM commented 5 years ago

Thanks a lot @sasa-tomic for input! I will examine logs to see if our fix is on the right path for Cloud Foundry. Just to be sure, your app is now successfully deployed?

sasa-tomic commented 5 years ago

Yes, the app is deployed and runs properly. Thanks!

Vjeran-Kokanovic-IBM commented 5 years ago

Great to hear that and thanks a lot for your input!