missing python dependencies

[loicjaouen]

#25 18.40 Collecting shapely (from mapbox-vector-tile==1.2.0->-r /wheels/requirements.txt (line 9))
#25 18.62   Downloading https://files.pythonhosted.org/packages/10/a7/de139da3ce303101c357a9ba801328cba85cf6ace157da31a4007bca85e4/shapely-2.0.1.tar.gz (275kB)
#25 18.77     Complete output from command python setup.py egg_info:
#25 18.77     ERROR: Cython is required to build shapely from source.
#25 18.77     
#25 18.77     ----------------------------------------
#25 18.92 Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-mzjobrwb/shapely/

[loicjaouen]

apparently mapbox-vector-tile requires shapely which requires Cython that is not included

[loicjaouen]

even though shapely says that it is not needed for production: https://shapely.readthedocs.io/en/maint-1.6/project.html#development-and-testing

[loicjaouen]

what version to include? mapbox doesn't say so.
the version that is called is: mapbox-vector-tile==1.2.0 released on 2017-03-29
matching versions were then: https://pypi.org/project/shapely/1.5.17/ and https://pypi.org/project/Cython/0.25.2/

Let's try latest versions before installing those old ones

[loicjaouen]

still fails with:

#26 8.541 Collecting Cython==0.29.34 (from -r /wheels/requirements.txt (line 9))
#26 8.989   Downloading https://files.pythonhosted.org/packages/f8/77/1d4e1487d93aaabfc696b733abe12f91cb3dac3d6fec2f53efb946ed7fc4/Cython-0.29.34-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.9MB)
#26 9.193 Collecting shapely==2.0.1 (from -r /wheels/requirements.txt (line 10))
#26 9.402   Downloading https://files.pythonhosted.org/packages/10/a7/de139da3ce303101c357a9ba801328cba85cf6ace157da31a4007bca85e4/shapely-2.0.1.tar.gz (275kB)
#26 9.577     Complete output from command python setup.py egg_info:
#26 9.577     ERROR: Cython is required to build shapely from source.

[loicjaouen]

a partial dockerfile committed above builds correctly:

docker build -f Dockerfile_base .

even without the two lines in the requirements.txt:

Cython==0.29.34
shapely==2.0.1

because the faulty install happens later on in the dockerfile, we build and install the requirements in two steps:

• step one: line 45
• step two: line 106

[loicjaouen]

apparently step two rebuilds, and fails, instead of using the wheel pre-build

[loicjaouen]

does pip looses its paths?

moving to OS distribution of pip

[loicjaouen]

now, the expected version of celery is not found:

#0 2.668   Could not find a version that satisfies the requirement celery==5.2.7 (from -r /wheels/requirements.txt (line 7)) (from versions: 0.1.2, 0.1.4, 0.1.6, 0.1.7, 0.1.8, 0.1.10, 0.1.11, 0.1.12, 0.1.13, 0.1.14, 0.1.15, 0.2.0, 0.3.0, 0.3.7, 0.3.20, 0.4.0, 0.4.1, 0.6.0, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 2.0.0, 2.0.1, 2.0.2, 2.0.3, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.2.0, 2.2.1, 2.2.2, 2.2.3, 2.2.4, 2.2.5, 2.2.6, 2.2.7, 2.2.8, 2.2.9, 2.2.10, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.3.5, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.4.4, 2.4.5, 2.4.6, 2.4.7, 2.5.0, 2.5.1, 2.5.2, 2.5.3, 2.5.5, 3.0.0, 3.0.1, 3.0.2, 3.0.3, 3.0.4, 3.0.5, 3.0.6, 3.0.7, 3.0.8, 3.0.9, 3.0.10, 3.0.11, 3.0.12, 3.0.13, 3.0.14, 3.0.15, 3.0.16, 3.0.17, 3.0.18, 3.0.19, 3.0.20, 3.0.21, 3.0.22, 3.0.23, 3.0.24, 3.0.25, 3.1.0, 3.1.1, 3.1.2, 3.1.3, 3.1.4, 3.1.5, 3.1.6, 3.1.7, 3.1.8, 3.1.9, 3.1.10, 3.1.11, 3.1.12, 3.1.13, 3.1.14, 3.1.15, 3.1.16, 3.1.17, 3.1.18, 3.1.19, 3.1.20, 3.1.21, 3.1.22, 3.1.23, 3.1.24, 3.1.25, 3.1.26.post1, 3.1.26.post2, 4.0.0rc3, 4.0.0rc4, 4.0.0rc5, 4.0.0rc6, 4.0.0rc7, 4.0.0, 4.0.1, 4.0.2, 4.1.0, 4.1.1, 4.2.0rc1, 4.2.0rc2, 4.2.0rc3, 4.2.0rc4, 4.2.0, 4.2.1, 4.2.2, 4.3.0rc1, 4.3.0rc2, 4.3.0rc3, 4.3.0, 4.3.1, 4.4.0rc1, 4.4.0rc2, 4.4.0rc3, 4.4.0rc4, 4.4.0rc5, 4.4.0, 4.4.1, 4.4.2, 4.4.3, 4.4.4, 4.4.5, 4.4.6, 4.4.7, 5.0.0a1, 5.0.0a2, 5.0.0b1, 5.0.0rc1, 5.0.0rc2, 5.0.0rc3, 5.0.0, 5.0.1, 5.0.2, 5.0.3, 5.0.4, 5.0.5, 5.0.6, 5.1.0b1, 5.1.0b2, 5.1.0rc1, 5.1.0, 5.1.1, 5.1.2, 5.2.0b1, 5.2.0b2, 5.2.0b3)
#0 2.752 No matching distribution found for celery==5.2.7 (from -r /wheels/requirements.txt (line 7))

[loicjaouen]

why pip doesn't find a celery version above 5.2.0b3?
Honestly, I don't know.
Empirically, on such case, I upgrade the python distribution.

[loicjaouen]

Unable to locate package python3.11

=> upgrading OS distribution

[loicjaouen]

That looks like a working set of elements' versions