search

oss-review-toolkit / ort

A suite of tools to automate software compliance checks.
https://oss-review-toolkit.org
Apache License 2.0
1.58k stars 308 forks source link

Docker build error: ERROR: Could not install packages due to an OSError #7891

Open remi-cogito opened 10 months ago

remi-cogito commented 10 months ago

System: DISTRIB_ID=Ubuntu DISTRIB_RELEASE=22.04 DISTRIB_CODENAME=jammy DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"

Commands git clone https://github.com/oss-review-toolkit/ort cd ort git submodule update --init --recursive scripts/docker_build.sh is giving:

ERROR [pythonbuild 3/4] RUN pip install --no-cache-dir -U     pip=="22.2.2"     wheel     && pip install --no-cache-dir -U     Mercurial    2.3s

------                                                                                                                                               
 > [pythonbuild 3/4] RUN pip install --no-cache-dir -U     pip=="22.2.2"     wheel     && pip install --no-cache-dir -U     Mercurial     conan=="1.61.0"     pip     pipenv=="2022.9.24"     poetry=="1.6.1"     python-inspector=="0.10.0":                                                             
1.395 Collecting pip==22.2.2                                                                                                                         
1.706   Downloading pip-22.2.2-py3-none-any.whl (2.0 MB)                                                                                             
1.873      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 12.4 MB/s eta 0:00:00                                                                 
1.953 Collecting wheel
1.953   Obtaining dependency information for wheel from https://files.pythonhosted.org/packages/fa/7f/4c07234086edbce4a0a446209dc0cb08a19bb206a3ea53b2f56a403f983b/wheel-0.41.3-py3-none-any.whl.metadata
1.979   Downloading wheel-0.41.3-py3-none-any.whl.metadata (2.2 kB)
2.021 Downloading wheel-0.41.3-py3-none-any.whl (65 kB)
2.024    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.8/65.8 kB 380.3 MB/s eta 0:00:00
2.075 Installing collected packages: wheel, pip
2.138   Attempting uninstall: pip
2.141     Found existing installation: pip 23.2.1
2.205     Uninstalling pip-23.2.1:
2.235 ERROR: Could not install packages due to an OSError: [Errno 22] Invalid argument: '/opt/python/versions/3.11.5/lib/python3.11/site-packages/pip-23.2.1.dist-info/'
2.235 
2.240 WARNING: Skipping /opt/python/versions/3.11.5/lib/python3.11/site-packages/pip-23.2.1.dist-info due to invalid metadata entry 'name'
2.240 WARNING: Ignoring invalid distribution ~ip (/opt/python/versions/3.11.5/lib/python3.11/site-packages)
------
Dockerfile:156
--------------------
 155 |     
 156 | >>> RUN pip install --no-cache-dir -U \
 157 | >>>     pip=="$PIPTOOL_VERSION" \
 158 | >>>     wheel \
 159 | >>>     && pip install --no-cache-dir -U \
 160 | >>>     Mercurial \
 161 | >>>     conan=="$CONAN_VERSION" \
 162 | >>>     pip \
 163 | >>>     pipenv=="$PYTHON_PIPENV_VERSION" \
 164 | >>>     poetry=="$PYTHON_POETRY_VERSION" \
 165 | >>>     python-inspector=="$PYTHON_INSPECTOR_VERSION"
 166 |     
--------------------
ERROR: failed to solve: process "/bin/bash -o pipefail -c pip install --no-cache-dir -U     pip==\"$PIPTOOL_VERSION\"     wheel     && pip install --no-cache-dir -U     Mercurial     conan==\"$CONAN_VERSION\"     pip     pipenv==\"$PYTHON_PIPENV_VERSION\"     poetry==\"$PYTHON_POETRY_VERSION\"     python-inspector==\"$PYTHON_INSPECTOR_VERSION\"" did not complete successfully: exit code: 1
sschuberth commented 10 months ago

@heliocastro does this ring a bell?

heliocastro commented 10 months ago

Can you please build like below and attach log in some gist ?

./scripts/docker_build --progress=plain --no-cache
remi-cogito commented 10 months ago 
#8 75.44 changing mode of /opt/python/versions/3.11.5/lib/python3.11/lib-dynload/__pycache__ to 755
#8 75.44 running install_scripts
#8 75.44 copying build/scripts-3.11/pydoc3.11 -> /opt/python/versions/3.11.5/bin
#8 75.44 copying build/scripts-3.11/idle3.11 -> /opt/python/versions/3.11.5/bin
#8 75.44 copying build/scripts-3.11/2to3-3.11 -> /opt/python/versions/3.11.5/bin
#8 75.44 changing mode of /opt/python/versions/3.11.5/bin/pydoc3.11 to 755
#8 75.44 changing mode of /opt/python/versions/3.11.5/bin/idle3.11 to 755
#8 75.44 changing mode of /opt/python/versions/3.11.5/bin/2to3-3.11 to 755
#8 75.44 rm /opt/python/versions/3.11.5/lib/python3.11/lib-dynload/_sysconfigdata__linux_x86_64-linux-gnu.py
#8 75.44 rm -r /opt/python/versions/3.11.5/lib/python3.11/lib-dynload/__pycache__
#8 75.44 Creating directory /opt/python/versions/3.11.5/share/man
#8 75.44 Creating directory /opt/python/versions/3.11.5/share/man/man1
#8 75.44 /usr/bin/install -c -m 644 ./Misc/python.man \
#8 75.44    /opt/python/versions/3.11.5/share/man/man1/python3.11.1
#8 75.44 if test ! -d /opt/python/versions/3.11.5/lib/pkgconfig; then \
#8 75.44    echo "Creating directory /opt/python/versions/3.11.5/lib/pkgconfig"; \
#8 75.44    /usr/bin/install -c -d -m 755 /opt/python/versions/3.11.5/lib/pkgconfig; \
#8 75.44 fi
#8 75.44 if test -f /opt/python/versions/3.11.5/bin/python3 -o -h /opt/python/versions/3.11.5/bin/python3; \
#8 75.44 then rm -f /opt/python/versions/3.11.5/bin/python3; \
#8 75.44 else true; \
#8 75.44 fi
#8 75.44 (cd /opt/python/versions/3.11.5/bin; ln -s python3.11 python3)
#8 75.44 if test "3.11" != "3.11"; then \
#8 75.44    rm -f /opt/python/versions/3.11.5/bin/python3.11-config; \
#8 75.44    (cd /opt/python/versions/3.11.5/bin; ln -s python3.11-config python3.11-config); \
#8 75.44    rm -f /opt/python/versions/3.11.5/lib/pkgconfig/python-3.11.pc; \
#8 75.44    (cd /opt/python/versions/3.11.5/lib/pkgconfig; ln -s python-3.11.pc python-3.11.pc); \
#8 75.44    rm -f /opt/python/versions/3.11.5/lib/pkgconfig/python-3.11-embed.pc; \
#8 75.44    (cd /opt/python/versions/3.11.5/lib/pkgconfig; ln -s python-3.11-embed.pc python-3.11-embed.pc); \
#8 75.44 fi
#8 75.44 rm -f /opt/python/versions/3.11.5/bin/python3-config
#8 75.44 (cd /opt/python/versions/3.11.5/bin; ln -s python3.11-config python3-config)
#8 75.44 rm -f /opt/python/versions/3.11.5/lib/pkgconfig/python3.pc
#8 75.44 (cd /opt/python/versions/3.11.5/lib/pkgconfig; ln -s python-3.11.pc python3.pc)
#8 75.44 rm -f /opt/python/versions/3.11.5/lib/pkgconfig/python3-embed.pc
#8 75.44 (cd /opt/python/versions/3.11.5/lib/pkgconfig; ln -s python-3.11-embed.pc python3-embed.pc)
#8 75.44 rm -f /opt/python/versions/3.11.5/bin/idle3
#8 75.44 (cd /opt/python/versions/3.11.5/bin; ln -s idle3.11 idle3)
#8 75.44 rm -f /opt/python/versions/3.11.5/bin/pydoc3
#8 75.44 (cd /opt/python/versions/3.11.5/bin; ln -s pydoc3.11 pydoc3)
#8 75.44 rm -f /opt/python/versions/3.11.5/bin/2to3
#8 75.44 (cd /opt/python/versions/3.11.5/bin; ln -s 2to3-3.11 2to3)
#8 75.44 if test "x" != "x" ; then \
#8 75.44    rm -f /opt/python/versions/3.11.5/bin/python3-32; \
#8 75.44    (cd /opt/python/versions/3.11.5/bin; ln -s python3.11-32 python3-32) \
#8 75.44 fi
#8 75.44 if test "x" != "x" ; then \
#8 75.44    rm -f /opt/python/versions/3.11.5/bin/python3-intel64; \
#8 75.44    (cd /opt/python/versions/3.11.5/bin; ln -s python3.11-intel64 python3-intel64) \
#8 75.44 fi
#8 75.44 rm -f /opt/python/versions/3.11.5/share/man/man1/python3.1
#8 75.44 (cd /opt/python/versions/3.11.5/share/man/man1; ln -s python3.11.1 python3.1)
#8 75.44 if test "xupgrade" != "xno"  ; then \
#8 75.44    case upgrade in \
#8 75.44        upgrade) ensurepip="--upgrade" ;; \
#8 75.44        install|*) ensurepip="" ;; \
#8 75.44    esac; \
#8 75.44    LD_LIBRARY_PATH=/tmp/python-build.20231117171724.123/Python-3.11.5 ./python -E -m ensurepip \
#8 75.44        $ensurepip --root=/ ; \
#8 75.44 fi
#8 77.44 Looking in links: /tmp/tmpirhh1120
#8 77.44 Processing /tmp/tmpirhh1120/setuptools-65.5.0-py3-none-any.whl
#8 77.44 Processing /tmp/tmpirhh1120/pip-23.2.1-py3-none-any.whl
#8 77.44 Installing collected packages: setuptools, pip
#8 79.44   WARNING: The scripts pip3 and pip3.11 are installed in '/opt/python/versions/3.11.5/bin' which is not on PATH.
#8 79.44   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
#8 79.44 Successfully installed pip-23.2.1 setuptools-65.5.0
#8 81.67 Installed Python-3.11.5 to /opt/python/versions/3.11.5
#8 DONE 82.0s

#9 [pythonbuild 3/4] RUN pip install --no-cache-dir -U     pip=="22.2.2"     wheel     && pip install --no-cache-dir -U     Mercurial     conan=="1.61.0"     pip     pipenv=="2022.9.24"     poetry=="1.6.1"     python-inspector=="0.10.0"
#9 1.341 Collecting pip==22.2.2
#9 1.512   Downloading pip-22.2.2-py3-none-any.whl (2.0 MB)
#9 1.677      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 13.0 MB/s eta 0:00:00
#9 1.770 Collecting wheel
#9 1.771   Obtaining dependency information for wheel from https://files.pythonhosted.org/packages/fa/7f/4c07234086edbce4a0a446209dc0cb08a19bb206a3ea53b2f56a403f983b/wheel-0.41.3-py3-none-any.whl.metadata
#9 1.799   Downloading wheel-0.41.3-py3-none-any.whl.metadata (2.2 kB)
#9 1.832 Downloading wheel-0.41.3-py3-none-any.whl (65 kB)
#9 1.835    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.8/65.8 kB 369.9 MB/s eta 0:00:00
#9 1.901 Installing collected packages: wheel, pip
#9 1.959   Attempting uninstall: pip
#9 1.962     Found existing installation: pip 23.2.1
#9 2.018     Uninstalling pip-23.2.1:
#9 2.184 ERROR: Could not install packages due to an OSError: [Errno 22] Invalid argument: '/opt/python/versions/3.11.5/lib/python3.11/site-packages/pip-23.2.1.dist-info/'
#9 2.184 
#9 2.189 WARNING: Skipping /opt/python/versions/3.11.5/lib/python3.11/site-packages/pip-23.2.1.dist-info due to invalid metadata entry 'name'
#9 2.189 WARNING: Ignoring invalid distribution ~ip (/opt/python/versions/3.11.5/lib/python3.11/site-packages)
#9 ERROR: process "/bin/bash -o pipefail -c pip install --no-cache-dir -U     pip==\"$PIPTOOL_VERSION\"     wheel     && pip install --no-cache-dir -U     Mercurial     conan==\"$CONAN_VERSION\"     pip     pipenv==\"$PYTHON_PIPENV_VERSION\"     poetry==\"$PYTHON_POETRY_VERSION\"     python-inspector==\"$PYTHON_INSPECTOR_VERSION\"" did not complete successfully: exit code: 1
------
 > [pythonbuild 3/4] RUN pip install --no-cache-dir -U     pip=="22.2.2"     wheel     && pip install --no-cache-dir -U     Mercurial     conan=="1.61.0"     pip     pipenv=="2022.9.24"     poetry=="1.6.1"     python-inspector=="0.10.0":
1.832 Downloading wheel-0.41.3-py3-none-any.whl (65 kB)
1.835    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.8/65.8 kB 369.9 MB/s eta 0:00:00
1.901 Installing collected packages: wheel, pip
1.959   Attempting uninstall: pip
1.962     Found existing installation: pip 23.2.1
2.018     Uninstalling pip-23.2.1:
2.184 ERROR: Could not install packages due to an OSError: [Errno 22] Invalid argument: '/opt/python/versions/3.11.5/lib/python3.11/site-packages/pip-23.2.1.dist-info/'
2.184 
2.189 WARNING: Skipping /opt/python/versions/3.11.5/lib/python3.11/site-packages/pip-23.2.1.dist-info due to invalid metadata entry 'name'
2.189 WARNING: Ignoring invalid distribution ~ip (/opt/python/versions/3.11.5/lib/python3.11/site-packages)
------
Dockerfile:156
--------------------
 155 |     
 156 | >>> RUN pip install --no-cache-dir -U \
 157 | >>>     pip=="$PIPTOOL_VERSION" \
 158 | >>>     wheel \
 159 | >>>     && pip install --no-cache-dir -U \
 160 | >>>     Mercurial \
 161 | >>>     conan=="$CONAN_VERSION" \
 162 | >>>     pip \
 163 | >>>     pipenv=="$PYTHON_PIPENV_VERSION" \
 164 | >>>     poetry=="$PYTHON_POETRY_VERSION" \
 165 | >>>     python-inspector=="$PYTHON_INSPECTOR_VERSION"
 166 |     
--------------------
ERROR: failed to solve: process "/bin/bash -o pipefail -c pip install --no-cache-dir -U     pip==\"$PIPTOOL_VERSION\"     wheel     && pip install --no-cache-dir -U     Mercurial     conan==\"$CONAN_VERSION\"     pip     pipenv==\"$PYTHON_PIPENV_VERSION\"     poetry==\"$PYTHON_POETRY_VERSION\"     python-inspector==\"$PYTHON_INSPECTOR_VERSION\"" did not complete successfully: exit code: 1
heliocastro commented 10 months ago

Not enough, i need to see the log for the base image, very first one installed. And what are your architecture ?

remi-cogito commented 10 months ago

logs.txt System: DISTRIB_ID=Ubuntu DISTRIB_RELEASE=22.04 DISTRIB_CODENAME=jammy DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"

heliocastro commented 10 months ago

Somehow weird thing is happening on your side. Your system is trying to downgrade pip. Did you have PIPTOOL_VERSION set or .versions modified ?

#9 [pythonbuild 3/4] RUN pip install --no-cache-dir -U     pip=="22.2.2"     wheel     && pip install --no-cache-dir -U     Mercurial     conan=="1.61.0"     pip     pipenv=="2022.9.24"     poetry=="1.6.1"     python-inspector=="0.10.0"
#9 1.341 Collecting pip==22.2.2
#9 1.512   Downloading pip-22.2.2-py3-none-any.whl (2.0 MB)

Definitively not make sense to me.

sschuberth commented 6 months ago

Did you have PIPTOOL_VERSION set or .versions modified ?

Any feedback @remi-cogito?