Closed nirik closed 1 year ago
Not only does the process take up excessive amounts of memory but it also nearly 100% of CPU resources, thus starving other containers and services of the resources that they need for their proper functioning. I started the build from the same Dockerfile
(which previously had fedora:37
as the base container image) in a virtual machine in my homelab and I cancelled the build when it was stuck at the Resolving dependencies...
stage and used up a little over 50% of the memory I allotted to the virtual machine.
For debugging purposes, it is the Poetry v1:1.14-1.fc37
that was used in building the container image previously.
I tried using fedora:38
as the base image but poetry
failed to install the project when it was asked to not use a virtual environment. Here are the logs for debugging.
[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
Install the buildx component to build images with BuildKit:
https://docs.docker.com/go/buildx/
Sending build context to Docker daemon 355.3kB
Step 1/11 : FROM registry.fedoraproject.org/fedora:38
---> 72c9e4564235
Step 2/11 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
---> Using cache
---> 1daefb639266
Step 3/11 : EXPOSE 8080
---> Using cache
---> e933d9096523
Step 4/11 : COPY . /code
---> Using cache
---> 4cb42e4783ac
Step 5/11 : WORKDIR /code
---> Using cache
---> 51176d311652
Step 6/11 : ENV PYTHONUNBUFFERED=1
---> Using cache
---> cec5ca5416e6
Step 7/11 : RUN rm -rf /code/poetry.lock
---> Using cache
---> 50355168c01e
Step 8/11 : RUN dnf -y install python3-pip poetry && dnf -y clean all
---> Running in 282a96b7a866
Fedora 38 - x86_64 8.0 MB/s | 83 MB 00:10
Fedora 38 openh264 (From Cisco) - x86_64 847 B/s | 2.5 kB 00:03
Fedora Modular 38 - x86_64 556 kB/s | 2.8 MB 00:05
Fedora 38 - x86_64 - Updates 4.1 MB/s | 32 MB 00:07
Fedora Modular 38 - x86_64 - Updates 363 kB/s | 2.1 MB 00:06
Dependencies resolved.
================================================================================
Package Arch Version Repo Size
================================================================================
Installing:
poetry noarch 1.3.2-3.fc38 fedora 17 k
python3-pip noarch 22.3.1-3.fc38 updates 3.1 M
Installing dependencies:
python-wheel-wheel noarch 1:0.38.4-2.fc38 fedora 43 k
python3-CacheControl noarch 0.12.11-4.fc38 fedora 60 k
python3-CacheControl+filecache noarch 0.12.11-4.fc38 fedora 8.7 k
python3-async-timeout noarch 4.0.2-6.fc38 fedora 19 k
python3-attrs noarch 22.2.0-2.fc38 fedora 124 k
python3-cffi x86_64 1.15.1-4.fc38 fedora 311 k
python3-charset-normalizer noarch 3.1.0-1.fc38 fedora 107 k
python3-cleo noarch 2.0.1-1.fc38 fedora 235 k
python3-crashtest noarch 0.4.1-1.fc38 fedora 33 k
python3-cryptography x86_64 37.0.2-8.fc38 fedora 1.2 M
python3-deprecated noarch 1.2.14-1.fc38 updates 26 k
python3-distlib noarch 0.3.6-2.fc38 fedora 270 k
python3-dulwich x86_64 0.21.2-1.fc38 fedora 605 k
python3-filelock noarch 3.8.2-2.fc38 fedora 40 k
python3-html5lib noarch 1:1.1-11.fc38 fedora 295 k
python3-idna noarch 3.4-2.fc38 fedora 110 k
python3-importlib-metadata noarch 6.0.0-2.fc38 fedora 59 k
python3-jaraco noarch 9.1.2-2.fc38 fedora 10 k
python3-jaraco-classes noarch 3.2.3-2.fc38 fedora 23 k
python3-jeepney noarch 0.8.0-4.fc38 fedora 418 k
python3-jsonschema noarch 4.17.3-2.fc38 fedora 201 k
python3-keyring noarch 23.11.0-3.fc38 fedora 113 k
python3-lockfile noarch 1:0.12.2-9.fc38 fedora 40 k
python3-more-itertools noarch 8.13.0-2.fc38 fedora 95 k
python3-msgpack x86_64 1.0.4-4.fc38 fedora 96 k
python3-packaging noarch 23.0-1.fc38 fedora 106 k
python3-pexpect noarch 4.8.0-14.fc38 fedora 170 k
python3-pkginfo noarch 1.9.6-1.fc38 fedora 51 k
python3-platformdirs noarch 2.6.0-2.fc38 fedora 42 k
python3-ply noarch 3.11-18.fc38 fedora 139 k
python3-poetry noarch 1.3.2-3.fc38 fedora 587 k
python3-poetry-core noarch 1.4.0-1.fc38 fedora 1.2 M
python3-poetry-plugin-export noarch 1.3.0-2.fc38 fedora 35 k
python3-ptyprocess noarch 0.7.0-3.fc38 fedora 36 k
python3-pycparser noarch 2.20-9.fc38 fedora 156 k
python3-pyrsistent x86_64 0.19.3-2.fc38 fedora 139 k
python3-pysocks noarch 1.7.1-16.fc38 fedora 40 k
python3-rapidfuzz x86_64 2.13.7-1.fc38 fedora 1.5 M
python3-redis noarch 4.3.4-2.fc38 fedora 502 k
python3-requests noarch 2.28.2-2.fc38 updates 155 k
python3-requests-toolbelt noarch 0.10.1-3.fc38 fedora 122 k
python3-secretstorage noarch 3.3.3-2.fc38 fedora 46 k
python3-setuptools noarch 65.5.1-2.fc38 fedora 1.7 M
python3-shellingham noarch 1.5.0-2.fc38 fedora 33 k
python3-six noarch 1.16.0-9.fc38 fedora 42 k
python3-tomlkit noarch 0.11.4-2.fc38 fedora 117 k
python3-trove-classifiers noarch 2023.4.25-1.fc38 updates 26 k
python3-urllib3 noarch 1.26.16-1.fc38 updates 257 k
python3-urllib3+socks noarch 1.26.16-1.fc38 updates 9.7 k
python3-virtualenv noarch 20.21.1-1.fc38 updates 310 k
python3-webencodings noarch 0.5.1-20.fc38 fedora 36 k
python3-wrapt x86_64 1.14.1-2.fc38 fedora 69 k
python3-zipp noarch 3.12.0-1.fc38 fedora 22 k
Installing weak dependencies:
libxcrypt-compat x86_64 4.4.36-1.fc38 updates 90 k
python3-CacheControl+redis noarch 0.12.11-4.fc38 fedora 8.7 k
Transaction Summary
================================================================================
Install 57 Packages
Total download size: 15 M
Installed size: 65 M
Downloading Packages:
(1/57): python3-CacheControl+filecache-0.12.11- 23 kB/s | 8.7 kB 00:00
(2/57): poetry-1.3.2-3.fc38.noarch.rpm 32 kB/s | 17 kB 00:00
(3/57): python3-CacheControl+redis-0.12.11-4.fc 56 kB/s | 8.7 kB 00:00
(4/57): python-wheel-wheel-0.38.4-2.fc38.noarch 62 kB/s | 43 kB 00:00
(5/57): python3-async-timeout-4.0.2-6.fc38.noar 111 kB/s | 19 kB 00:00
(6/57): python3-CacheControl-0.12.11-4.fc38.noa 211 kB/s | 60 kB 00:00
(7/57): python3-charset-normalizer-3.1.0-1.fc38 353 kB/s | 107 kB 00:00
(8/57): python3-cffi-1.15.1-4.fc38.x86_64.rpm 544 kB/s | 311 kB 00:00
(9/57): python3-cleo-2.0.1-1.fc38.noarch.rpm 760 kB/s | 235 kB 00:00
(10/57): python3-crashtest-0.4.1-1.fc38.noarch. 200 kB/s | 33 kB 00:00
(11/57): python3-distlib-0.3.6-2.fc38.noarch.rp 1.6 MB/s | 270 kB 00:00
(12/57): python3-attrs-22.2.0-2.fc38.noarch.rpm 123 kB/s | 124 kB 00:01
(13/57): python3-cryptography-37.0.2-8.fc38.x86 2.9 MB/s | 1.2 MB 00:00
(14/57): python3-dulwich-0.21.2-1.fc38.x86_64.r 1.7 MB/s | 605 kB 00:00
(15/57): python3-html5lib-1.1-11.fc38.noarch.rp 1.7 MB/s | 295 kB 00:00
(16/57): python3-idna-3.4-2.fc38.noarch.rpm 676 kB/s | 110 kB 00:00
(17/57): python3-importlib-metadata-6.0.0-2.fc3 395 kB/s | 59 kB 00:00
(18/57): python3-filelock-3.8.2-2.fc38.noarch.r 73 kB/s | 40 kB 00:00
(19/57): python3-jaraco-9.1.2-2.fc38.noarch.rpm 61 kB/s | 10 kB 00:00
(20/57): python3-jaraco-classes-3.2.3-2.fc38.no 143 kB/s | 23 kB 00:00
(21/57): python3-jsonschema-4.17.3-2.fc38.noarc 1.3 MB/s | 201 kB 00:00
(22/57): python3-keyring-23.11.0-3.fc38.noarch. 686 kB/s | 113 kB 00:00
(23/57): python3-lockfile-0.12.2-9.fc38.noarch. 237 kB/s | 40 kB 00:00
(24/57): python3-more-itertools-8.13.0-2.fc38.n 529 kB/s | 95 kB 00:00
(25/57): python3-msgpack-1.0.4-4.fc38.x86_64.rp 587 kB/s | 96 kB 00:00
(26/57): python3-packaging-23.0-1.fc38.noarch.r 583 kB/s | 106 kB 00:00
(27/57): python3-pexpect-4.8.0-14.fc38.noarch.r 1.1 MB/s | 170 kB 00:00
(28/57): python3-pkginfo-1.9.6-1.fc38.noarch.rp 266 kB/s | 51 kB 00:00
(29/57): python3-platformdirs-2.6.0-2.fc38.noar 282 kB/s | 42 kB 00:00
(30/57): python3-poetry-1.3.2-3.fc38.noarch.rpm 2.6 MB/s | 587 kB 00:00
(31/57): python3-ply-3.11-18.fc38.noarch.rpm 514 kB/s | 139 kB 00:00
(32/57): python3-poetry-plugin-export-1.3.0-2.f 234 kB/s | 35 kB 00:00
(33/57): python3-poetry-core-1.4.0-1.fc38.noarc 4.1 MB/s | 1.2 MB 00:00
(34/57): python3-ptyprocess-0.7.0-3.fc38.noarch 236 kB/s | 36 kB 00:00
(35/57): python3-pycparser-2.20-9.fc38.noarch.r 874 kB/s | 156 kB 00:00
(36/57): python3-pyrsistent-0.19.3-2.fc38.x86_6 820 kB/s | 139 kB 00:00
(37/57): python3-pysocks-1.7.1-16.fc38.noarch.r 254 kB/s | 40 kB 00:00
(38/57): python3-redis-4.3.4-2.fc38.noarch.rpm 2.8 MB/s | 502 kB 00:00
(39/57): python3-rapidfuzz-2.13.7-1.fc38.x86_64 4.3 MB/s | 1.5 MB 00:00
(40/57): python3-secretstorage-3.3.3-2.fc38.noa 292 kB/s | 46 kB 00:00
(41/57): python3-requests-toolbelt-0.10.1-3.fc3 651 kB/s | 122 kB 00:00
(42/57): python3-shellingham-1.5.0-2.fc38.noarc 181 kB/s | 33 kB 00:00
(43/57): python3-setuptools-65.5.1-2.fc38.noarc 5.1 MB/s | 1.7 MB 00:00
(44/57): python3-six-1.16.0-9.fc38.noarch.rpm 284 kB/s | 42 kB 00:00
(45/57): python3-tomlkit-0.11.4-2.fc38.noarch.r 614 kB/s | 117 kB 00:00
(46/57): python3-webencodings-0.5.1-20.fc38.noa 193 kB/s | 36 kB 00:00
(47/57): python3-wrapt-1.14.1-2.fc38.x86_64.rpm 416 kB/s | 69 kB 00:00
(48/57): python3-zipp-3.12.0-1.fc38.noarch.rpm 123 kB/s | 22 kB 00:00
(49/57): python3-deprecated-1.2.14-1.fc38.noarc 69 kB/s | 26 kB 00:00
(50/57): libxcrypt-compat-4.4.36-1.fc38.x86_64. 183 kB/s | 90 kB 00:00
(51/57): python3-requests-2.28.2-2.fc38.noarch. 626 kB/s | 155 kB 00:00
(52/57): python3-trove-classifiers-2023.4.25-1. 199 kB/s | 26 kB 00:00
(53/57): python3-urllib3+socks-1.26.16-1.fc38.n 76 kB/s | 9.7 kB 00:00
(54/57): python3-urllib3-1.26.16-1.fc38.noarch. 1.0 MB/s | 257 kB 00:00
(55/57): python3-virtualenv-20.21.1-1.fc38.noar 2.3 MB/s | 310 kB 00:00
(56/57): python3-pip-22.3.1-3.fc38.noarch.rpm 2.1 MB/s | 3.1 MB 00:01
(57/57): python3-jeepney-0.8.0-4.fc38.noarch.rp 59 kB/s | 418 kB 00:07
--------------------------------------------------------------------------------
Total 1.4 MB/s | 15 MB 00:10
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : python3-six-1.16.0-9.fc38.noarch 1/57
Installing : python3-setuptools-65.5.1-2.fc38.noarch 2/57
Installing : python3-poetry-core-1.4.0-1.fc38.noarch 3/57
Installing : python3-platformdirs-2.6.0-2.fc38.noarch 4/57
Installing : python3-packaging-23.0-1.fc38.noarch 5/57
Installing : python3-lockfile-1:0.12.2-9.fc38.noarch 6/57
Installing : python3-jeepney-0.8.0-4.fc38.noarch 7/57
Installing : python3-idna-3.4-2.fc38.noarch 8/57
Installing : python3-filelock-3.8.2-2.fc38.noarch 9/57
Installing : python3-crashtest-0.4.1-1.fc38.noarch 10/57
Installing : python3-pkginfo-1.9.6-1.fc38.noarch 11/57
Installing : python3-trove-classifiers-2023.4.25-1.fc38.noarch 12/57
Installing : libxcrypt-compat-4.4.36-1.fc38.x86_64 13/57
Installing : python3-zipp-3.12.0-1.fc38.noarch 14/57
Installing : python3-importlib-metadata-6.0.0-2.fc38.noarch 15/57
Installing : python3-wrapt-1.14.1-2.fc38.x86_64 16/57
Installing : python3-deprecated-1.2.14-1.fc38.noarch 17/57
Installing : python3-webencodings-0.5.1-20.fc38.noarch 18/57
Installing : python3-html5lib-1:1.1-11.fc38.noarch 19/57
Installing : python3-tomlkit-0.11.4-2.fc38.noarch 20/57
Installing : python3-shellingham-1.5.0-2.fc38.noarch 21/57
Installing : python3-rapidfuzz-2.13.7-1.fc38.x86_64 22/57
Installing : python3-cleo-2.0.1-1.fc38.noarch 23/57
Installing : python3-pysocks-1.7.1-16.fc38.noarch 24/57
Installing : python3-urllib3+socks-1.26.16-1.fc38.noarch 25/57
Installing : python3-urllib3-1.26.16-1.fc38.noarch 26/57
Installing : python3-dulwich-0.21.2-1.fc38.x86_64 27/57
Installing : python3-pyrsistent-0.19.3-2.fc38.x86_64 28/57
Installing : python3-ptyprocess-0.7.0-3.fc38.noarch 29/57
Installing : python3-pexpect-4.8.0-14.fc38.noarch 30/57
Installing : python3-ply-3.11-18.fc38.noarch 31/57
Installing : python3-pycparser-2.20-9.fc38.noarch 32/57
Installing : python3-cffi-1.15.1-4.fc38.x86_64 33/57
Installing : python3-cryptography-37.0.2-8.fc38.x86_64 34/57
Installing : python3-secretstorage-3.3.3-2.fc38.noarch 35/57
Installing : python3-msgpack-1.0.4-4.fc38.x86_64 36/57
Installing : python3-more-itertools-8.13.0-2.fc38.noarch 37/57
Installing : python3-jaraco-9.1.2-2.fc38.noarch 38/57
Installing : python3-jaraco-classes-3.2.3-2.fc38.noarch 39/57
Installing : python3-keyring-23.11.0-3.fc38.noarch 40/57
Installing : python3-distlib-0.3.6-2.fc38.noarch 41/57
Installing : python3-charset-normalizer-3.1.0-1.fc38.noarch 42/57
Installing : python3-requests-2.28.2-2.fc38.noarch 43/57
Installing : python3-requests-toolbelt-0.10.1-3.fc38.noarch 44/57
Installing : python3-attrs-22.2.0-2.fc38.noarch 45/57
Installing : python3-jsonschema-4.17.3-2.fc38.noarch 46/57
Installing : python3-async-timeout-4.0.2-6.fc38.noarch 47/57
Installing : python3-redis-4.3.4-2.fc38.noarch 48/57
Installing : python3-CacheControl+redis-0.12.11-4.fc38.noarch 49/57
Installing : python3-CacheControl-0.12.11-4.fc38.noarch 50/57
Installing : python3-CacheControl+filecache-0.12.11-4.fc38.noar 51/57
Installing : python-wheel-wheel-1:0.38.4-2.fc38.noarch 52/57
Installing : python3-virtualenv-20.21.1-1.fc38.noarch 53/57
Installing : python3-poetry-plugin-export-1.3.0-2.fc38.noarch 54/57
Installing : python3-poetry-1.3.2-3.fc38.noarch 55/57
Installing : poetry-1.3.2-3.fc38.noarch 56/57
Installing : python3-pip-22.3.1-3.fc38.noarch 57/57
Running scriptlet: python3-pip-22.3.1-3.fc38.noarch 57/57
Verifying : poetry-1.3.2-3.fc38.noarch 1/57
Verifying : python-wheel-wheel-1:0.38.4-2.fc38.noarch 2/57
Verifying : python3-CacheControl+filecache-0.12.11-4.fc38.noar 3/57
Verifying : python3-CacheControl+redis-0.12.11-4.fc38.noarch 4/57
Verifying : python3-CacheControl-0.12.11-4.fc38.noarch 5/57
Verifying : python3-async-timeout-4.0.2-6.fc38.noarch 6/57
Verifying : python3-attrs-22.2.0-2.fc38.noarch 7/57
Verifying : python3-cffi-1.15.1-4.fc38.x86_64 8/57
Verifying : python3-charset-normalizer-3.1.0-1.fc38.noarch 9/57
Verifying : python3-cleo-2.0.1-1.fc38.noarch 10/57
Verifying : python3-crashtest-0.4.1-1.fc38.noarch 11/57
Verifying : python3-cryptography-37.0.2-8.fc38.x86_64 12/57
Verifying : python3-distlib-0.3.6-2.fc38.noarch 13/57
Verifying : python3-dulwich-0.21.2-1.fc38.x86_64 14/57
Verifying : python3-filelock-3.8.2-2.fc38.noarch 15/57
Verifying : python3-html5lib-1:1.1-11.fc38.noarch 16/57
Verifying : python3-idna-3.4-2.fc38.noarch 17/57
Verifying : python3-importlib-metadata-6.0.0-2.fc38.noarch 18/57
Verifying : python3-jaraco-9.1.2-2.fc38.noarch 19/57
Verifying : python3-jaraco-classes-3.2.3-2.fc38.noarch 20/57
Verifying : python3-jeepney-0.8.0-4.fc38.noarch 21/57
Verifying : python3-jsonschema-4.17.3-2.fc38.noarch 22/57
Verifying : python3-keyring-23.11.0-3.fc38.noarch 23/57
Verifying : python3-lockfile-1:0.12.2-9.fc38.noarch 24/57
Verifying : python3-more-itertools-8.13.0-2.fc38.noarch 25/57
Verifying : python3-msgpack-1.0.4-4.fc38.x86_64 26/57
Verifying : python3-packaging-23.0-1.fc38.noarch 27/57
Verifying : python3-pexpect-4.8.0-14.fc38.noarch 28/57
Verifying : python3-pkginfo-1.9.6-1.fc38.noarch 29/57
Verifying : python3-platformdirs-2.6.0-2.fc38.noarch 30/57
Verifying : python3-ply-3.11-18.fc38.noarch 31/57
Verifying : python3-poetry-1.3.2-3.fc38.noarch 32/57
Verifying : python3-poetry-core-1.4.0-1.fc38.noarch 33/57
Verifying : python3-poetry-plugin-export-1.3.0-2.fc38.noarch 34/57
Verifying : python3-ptyprocess-0.7.0-3.fc38.noarch 35/57
Verifying : python3-pycparser-2.20-9.fc38.noarch 36/57
Verifying : python3-pyrsistent-0.19.3-2.fc38.x86_64 37/57
Verifying : python3-pysocks-1.7.1-16.fc38.noarch 38/57
Verifying : python3-rapidfuzz-2.13.7-1.fc38.x86_64 39/57
Verifying : python3-redis-4.3.4-2.fc38.noarch 40/57
Verifying : python3-requests-toolbelt-0.10.1-3.fc38.noarch 41/57
Verifying : python3-secretstorage-3.3.3-2.fc38.noarch 42/57
Verifying : python3-setuptools-65.5.1-2.fc38.noarch 43/57
Verifying : python3-shellingham-1.5.0-2.fc38.noarch 44/57
Verifying : python3-six-1.16.0-9.fc38.noarch 45/57
Verifying : python3-tomlkit-0.11.4-2.fc38.noarch 46/57
Verifying : python3-webencodings-0.5.1-20.fc38.noarch 47/57
Verifying : python3-wrapt-1.14.1-2.fc38.x86_64 48/57
Verifying : python3-zipp-3.12.0-1.fc38.noarch 49/57
Verifying : libxcrypt-compat-4.4.36-1.fc38.x86_64 50/57
Verifying : python3-deprecated-1.2.14-1.fc38.noarch 51/57
Verifying : python3-pip-22.3.1-3.fc38.noarch 52/57
Verifying : python3-requests-2.28.2-2.fc38.noarch 53/57
Verifying : python3-trove-classifiers-2023.4.25-1.fc38.noarch 54/57
Verifying : python3-urllib3+socks-1.26.16-1.fc38.noarch 55/57
Verifying : python3-urllib3-1.26.16-1.fc38.noarch 56/57
Verifying : python3-virtualenv-20.21.1-1.fc38.noarch 57/57
Installed:
libxcrypt-compat-4.4.36-1.fc38.x86_64
poetry-1.3.2-3.fc38.noarch
python-wheel-wheel-1:0.38.4-2.fc38.noarch
python3-CacheControl-0.12.11-4.fc38.noarch
python3-CacheControl+filecache-0.12.11-4.fc38.noarch
python3-CacheControl+redis-0.12.11-4.fc38.noarch
python3-async-timeout-4.0.2-6.fc38.noarch
python3-attrs-22.2.0-2.fc38.noarch
python3-cffi-1.15.1-4.fc38.x86_64
python3-charset-normalizer-3.1.0-1.fc38.noarch
python3-cleo-2.0.1-1.fc38.noarch
python3-crashtest-0.4.1-1.fc38.noarch
python3-cryptography-37.0.2-8.fc38.x86_64
python3-deprecated-1.2.14-1.fc38.noarch
python3-distlib-0.3.6-2.fc38.noarch
python3-dulwich-0.21.2-1.fc38.x86_64
python3-filelock-3.8.2-2.fc38.noarch
python3-html5lib-1:1.1-11.fc38.noarch
python3-idna-3.4-2.fc38.noarch
python3-importlib-metadata-6.0.0-2.fc38.noarch
python3-jaraco-9.1.2-2.fc38.noarch
python3-jaraco-classes-3.2.3-2.fc38.noarch
python3-jeepney-0.8.0-4.fc38.noarch
python3-jsonschema-4.17.3-2.fc38.noarch
python3-keyring-23.11.0-3.fc38.noarch
python3-lockfile-1:0.12.2-9.fc38.noarch
python3-more-itertools-8.13.0-2.fc38.noarch
python3-msgpack-1.0.4-4.fc38.x86_64
python3-packaging-23.0-1.fc38.noarch
python3-pexpect-4.8.0-14.fc38.noarch
python3-pip-22.3.1-3.fc38.noarch
python3-pkginfo-1.9.6-1.fc38.noarch
python3-platformdirs-2.6.0-2.fc38.noarch
python3-ply-3.11-18.fc38.noarch
python3-poetry-1.3.2-3.fc38.noarch
python3-poetry-core-1.4.0-1.fc38.noarch
python3-poetry-plugin-export-1.3.0-2.fc38.noarch
python3-ptyprocess-0.7.0-3.fc38.noarch
python3-pycparser-2.20-9.fc38.noarch
python3-pyrsistent-0.19.3-2.fc38.x86_64
python3-pysocks-1.7.1-16.fc38.noarch
python3-rapidfuzz-2.13.7-1.fc38.x86_64
python3-redis-4.3.4-2.fc38.noarch
python3-requests-2.28.2-2.fc38.noarch
python3-requests-toolbelt-0.10.1-3.fc38.noarch
python3-secretstorage-3.3.3-2.fc38.noarch
python3-setuptools-65.5.1-2.fc38.noarch
python3-shellingham-1.5.0-2.fc38.noarch
python3-six-1.16.0-9.fc38.noarch
python3-tomlkit-0.11.4-2.fc38.noarch
python3-trove-classifiers-2023.4.25-1.fc38.noarch
python3-urllib3-1.26.16-1.fc38.noarch
python3-urllib3+socks-1.26.16-1.fc38.noarch
python3-virtualenv-20.21.1-1.fc38.noarch
python3-webencodings-0.5.1-20.fc38.noarch
python3-wrapt-1.14.1-2.fc38.x86_64
python3-zipp-3.12.0-1.fc38.noarch
Complete!
42 files removed
Removing intermediate container 282a96b7a866
---> 6e57405404db
Step 9/11 : RUN poetry config virtualenvs.create false && poetry install
---> Running in 74f12f22e6e3
Skipping virtualenv creation, as specified in config file.
Updating dependencies
Resolving dependencies...
Writing lock file
Package operations: 68 installs, 18 updates, 0 removals
• Updating attrs (22.2.0 /usr/lib/python3.11/site-packages -> 23.1.0)
• Updating idna (3.4 /usr/lib/python3.11/site-packages -> 3.4)
• Updating pycparser (2.20 /usr/lib/python3.11/site-packages -> 2.21)
• Installing rpds-py (0.10.2)
• Updating setuptools (65.5.1 /usr/lib/python3.11/site-packages -> 68.2.2)
• Updating six (1.16.0 /usr/lib/python3.11/site-packages -> 1.16.0)
• Installing automat (22.10.0)
• Updating cffi (1.15.1 /usr/lib64/python3.11/site-packages -> 1.15.1)
• Installing constantly (15.1.0)
• Installing hyperlink (21.0.0)
• Installing incremental (22.10.0)
• Installing referencing (0.30.2)
• Installing pyasn1 (0.5.0)
• Installing typing-extensions (4.7.1)
• Installing zope-interface (6.0)
• Updating cryptography (37.0.2 /usr/lib64/python3.11/site-packages -> 41.0.3)
• Installing frozenlist (1.4.0)
• Installing iniconfig (2.0.0)
• Installing jsonschema-specifications (2023.7.1)
• Installing mdurl (0.1.2)
• Installing multidict (6.0.4)
• Updating packaging (23.0 /usr/lib/python3.11/site-packages -> 23.1)
• Installing pluggy (1.3.0)
• Installing pyasn1-modules (0.3.0)
• Installing smmap (5.0.0)
• Installing twisted (23.8.0)
• Updating wrapt (1.14.1 /usr/lib64/python3.11/site-packages -> 1.15.0)
• Installing aiosignal (1.3.1)
• Updating async-timeout (4.0.2 /usr/lib/python3.11/site-packages -> 4.0.3)
• Installing blinker (1.6.2)
• Updating charset-normalizer (3.1.0 /usr/lib/python3.11/site-packages -> 3.2.0)
• Installing click (8.1.7)
• Installing crochet (2.1.1)
• Updating distlib (0.3.6 /usr/lib/python3.11/site-packages -> 0.3.7)
• Updating filelock (3.8.2 /usr/lib/python3.11/site-packages -> 3.12.3)
• Installing gitdb (4.0.10)
• Updating jsonschema (4.17.3 /usr/lib/python3.11/site-packages -> 4.19.0)
• Installing markdown-it-py (3.0.0)
• Installing mccabe (0.7.0)
• Installing mypy-extensions (1.0.0)
• Installing pathspec (0.11.2)
• Installing pbr (5.11.1)
• Installing pika (1.3.2)
• Updating platformdirs (2.6.0 /usr/lib/python3.11/site-packages -> 3.10.0)
• Installing pycodestyle (2.9.1)
• Installing pyflakes (2.5.0)
• Installing pygments (2.16.1)
• Installing pyopenssl (23.2.0)
• Installing pytest (7.4.2)
• Installing pytz (2023.3.post1)
• Installing service-identity (23.1.0)
• Installing yarl (1.9.2)
• Installing aiohttp (3.8.5)
• Installing black (23.9.1)
• Installing cachetools (5.3.1)
• Installing certifi (2023.7.22)
• Installing chardet (5.2.0)
• Installing colorama (0.4.6)
• Installing coverage (7.3.1)
• Installing fedora-messaging (3.4.1)
• Installing flake8 (5.0.4)
• Installing gitpython (3.1.36)
• Installing isort (5.12.0)
• Installing pyproject-api (1.6.1)
• Installing pytest-asyncio (0.21.1)
• Installing pyyaml (6.0.1)
• Installing rich (13.5.2)
• Installing soupsieve (2.5)
• Installing stevedore (5.1.0)
• Installing toml (0.10.2)
• Updating urllib3 (1.26.16 /usr/lib/python3.11/site-packages -> 2.0.4)
• Updating virtualenv (20.21.1 /usr/lib/python3.11/site-packages -> 20.24.5)
• Installing aiosqlite (0.19.0)
• Installing bandit (1.7.5)
• Installing beautifulsoup4 (4.12.2)
• Installing gunicorn (20.1.0)
• Installing mdapi-messages (1.0.0)
• Installing pytest-aiohttp (1.0.5)
• Installing pytest-black (0.3.12)
• Installing pytest-cov (4.1.0)
• Installing pytest-flake8 (1.1.1)
• Installing pytest-isort (3.1.0)
• Installing pyzstd (0.15.9)
• Updating requests (2.28.2 /usr/lib/python3.11/site-packages -> 2.31.0)
• Installing tox (4.11.3)
• Installing uvloop (0.17.0)
Installing the current project: mdapi (3.1.2)
- Failed to create mdapi.pth for /code
Unable to access any of "/usr/local/lib/python3.11/site-packages/mdapi-3.1.2.dist-info", "/usr/local/lib64/python3.11/site-packages/mdapi-3.1.2.dist-info"
The command '/bin/sh -c poetry config virtualenvs.create false && poetry install' returned a non-zero code: 1
I suspect that I will have to probably push these releases on PyPI and then install them onto the base container image using pip when building the container to install them without any active virtual environment and system-wide.
The aforementioned error has been reported twice (here https://github.com/python-poetry/poetry/issues/6459 and here https://github.com/python-poetry/poetry/issues/7200) and attempted to be fixed (here https://github.com/python-poetry/poetry/pull/7766) but to no avail. There are workarounds to create, activate and use a virtual environment from within a container but frankly, I do not find them convincing.
This is interesting. I tried installing poetry
via pip
and then used poetry
to install the project. From what I understand - as one of the dependencies of project six
requires a certain specific version of setuptools
that conflicts with the version of setuptools
that is required by poetry
, the installation does not go through.
[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
Install the buildx component to build images with BuildKit:
https://docs.docker.com/go/buildx/
Sending build context to Docker daemon 355.3kB
Step 1/12 : FROM registry.fedoraproject.org/fedora:38
---> 72c9e4564235
Step 2/12 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
---> Using cache
---> 1daefb639266
Step 3/12 : EXPOSE 8080
---> Using cache
---> e933d9096523
Step 4/12 : COPY . /code
---> 05602063e0ad
Step 5/12 : WORKDIR /code
---> Running in cd7bc4da0d5d
Removing intermediate container cd7bc4da0d5d
---> fd793d6de7da
Step 6/12 : ENV PYTHONUNBUFFERED=1
---> Running in 42f4b1ed5eb1
Removing intermediate container 42f4b1ed5eb1
---> 21d380eeb1f9
Step 7/12 : RUN rm -rf /code/poetry.lock
---> Running in d8d5a2721777
Removing intermediate container d8d5a2721777
---> e72ce3ce70ab
Step 8/12 : RUN dnf -y install python3-pip && dnf -y clean all
---> Running in 26a5dcb864fd
Fedora 38 - x86_64 8.3 MB/s | 83 MB 00:09
Fedora 38 openh264 (From Cisco) - x86_64 729 B/s | 2.5 kB 00:03
Fedora Modular 38 - x86_64 784 kB/s | 2.8 MB 00:03
^C
[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
Install the buildx component to build images with BuildKit:
https://docs.docker.com/go/buildx/
Sending build context to Docker daemon 355.3kB
Step 1/12 : FROM registry.fedoraproject.org/fedora:38
---> 72c9e4564235
Step 2/12 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
---> Using cache
---> 1daefb639266
Step 3/12 : EXPOSE 8080
---> Using cache
---> e933d9096523
Step 4/12 : COPY . /code
---> Using cache
---> 05602063e0ad
Step 5/12 : WORKDIR /code
---> Using cache
---> fd793d6de7da
Step 6/12 : ENV PYTHONUNBUFFERED=1
---> Using cache
---> 21d380eeb1f9
Step 7/12 : RUN rm -rf /code/poetry.lock
---> Using cache
---> e72ce3ce70ab
Step 8/12 : RUN dnf -y install python3-pip && dnf -y clean all
---> Running in dbdbe60b1754
Fedora 38 - x86_64 7.3 MB/s | 83 MB 00:11
Fedora 38 openh264 (From Cisco) - x86_64 616 B/s | 2.5 kB 00:04
Fedora Modular 38 - x86_64 1.1 MB/s | 2.8 MB 00:02
Fedora 38 - x86_64 - Updates 4.6 MB/s | 32 MB 00:07
Fedora Modular 38 - x86_64 - Updates 321 kB/s | 2.1 MB 00:06
Dependencies resolved.
================================================================================
Package Architecture Version Repository Size
================================================================================
Installing:
python3-pip noarch 22.3.1-3.fc38 updates 3.1 M
Installing weak dependencies:
libxcrypt-compat x86_64 4.4.36-1.fc38 updates 90 k
python3-setuptools noarch 65.5.1-2.fc38 fedora 1.7 M
Transaction Summary
================================================================================
Install 3 Packages
Total download size: 4.8 M
Installed size: 23 M
Downloading Packages:
(1/3): libxcrypt-compat-4.4.36-1.fc38.x86_64.rp 104 kB/s | 90 kB 00:00
(2/3): python3-pip-22.3.1-3.fc38.noarch.rpm 2.1 MB/s | 3.1 MB 00:01
(3/3): python3-setuptools-65.5.1-2.fc38.noarch. 1.0 MB/s | 1.7 MB 00:01
--------------------------------------------------------------------------------
Total 1.5 MB/s | 4.8 MB 00:03
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : libxcrypt-compat-4.4.36-1.fc38.x86_64 1/3
Installing : python3-setuptools-65.5.1-2.fc38.noarch 2/3
Installing : python3-pip-22.3.1-3.fc38.noarch 3/3
Running scriptlet: python3-pip-22.3.1-3.fc38.noarch 3/3
Verifying : python3-setuptools-65.5.1-2.fc38.noarch 1/3
Verifying : libxcrypt-compat-4.4.36-1.fc38.x86_64 2/3
Verifying : python3-pip-22.3.1-3.fc38.noarch 3/3
Installed:
libxcrypt-compat-4.4.36-1.fc38.x86_64 python3-pip-22.3.1-3.fc38.noarch
python3-setuptools-65.5.1-2.fc38.noarch
Complete!
42 files removed
Removing intermediate container dbdbe60b1754
---> 05c33163c515
Step 9/12 : RUN pip install --upgrade poetry
---> Running in a76cd578b19a
Collecting poetry
Downloading poetry-1.6.1-py3-none-any.whl (232 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 232.8/232.8 kB 7.3 MB/s eta 0:00:00
Collecting build<0.11.0,>=0.10.0
Downloading build-0.10.0-py3-none-any.whl (17 kB)
Collecting cachecontrol[filecache]<0.14.0,>=0.13.0
Downloading cachecontrol-0.13.1-py3-none-any.whl (22 kB)
Collecting cleo<3.0.0,>=2.0.0
Downloading cleo-2.0.1-py3-none-any.whl (77 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.3/77.3 kB 8.1 MB/s eta 0:00:00
Collecting crashtest<0.5.0,>=0.4.1
Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB)
Collecting dulwich<0.22.0,>=0.21.2
Downloading dulwich-0.21.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (513 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 513.8/513.8 kB 25.8 MB/s eta 0:00:00
Collecting installer<0.8.0,>=0.7.0
Downloading installer-0.7.0-py3-none-any.whl (453 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 453.8/453.8 kB 36.4 MB/s eta 0:00:00
Collecting jsonschema<4.18.0,>=4.10.0
Downloading jsonschema-4.17.3-py3-none-any.whl (90 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90.4/90.4 kB 9.3 MB/s eta 0:00:00
Collecting keyring<25.0.0,>=24.0.0
Downloading keyring-24.2.0-py3-none-any.whl (37 kB)
Collecting packaging>=20.4
Downloading packaging-23.1-py3-none-any.whl (48 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 5.6 MB/s eta 0:00:00
Collecting pexpect<5.0.0,>=4.7.0
Downloading pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.0/59.0 kB 5.4 MB/s eta 0:00:00
Collecting pkginfo<2.0.0,>=1.9.4
Downloading pkginfo-1.9.6-py3-none-any.whl (30 kB)
Collecting platformdirs<4.0.0,>=3.0.0
Downloading platformdirs-3.10.0-py3-none-any.whl (17 kB)
Collecting poetry-core==1.7.0
Downloading poetry_core-1.7.0-py3-none-any.whl (426 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 426.4/426.4 kB 36.4 MB/s eta 0:00:00
Collecting poetry-plugin-export<2.0.0,>=1.5.0
Downloading poetry_plugin_export-1.5.0-py3-none-any.whl (10 kB)
Collecting pyproject-hooks<2.0.0,>=1.0.0
Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB)
Collecting requests<3.0,>=2.26
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 5.7 MB/s eta 0:00:00
Collecting requests-toolbelt<2,>=0.9.1
Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.5/54.5 kB 5.0 MB/s eta 0:00:00
Collecting shellingham<2.0,>=1.5
Downloading shellingham-1.5.3-py2.py3-none-any.whl (9.7 kB)
Collecting tomlkit<1.0.0,>=0.11.4
Downloading tomlkit-0.12.1-py3-none-any.whl (37 kB)
Collecting trove-classifiers>=2022.5.19
Downloading trove_classifiers-2023.8.7-py3-none-any.whl (13 kB)
Collecting virtualenv<21.0.0,>=20.22.0
Downloading virtualenv-20.24.5-py3-none-any.whl (3.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.7/3.7 MB 36.1 MB/s eta 0:00:00
Collecting msgpack>=0.5.2
Downloading msgpack-1.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (325 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 325.1/325.1 kB 19.4 MB/s eta 0:00:00
Collecting filelock>=3.8.0
Downloading filelock-3.12.3-py3-none-any.whl (11 kB)
Collecting rapidfuzz<3.0.0,>=2.2.0
Downloading rapidfuzz-2.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 34.8 MB/s eta 0:00:00
Collecting urllib3>=1.25
Downloading urllib3-2.0.4-py3-none-any.whl (123 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.9/123.9 kB 13.7 MB/s eta 0:00:00
Collecting attrs>=17.4.0
Downloading attrs-23.1.0-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 kB 5.6 MB/s eta 0:00:00
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Downloading pyrsistent-0.19.3-py3-none-any.whl (57 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 5.1 MB/s eta 0:00:00
Collecting jaraco.classes
Downloading jaraco.classes-3.3.0-py3-none-any.whl (5.9 kB)
Collecting importlib-metadata>=4.11.4
Downloading importlib_metadata-6.8.0-py3-none-any.whl (22 kB)
Collecting SecretStorage>=3.2
Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB)
Collecting jeepney>=0.4.2
Downloading jeepney-0.8.0-py3-none-any.whl (48 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.4/48.4 kB 4.4 MB/s eta 0:00:00
Collecting ptyprocess>=0.5
Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting charset-normalizer<4,>=2
Downloading charset_normalizer-3.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.6/199.6 kB 15.9 MB/s eta 0:00:00
Collecting idna<4,>=2.5
Downloading idna-3.4-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 5.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.3/158.3 kB 15.7 MB/s eta 0:00:00
Collecting distlib<1,>=0.3.7
Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 468.9/468.9 kB 31.9 MB/s eta 0:00:00
Collecting zipp>=0.5
Downloading zipp-3.16.2-py3-none-any.whl (7.2 kB)
Collecting cryptography>=2.0
Downloading cryptography-41.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.3/4.3 MB 36.3 MB/s eta 0:00:00
Collecting more-itertools
Downloading more_itertools-10.1.0-py3-none-any.whl (55 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.8/55.8 kB 6.0 MB/s eta 0:00:00
Collecting cffi>=1.12
Downloading cffi-1.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (462 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 462.6/462.6 kB 22.3 MB/s eta 0:00:00
Collecting pycparser
Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 7.6 MB/s eta 0:00:00
Installing collected packages: trove-classifiers, ptyprocess, msgpack, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyrsistent, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, attrs, virtualenv, requests, jsonschema, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry
Successfully installed SecretStorage-3.3.3 attrs-23.1.0 build-0.10.0 cachecontrol-0.13.1 certifi-2023.7.22 cffi-1.15.1 charset-normalizer-3.2.0 cleo-2.0.1 crashtest-0.4.1 cryptography-41.0.3 distlib-0.3.7 dulwich-0.21.6 filelock-3.12.3 idna-3.4 importlib-metadata-6.8.0 installer-0.7.0 jaraco.classes-3.3.0 jeepney-0.8.0 jsonschema-4.17.3 keyring-24.2.0 more-itertools-10.1.0 msgpack-1.0.5 packaging-23.1 pexpect-4.8.0 pkginfo-1.9.6 platformdirs-3.10.0 poetry-1.6.1 poetry-core-1.7.0 poetry-plugin-export-1.5.0 ptyprocess-0.7.0 pycparser-2.21 pyproject-hooks-1.0.0 pyrsistent-0.19.3 rapidfuzz-2.15.1 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.3 tomlkit-0.12.1 trove-classifiers-2023.8.7 urllib3-2.0.4 virtualenv-20.24.5 zipp-3.16.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Removing intermediate container a76cd578b19a
---> 20bfa099f052
Step 10/12 : RUN poetry config virtualenvs.create false && poetry install
---> Running in 3829485d40dd
Skipping virtualenv creation, as specified in config file.
Updating dependencies
Resolving dependencies...
Package operations: 70 installs, 2 updates, 0 removals
• Installing rpds-py (0.10.2)
• Updating setuptools (65.5.1 /usr/lib/python3.11/site-packages -> 68.2.2)
• Installing six (1.16.0)
CalledProcessError
Command '['/usr/bin/python3', '-m', 'pip', 'uninstall', 'setuptools', '-y']' returned non-zero exit status 1.
at /usr/lib64/python3.11/subprocess.py:571 in run
567│ # We don't call process.wait() as .__exit__ does that for us.
568│ raise
569│ retcode = process.poll()
570│ if check and retcode:
→ 571│ raise CalledProcessError(retcode, process.args,
572│ output=stdout, stderr=stderr)
573│ return CompletedProcess(process.args, retcode, stdout, stderr)
574│
575│
The following error occurred when trying to handle this error:
EnvCommandError
Command ['/usr/bin/python3', '-m', 'pip', 'uninstall', 'setuptools', '-y'] errored with the following return code 1
Output:
Found existing installation: setuptools 65.5.1
ERROR: Cannot uninstall setuptools 65.5.1, RECORD file not found. Hint: The package was installed by rpm.
at /usr/local/lib/python3.11/site-packages/poetry/utils/env/base_env.py:363 in _run
359│ output = subprocess.check_output(
360│ cmd, stderr=stderr, env=env, text=True, **kwargs
361│ )
362│ except CalledProcessError as e:
→ 363│ raise EnvCommandError(e, input=input_)
364│
365│ return output
366│
367│ def execute(self, bin: str, *args: str, **kwargs: Any) -> int:
The command '/bin/sh -c poetry config virtualenvs.create false && poetry install' returned a non-zero code: 1
Seems like installing from PyPI remains to be the last resort - what do you think @abompard ?
I pushed a new release on GitHub https://github.com/fedora-infra/mdapi/releases/tag/3.1.3 and an associated new release on PyPI https://pypi.org/project/mdapi/3.1.3/, which happens to be the first release of the project on that platform. I also changed the Dockerfile
to not remove the staged that required poetry
to be installed and the project to be built/installed locally as we are not doing that anymore.
Dockerfile
FROM registry.fedoraproject.org/fedora:38
LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
EXPOSE 8080
ENV PYTHONUNBUFFERED=1
RUN dnf -y install python3-pip && dnf -y clean all
RUN pip install --upgrade mdapi==3.1.3
# Uncomment the following MDAPI_CONFIG and comment the other MDAPI_CONFIG for local development builds
# ENV MDAPI_CONFIG=/code/mdapi/confdata/standard.py
# For deployment purposes, make a custom configuration in the /etc/mdapi/confdata directory
ENV MDAPI_CONFIG=/etc/mdapi/confdata/myconfig.py
ENTRYPOINT mdapi -c $MDAPI_CONFIG serveapp
This one works just fine.
[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile -t mdapi:v3.1.3
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
Install the buildx component to build images with BuildKit:
https://docs.docker.com/go/buildx/
Sending build context to Docker daemon 355.3kB
Step 1/10 : FROM fedora:38
---> 6b9fae4fa405
Step 2/10 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
---> Using cache
---> 55622f4a526f
Step 3/10 : EXPOSE 8080
---> Using cache
---> 9fbb663016e1
Step 4/10 : COPY . /code
---> 12b5b8bdcef8
Step 5/10 : WORKDIR /code
---> Running in dc178baee47b
Removing intermediate container dc178baee47b
---> 670a6a567fef
Step 6/10 : ENV PYTHONUNBUFFERED=1
---> Running in b70bed3e21b8
Removing intermediate container b70bed3e21b8
---> 790163180fc3
Step 7/10 : RUN dnf -y install python3-pip && dnf -y clean all
---> Running in 9f19721ebb61
Fedora 38 - x86_64 2.7 MB/s | 83 MB 00:30
Fedora 38 openh264 (From Cisco) - x86_64 752 B/s | 2.5 kB 00:03
Fedora Modular 38 - x86_64 814 kB/s | 2.8 MB 00:03
Fedora 38 - x86_64 - Updates 7.3 MB/s | 32 MB 00:04
Fedora Modular 38 - x86_64 - Updates 562 kB/s | 2.1 MB 00:03
Last metadata expiration check: 0:00:01 ago on Wed Sep 13 08:34:02 2023.
Dependencies resolved.
================================================================================
Package Architecture Version Repository Size
================================================================================
Installing:
python3-pip noarch 22.3.1-3.fc38 updates 3.1 M
Installing weak dependencies:
libxcrypt-compat x86_64 4.4.36-1.fc38 updates 90 k
python3-setuptools noarch 65.5.1-2.fc38 fedora 1.7 M
Transaction Summary
================================================================================
Install 3 Packages
Total download size: 4.8 M
Installed size: 23 M
Downloading Packages:
(1/3): libxcrypt-compat-4.4.36-1.fc38.x86_64.rp 170 kB/s | 90 kB 00:00
(2/3): python3-pip-22.3.1-3.fc38.noarch.rpm 2.0 MB/s | 3.1 MB 00:01
(3/3): python3-setuptools-65.5.1-2.fc38.noarch. 780 kB/s | 1.7 MB 00:02
--------------------------------------------------------------------------------
Total 1.2 MB/s | 4.8 MB 00:04
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : libxcrypt-compat-4.4.36-1.fc38.x86_64 1/3
Installing : python3-setuptools-65.5.1-2.fc38.noarch 2/3
Installing : python3-pip-22.3.1-3.fc38.noarch 3/3
Running scriptlet: python3-pip-22.3.1-3.fc38.noarch 3/3
Verifying : python3-setuptools-65.5.1-2.fc38.noarch 1/3
Verifying : libxcrypt-compat-4.4.36-1.fc38.x86_64 2/3
Verifying : python3-pip-22.3.1-3.fc38.noarch 3/3
Installed:
libxcrypt-compat-4.4.36-1.fc38.x86_64 python3-pip-22.3.1-3.fc38.noarch
python3-setuptools-65.5.1-2.fc38.noarch
Complete!
42 files removed
Removing intermediate container 9f19721ebb61
---> eda9d0f1ab5c
Step 8/10 : RUN pip install --upgrade mdapi==3.1.3
---> Running in b079581ade2c
Collecting mdapi==3.1.3
Downloading mdapi-3.1.3-py3-none-any.whl (37 kB)
Collecting aiohttp<4.0.0,>=3.8.1
Downloading aiohttp-3.8.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 13.9 MB/s eta 0:00:00
Collecting aiosqlite<0.20.0,>=0.18.0
Downloading aiosqlite-0.19.0-py3-none-any.whl (15 kB)
Collecting click<9.0.0,>=8.1.3
Downloading click-8.1.7-py3-none-any.whl (97 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 8.7 MB/s eta 0:00:00
Collecting fedora-messaging<4.0.0,>=3.0.2
Downloading fedora_messaging-3.4.1-py3-none-any.whl (109 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 109.2/109.2 kB 11.0 MB/s eta 0:00:00
Collecting gunicorn<21.0.0,>=20.1.0
Downloading gunicorn-20.1.0-py3-none-any.whl (79 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.5/79.5 kB 9.0 MB/s eta 0:00:00
Collecting mdapi-messages<2.0.0,>=1.0.0
Downloading mdapi_messages-1.0.0-py2.py3-none-any.whl (14 kB)
Collecting pyzstd<0.16.0,>=0.15.0
Downloading pyzstd-0.15.9-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (412 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 412.3/412.3 kB 15.3 MB/s eta 0:00:00
Collecting requests<3.0.0,>=2.28.1
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 6.5 MB/s eta 0:00:00
Requirement already satisfied: setuptools in /usr/lib/python3.11/site-packages (from mdapi==3.1.3) (65.5.1)
Collecting uvloop<0.18.0,>=0.17.0
Downloading uvloop-0.17.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.2/4.2 MB 30.0 MB/s eta 0:00:00
Collecting attrs>=17.3.0
Downloading attrs-23.1.0-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 kB 7.1 MB/s eta 0:00:00
Collecting charset-normalizer<4.0,>=2.0
Downloading charset_normalizer-3.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.6/199.6 kB 21.7 MB/s eta 0:00:00
Collecting multidict<7.0,>=4.5
Downloading multidict-6.0.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (117 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.4/117.4 kB 10.3 MB/s eta 0:00:00
Collecting async-timeout<5.0,>=4.0.0a3
Downloading async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Collecting yarl<2.0,>=1.0
Downloading yarl-1.9.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 282.8/282.8 kB 16.6 MB/s eta 0:00:00
Collecting frozenlist>=1.1.1
Downloading frozenlist-1.4.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 250.5/250.5 kB 19.4 MB/s eta 0:00:00
Collecting aiosignal>=1.1.2
Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting blinker
Downloading blinker-1.6.2-py3-none-any.whl (13 kB)
Collecting crochet
Downloading crochet-2.1.1-py3-none-any.whl (31 kB)
Collecting jsonschema
Downloading jsonschema-4.19.0-py3-none-any.whl (83 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.4/83.4 kB 9.4 MB/s eta 0:00:00
Collecting Twisted
Downloading twisted-23.8.0-py3-none-any.whl (3.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 29.9 MB/s eta 0:00:00
Collecting pytz
Downloading pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 502.5/502.5 kB 14.1 MB/s eta 0:00:00
Collecting PyOpenSSL
Downloading pyOpenSSL-23.2.0-py3-none-any.whl (59 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.0/59.0 kB 6.0 MB/s eta 0:00:00
Collecting pika>=1.0.1
Downloading pika-1.3.2-py3-none-any.whl (155 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.4/155.4 kB 13.3 MB/s eta 0:00:00
Collecting service-identity
Downloading service_identity-23.1.0-py3-none-any.whl (12 kB)
Collecting idna<4,>=2.5
Downloading idna-3.4-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 6.4 MB/s eta 0:00:00
Collecting urllib3<3,>=1.21.1
Downloading urllib3-2.0.4-py3-none-any.whl (123 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.9/123.9 kB 12.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.3/158.3 kB 15.5 MB/s eta 0:00:00
Collecting wrapt
Downloading wrapt-1.15.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.9/78.9 kB 7.6 MB/s eta 0:00:00
Collecting automat>=0.8.0
Downloading Automat-22.10.0-py2.py3-none-any.whl (26 kB)
Collecting constantly>=15.1
Downloading constantly-15.1.0-py2.py3-none-any.whl (7.9 kB)
Collecting hyperlink>=17.1.1
Downloading hyperlink-21.0.0-py2.py3-none-any.whl (74 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.6/74.6 kB 7.6 MB/s eta 0:00:00
Collecting incremental>=22.10.0
Downloading incremental-22.10.0-py2.py3-none-any.whl (16 kB)
Collecting typing-extensions>=3.10.0
Downloading typing_extensions-4.7.1-py3-none-any.whl (33 kB)
Collecting zope-interface>=5
Downloading zope.interface-6.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (249 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 249.0/249.0 kB 19.0 MB/s eta 0:00:00
Collecting jsonschema-specifications>=2023.03.6
Downloading jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB)
Collecting referencing>=0.28.4
Downloading referencing-0.30.2-py3-none-any.whl (25 kB)
Collecting rpds-py>=0.7.1
Downloading rpds_py-0.10.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 30.0 MB/s eta 0:00:00
Collecting cryptography!=40.0.0,!=40.0.1,<42,>=38.0.0
Downloading cryptography-41.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.3/4.3 MB 28.7 MB/s eta 0:00:00
Collecting pyasn1
Downloading pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.9/83.9 kB 9.3 MB/s eta 0:00:00
Collecting pyasn1-modules
Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 12.0 MB/s eta 0:00:00
Collecting six
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting cffi>=1.12
Downloading cffi-1.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (462 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 462.6/462.6 kB 15.3 MB/s eta 0:00:00
Collecting pycparser
Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 9.5 MB/s eta 0:00:00
Installing collected packages: pytz, incremental, constantly, zope-interface, wrapt, uvloop, urllib3, typing-extensions, six, rpds-py, pyzstd, pycparser, pyasn1, pika, multidict, idna, gunicorn, frozenlist, click, charset-normalizer, certifi, blinker, attrs, async-timeout, aiosqlite, yarl, requests, referencing, pyasn1-modules, hyperlink, cffi, automat, aiosignal, Twisted, jsonschema-specifications, cryptography, aiohttp, service-identity, PyOpenSSL, jsonschema, crochet, fedora-messaging, mdapi-messages, mdapi
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Successfully installed PyOpenSSL-23.2.0 Twisted-23.8.0 aiohttp-3.8.5 aiosignal-1.3.1 aiosqlite-0.19.0 async-timeout-4.0.3 attrs-23.1.0 automat-22.10.0 blinker-1.6.2 certifi-2023.7.22 cffi-1.15.1 charset-normalizer-3.2.0 click-8.1.7 constantly-15.1.0 crochet-2.1.1 cryptography-41.0.3 fedora-messaging-3.4.1 frozenlist-1.4.0 gunicorn-20.1.0 hyperlink-21.0.0 idna-3.4 incremental-22.10.0 jsonschema-4.19.0 jsonschema-specifications-2023.7.1 mdapi-3.1.3 mdapi-messages-1.0.0 multidict-6.0.4 pika-1.3.2 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pytz-2023.3.post1 pyzstd-0.15.9 referencing-0.30.2 requests-2.31.0 rpds-py-0.10.2 service-identity-23.1.0 six-1.16.0 typing-extensions-4.7.1 urllib3-2.0.4 uvloop-0.17.0 wrapt-1.15.0 yarl-1.9.2 zope-interface-6.0
Removing intermediate container b079581ade2c
---> 1d1000600cf2
Step 9/10 : ENV MDAPI_CONFIG=/etc/mdapi/confdata/myconfig.py
---> Running in 464062e18235
Removing intermediate container 464062e18235
---> 1e9b61e12322
Step 10/10 : ENTRYPOINT mdapi -c $MDAPI_CONFIG serveapp
---> Running in 82a640796bf5
Removing intermediate container 82a640796bf5
---> 958ebcfd83a4
Successfully built 958ebcfd83a4
Successfully tagged mdapi:v3.1.3
I am not sure if this is objectively the correct way of doing things but as this is working just fine and I do not have any other solutions present in hand at the moment, I am going to push the necessary changes to the develop
and prod
branches for the Dockerfile
.
@davidkirwan reported that the most recent version has successfully generated the container image and MDAPI v3.1.3 is now deployed in the production environment.
Closing this now as FIXED. Thanks for reporting this @nirik!
mdapi build took about 230GB and caused the node it was on to be unstable. ;(
Here's the logs from the last build:
It got to about 5GB in 10min... ;(