fedora-infra / mdapi

A simple and fast API for serving the metadata from the RPM repositories.
https://mdapi.fedoraproject.org/
GNU General Public License v3.0
8 stars 11 forks source link

mdapi build in fedora prod openshift takes up lots of memory and never finishes #212

Closed nirik closed 1 year ago

nirik commented 1 year ago

mdapi build took about 230GB and caused the node it was on to be unstable. ;(

Here's the logs from the last build:

time="2023-09-12T21:21:20Z" level=info msg="Not using native diff for overlay, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled"
I0912 21:21:20.925803       1 defaults.go:112] Defaulting to storage driver "overlay" with options [mountopt=metacopy=on].
Caching blobs under "/var/cache/blobs".

Pulling image registry.fedoraproject.org/fedora:37 ...
Trying to pull registry.fedoraproject.org/fedora:37...
Getting image source signatures
Copying blob sha256:b76797e95414373fc6b5372967d6ba50cb2ffad4d95571fe9be39c0540c1a781
Copying config sha256:dab9f651d5359dc2bc6414f4f09ce7787aee5308b7177aaa75934923f38f7c3b
Writing manifest to image destination
Storing signatures
Adding transient rw bind mount for /run/secrets/rhsm
STEP 1/13: FROM registry.fedoraproject.org/fedora:37
STEP 2/13: LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
--> 56ee5cfa7d5
STEP 3/13: EXPOSE 8080
--> 6a379e659c2
STEP 4/13: COPY . /code
--> 0a35f47708c
STEP 5/13: WORKDIR /code
--> eb7f2f26c16
STEP 6/13: ENV PYTHONUNBUFFERED=1
--> 9660c376ccb
STEP 7/13: RUN rm -rf /code/poetry.lock
--> 3e589ed8819
STEP 8/13: RUN dnf -y install python3-pip poetry && dnf -y clean all
Fedora 37 - x86_64                               46 MB/s |  82 MB     00:01    
Fedora 37 openh264 (From Cisco) - x86_64         15 kB/s | 2.5 kB     00:00    
Fedora Modular 37 - x86_64                       23 MB/s | 3.8 MB     00:00    
Fedora 37 - x86_64 - Updates                     52 MB/s |  39 MB     00:00    
Fedora Modular 37 - x86_64 - Updates             16 MB/s | 2.9 MB     00:00    
Dependencies resolved.
================================================================================
 Package                          Arch     Version              Repo       Size
================================================================================
Installing:
 poetry                           noarch   1.1.14-1.fc37        fedora     14 k
 python3-pip                      noarch   22.2.2-3.fc37        updates   3.1 M
Installing dependencies:
 python-wheel-wheel               noarch   1:0.37.1-4.fc37      fedora     42 k
 python3-CacheControl             noarch   0.12.11-3.fc37       fedora     60 k
 python3-CacheControl+filecache   noarch   0.12.11-3.fc37       fedora    8.6 k
 python3-async-timeout            noarch   4.0.2-5.fc37         fedora     19 k
 python3-cachy                    noarch   0.3.0-12.fc37        fedora     62 k
 python3-cffi                     x86_64   1.15.1-2.fc37        fedora    311 k
 python3-charset-normalizer       noarch   2.1.0-2.fc37         fedora    102 k
 python3-cleo                     noarch   0.8.1-7.fc37         fedora     67 k
 python3-clikit                   noarch   0.6.2-7.fc37         fedora    284 k
 python3-crashtest                noarch   0.3.1-8.fc37         fedora     33 k
 python3-cryptography             x86_64   37.0.2-5.fc37        updates   1.2 M
 python3-deprecated               noarch   1.2.13-3.fc37        fedora     24 k
 python3-distlib                  noarch   0.3.4-5.fc37         fedora    270 k
 python3-filelock                 noarch   3.7.1-1.fc37         fedora     40 k
 python3-html5lib                 noarch   1:1.1-10.fc37        fedora    297 k
 python3-idna                     noarch   3.3-4.fc37           fedora    110 k
 python3-importlib-metadata       noarch   4.12.0-2.fc37        fedora     58 k
 python3-jaraco                   noarch   9.0.0-3.fc37         fedora     10 k
 python3-jaraco-classes           noarch   3.2.1-8.fc37         fedora     23 k
 python3-jeepney                  noarch   0.8.0-3.fc37         fedora    414 k
 python3-keyring                  noarch   23.11.0-1.fc37       updates   112 k
 python3-lockfile                 noarch   1:0.12.2-8.fc37      fedora     40 k
 python3-more-itertools           noarch   8.12.0-5.fc37        fedora    101 k
 python3-msgpack                  x86_64   1.0.4-3.fc37         fedora     96 k
 python3-packaging                noarch   21.3-6.fc37          fedora     98 k
 python3-pastel                   noarch   0.2.0-9.fc37         fedora     22 k
 python3-pexpect                  noarch   4.8.0-13.fc37        fedora    170 k
 python3-pkginfo                  noarch   1.8.3-2.fc37         fedora     48 k
 python3-platformdirs             noarch   2.5.2-3.fc37         fedora     42 k
 python3-ply                      noarch   3.11-17.fc37         fedora    139 k
 python3-poetry                   noarch   1.1.14-1.fc37        fedora    470 k
 python3-poetry-core              noarch   1.0.8-3.fc37         fedora    980 k
 python3-ptyprocess               noarch   0.6.0-17.fc37        fedora     35 k
 python3-pycparser                noarch   2.20-8.fc37          fedora    156 k
 python3-pylev                    noarch   1.3.0-14.fc37        fedora     15 k
 python3-pyparsing                noarch   3.0.9-2.fc37         fedora    262 k
 python3-pysocks                  noarch   1.7.1-15.fc37        fedora     40 k
 python3-redis                    noarch   4.3.3-3.fc37         fedora    502 k
 python3-requests                 noarch   2.28.1-3.fc37        updates   155 k
 python3-requests-toolbelt        noarch   0.9.1-19.fc37        fedora    122 k
 python3-secretstorage            noarch   3.3.3-1.fc37         fedora     46 k
 python3-setuptools               noarch   62.6.0-3.fc37        updates   1.6 M
 python3-shellingham              noarch   1.4.0-2.fc37         fedora     33 k
 python3-six                      noarch   1.16.0-8.fc37        fedora     42 k
 python3-tomlkit                  noarch   0.11.4-1.fc37        fedora    118 k
 python3-urllib3                  noarch   1.26.16-1.fc37       updates   257 k
 python3-urllib3+socks            noarch   1.26.16-1.fc37       updates   9.7 k
 python3-virtualenv               noarch   20.21.1-1.fc37       updates   310 k
 python3-webencodings             noarch   0.5.1-19.fc37        fedora     36 k
 python3-wrapt                    x86_64   1.14.0-3.fc37        fedora     69 k
 python3-zipp                     noarch   3.8.1-2.fc37         fedora     19 k
Installing weak dependencies:
 libxcrypt-compat                 x86_64   4.4.36-1.fc37        updates    90 k
 python3-CacheControl+redis       noarch   0.12.11-3.fc37       fedora    8.6 k

Transaction Summary
================================================================================
Install  55 Packages

Total download size: 13 M
Installed size: 52 M
Downloading Packages:
(1/55): poetry-1.1.14-1.fc37.noarch.rpm         177 kB/s |  14 kB     00:00    
(2/55): python3-CacheControl+filecache-0.12.11- 108 kB/s | 8.6 kB     00:00    
(3/55): python-wheel-wheel-0.37.1-4.fc37.noarch 523 kB/s |  42 kB     00:00    
(4/55): python3-CacheControl+redis-0.12.11-3.fc 5.8 MB/s | 8.6 kB     00:00    
(5/55): python3-async-timeout-4.0.2-5.fc37.noar 8.8 MB/s |  19 kB     00:00    
(6/55): python3-CacheControl-0.12.11-3.fc37.noa  20 MB/s |  60 kB     00:00    
(7/55): python3-cachy-0.3.0-12.fc37.noarch.rpm   27 MB/s |  62 kB     00:00    
(8/55): python3-charset-normalizer-2.1.0-2.fc37  74 MB/s | 102 kB     00:00    
(9/55): python3-cffi-1.15.1-2.fc37.x86_64.rpm    76 MB/s | 311 kB     00:00    
(10/55): python3-cleo-0.8.1-7.fc37.noarch.rpm    19 MB/s |  67 kB     00:00    
(11/55): python3-clikit-0.6.2-7.fc37.noarch.rpm  72 MB/s | 284 kB     00:00    
(12/55): python3-crashtest-0.3.1-8.fc37.noarch.  17 MB/s |  33 kB     00:00    
(13/55): python3-deprecated-1.2.13-3.fc37.noarc  12 MB/s |  24 kB     00:00    
(14/55): python3-filelock-3.7.1-1.fc37.noarch.r  16 MB/s |  40 kB     00:00    
(15/55): python3-distlib-0.3.4-5.fc37.noarch.rp  68 MB/s | 270 kB     00:00    
(16/55): python3-idna-3.3-4.fc37.noarch.rpm      63 MB/s | 110 kB     00:00    
(17/55): python3-html5lib-1.1-10.fc37.noarch.rp  58 MB/s | 297 kB     00:00    
(18/55): python3-importlib-metadata-4.12.0-2.fc  24 MB/s |  58 kB     00:00    
(19/55): python3-jaraco-9.0.0-3.fc37.noarch.rpm 5.2 MB/s |  10 kB     00:00    
(20/55): python3-jaraco-classes-3.2.1-8.fc37.no  10 MB/s |  23 kB     00:00    
(21/55): python3-lockfile-0.12.2-8.fc37.noarch.  17 MB/s |  40 kB     00:00    
(22/55): python3-jeepney-0.8.0-3.fc37.noarch.rp  91 MB/s | 414 kB     00:00    
(23/55): python3-more-itertools-8.12.0-5.fc37.n  30 MB/s | 101 kB     00:00    
(24/55): python3-msgpack-1.0.4-3.fc37.x86_64.rp  32 MB/s |  96 kB     00:00    
(25/55): python3-pastel-0.2.0-9.fc37.noarch.rpm  10 MB/s |  22 kB     00:00    
(26/55): python3-packaging-21.3-6.fc37.noarch.r  32 MB/s |  98 kB     00:00    
(27/55): python3-pexpect-4.8.0-13.fc37.noarch.r  54 MB/s | 170 kB     00:00    
(28/55): python3-pkginfo-1.8.3-2.fc37.noarch.rp  20 MB/s |  48 kB     00:00    
(29/55): python3-platformdirs-2.5.2-3.fc37.noar  13 MB/s |  42 kB     00:00    
(30/55): python3-ply-3.11-17.fc37.noarch.rpm     53 MB/s | 139 kB     00:00    
(31/55): python3-ptyprocess-0.6.0-17.fc37.noarc  14 MB/s |  35 kB     00:00    
(32/55): python3-poetry-1.1.14-1.fc37.noarch.rp  76 MB/s | 470 kB     00:00    
(33/55): python3-pycparser-2.20-8.fc37.noarch.r  54 MB/s | 156 kB     00:00    
(34/55): python3-pylev-1.3.0-14.fc37.noarch.rpm 8.3 MB/s |  15 kB     00:00    
(35/55): python3-pysocks-1.7.1-15.fc37.noarch.r  39 MB/s |  40 kB     00:00    
(36/55): python3-poetry-core-1.0.8-3.fc37.noarc 103 MB/s | 980 kB     00:00    
(37/55): python3-pyparsing-3.0.9-2.fc37.noarch.  61 MB/s | 262 kB     00:00    
(38/55): python3-requests-toolbelt-0.9.1-19.fc3  38 MB/s | 122 kB     00:00    
(39/55): python3-secretstorage-3.3.3-1.fc37.noa  19 MB/s |  46 kB     00:00    
(40/55): python3-redis-4.3.3-3.fc37.noarch.rpm   84 MB/s | 502 kB     00:00    
(41/55): python3-six-1.16.0-8.fc37.noarch.rpm    39 MB/s |  42 kB     00:00    
(42/55): python3-shellingham-1.4.0-2.fc37.noarc  16 MB/s |  33 kB     00:00    
(43/55): python3-tomlkit-0.11.4-1.fc37.noarch.r  46 MB/s | 118 kB     00:00    
(44/55): python3-webencodings-0.5.1-19.fc37.noa  16 MB/s |  36 kB     00:00    
(45/55): python3-wrapt-1.14.0-3.fc37.x86_64.rpm  25 MB/s |  69 kB     00:00    
(46/55): python3-zipp-3.8.1-2.fc37.noarch.rpm    10 MB/s |  19 kB     00:00    
(47/55): libxcrypt-compat-4.4.36-1.fc37.x86_64.  29 MB/s |  90 kB     00:00    
(48/55): python3-keyring-23.11.0-1.fc37.noarch.  33 MB/s | 112 kB     00:00    
(49/55): python3-cryptography-37.0.2-5.fc37.x86 158 MB/s | 1.2 MB     00:00    
(50/55): python3-requests-2.28.1-3.fc37.noarch.  40 MB/s | 155 kB     00:00    
(51/55): python3-urllib3+socks-1.26.16-1.fc37.n 4.6 MB/s | 9.7 kB     00:00    
(52/55): python3-urllib3-1.26.16-1.fc37.noarch.  74 MB/s | 257 kB     00:00    
(53/55): python3-setuptools-62.6.0-3.fc37.noarc 132 MB/s | 1.6 MB     00:00    
(54/55): python3-virtualenv-20.21.1-1.fc37.noar  49 MB/s | 310 kB     00:00    
(55/55): python3-pip-22.2.2-3.fc37.noarch.rpm   137 MB/s | 3.1 MB     00:00    
--------------------------------------------------------------------------------
Total                                            50 MB/s |  13 MB     00:00     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : python3-six-1.16.0-8.fc37.noarch                      1/55 
  Installing       : python3-setuptools-62.6.0-3.fc37.noarch               2/55 
  Installing       : python3-msgpack-1.0.4-3.fc37.x86_64                   3/55 
  Installing       : python3-jeepney-0.8.0-3.fc37.noarch                   4/55 
  Installing       : python3-idna-3.3-4.fc37.noarch                        5/55 
  Installing       : python3-crashtest-0.3.1-8.fc37.noarch                 6/55 
  Installing       : python3-pkginfo-1.8.3-2.fc37.noarch                   7/55 
  Installing       : libxcrypt-compat-4.4.36-1.fc37.x86_64                 8/55 
  Installing       : python3-zipp-3.8.1-2.fc37.noarch                      9/55 
  Installing       : python3-importlib-metadata-4.12.0-2.fc37.noarch      10/55 
  Installing       : python3-wrapt-1.14.0-3.fc37.x86_64                   11/55 
  Installing       : python3-deprecated-1.2.13-3.fc37.noarch              12/55 
  Installing       : python3-webencodings-0.5.1-19.fc37.noarch            13/55 
  Installing       : python3-html5lib-1:1.1-10.fc37.noarch                14/55 
  Installing       : python3-tomlkit-0.11.4-1.fc37.noarch                 15/55 
  Installing       : python3-shellingham-1.4.0-2.fc37.noarch              16/55 
  Installing       : python3-pysocks-1.7.1-15.fc37.noarch                 17/55 
  Installing       : python3-urllib3+socks-1.26.16-1.fc37.noarch          18/55 
  Installing       : python3-urllib3-1.26.16-1.fc37.noarch                19/55 
  Installing       : python3-pyparsing-3.0.9-2.fc37.noarch                20/55 
  Installing       : python3-packaging-21.3-6.fc37.noarch                 21/55 
  Installing       : python3-pylev-1.3.0-14.fc37.noarch                   22/55 
  Installing       : python3-ptyprocess-0.6.0-17.fc37.noarch              23/55 
  Installing       : python3-pexpect-4.8.0-13.fc37.noarch                 24/55 
  Installing       : python3-poetry-core-1.0.8-3.fc37.noarch              25/55 
  Installing       : python3-ply-3.11-17.fc37.noarch                      26/55 
  Installing       : python3-pycparser-2.20-8.fc37.noarch                 27/55 
  Installing       : python3-cffi-1.15.1-2.fc37.x86_64                    28/55 
  Installing       : python3-cryptography-37.0.2-5.fc37.x86_64            29/55 
  Installing       : python3-secretstorage-3.3.3-1.fc37.noarch            30/55 
  Installing       : python3-platformdirs-2.5.2-3.fc37.noarch             31/55 
  Installing       : python3-pastel-0.2.0-9.fc37.noarch                   32/55 
  Installing       : python3-clikit-0.6.2-7.fc37.noarch                   33/55 
  Installing       : python3-cleo-0.8.1-7.fc37.noarch                     34/55 
  Installing       : python3-more-itertools-8.12.0-5.fc37.noarch          35/55 
  Installing       : python3-lockfile-1:0.12.2-8.fc37.noarch              36/55 
  Installing       : python3-jaraco-9.0.0-3.fc37.noarch                   37/55 
  Installing       : python3-jaraco-classes-3.2.1-8.fc37.noarch           38/55 
  Installing       : python3-keyring-23.11.0-1.fc37.noarch                39/55 
  Installing       : python3-filelock-3.7.1-1.fc37.noarch                 40/55 
  Installing       : python3-distlib-0.3.4-5.fc37.noarch                  41/55 
  Installing       : python3-charset-normalizer-2.1.0-2.fc37.noarch       42/55 
  Installing       : python3-requests-2.28.1-3.fc37.noarch                43/55 
  Installing       : python3-requests-toolbelt-0.9.1-19.fc37.noarch       44/55 
  Installing       : python3-async-timeout-4.0.2-5.fc37.noarch            45/55 
  Installing       : python3-redis-4.3.3-3.fc37.noarch                    46/55 
  Installing       : python3-CacheControl+redis-0.12.11-3.fc37.noarch     47/55 
  Installing       : python3-CacheControl-0.12.11-3.fc37.noarch           48/55 
  Installing       : python3-CacheControl+filecache-0.12.11-3.fc37.noar   49/55 
  Installing       : python3-cachy-0.3.0-12.fc37.noarch                   50/55 
  Installing       : python-wheel-wheel-1:0.37.1-4.fc37.noarch            51/55 
  Installing       : python3-virtualenv-20.21.1-1.fc37.noarch             52/55 
  Installing       : python3-poetry-1.1.14-1.fc37.noarch                  53/55 
  Installing       : poetry-1.1.14-1.fc37.noarch                          54/55 
  Installing       : python3-pip-22.2.2-3.fc37.noarch                     55/55 
  Running scriptlet: python3-pip-22.2.2-3.fc37.noarch                     55/55 
  Verifying        : poetry-1.1.14-1.fc37.noarch                           1/55 
  Verifying        : python-wheel-wheel-1:0.37.1-4.fc37.noarch             2/55 
  Verifying        : python3-CacheControl+filecache-0.12.11-3.fc37.noar    3/55 
  Verifying        : python3-CacheControl+redis-0.12.11-3.fc37.noarch      4/55 
  Verifying        : python3-CacheControl-0.12.11-3.fc37.noarch            5/55 
  Verifying        : python3-async-timeout-4.0.2-5.fc37.noarch             6/55 
  Verifying        : python3-cachy-0.3.0-12.fc37.noarch                    7/55 
  Verifying        : python3-cffi-1.15.1-2.fc37.x86_64                     8/55 
  Verifying        : python3-charset-normalizer-2.1.0-2.fc37.noarch        9/55 
  Verifying        : python3-cleo-0.8.1-7.fc37.noarch                     10/55 
  Verifying        : python3-clikit-0.6.2-7.fc37.noarch                   11/55 
  Verifying        : python3-crashtest-0.3.1-8.fc37.noarch                12/55 
  Verifying        : python3-deprecated-1.2.13-3.fc37.noarch              13/55 
  Verifying        : python3-distlib-0.3.4-5.fc37.noarch                  14/55 
  Verifying        : python3-filelock-3.7.1-1.fc37.noarch                 15/55 
  Verifying        : python3-html5lib-1:1.1-10.fc37.noarch                16/55 
  Verifying        : python3-idna-3.3-4.fc37.noarch                       17/55 
  Verifying        : python3-importlib-metadata-4.12.0-2.fc37.noarch      18/55 
  Verifying        : python3-jaraco-9.0.0-3.fc37.noarch                   19/55 
  Verifying        : python3-jaraco-classes-3.2.1-8.fc37.noarch           20/55 
  Verifying        : python3-jeepney-0.8.0-3.fc37.noarch                  21/55 
  Verifying        : python3-lockfile-1:0.12.2-8.fc37.noarch              22/55 
  Verifying        : python3-more-itertools-8.12.0-5.fc37.noarch          23/55 
  Verifying        : python3-msgpack-1.0.4-3.fc37.x86_64                  24/55 
  Verifying        : python3-packaging-21.3-6.fc37.noarch                 25/55 
  Verifying        : python3-pastel-0.2.0-9.fc37.noarch                   26/55 
  Verifying        : python3-pexpect-4.8.0-13.fc37.noarch                 27/55 
  Verifying        : python3-pkginfo-1.8.3-2.fc37.noarch                  28/55 
  Verifying        : python3-platformdirs-2.5.2-3.fc37.noarch             29/55 
  Verifying        : python3-ply-3.11-17.fc37.noarch                      30/55 
  Verifying        : python3-poetry-1.1.14-1.fc37.noarch                  31/55 
  Verifying        : python3-poetry-core-1.0.8-3.fc37.noarch              32/55 
  Verifying        : python3-ptyprocess-0.6.0-17.fc37.noarch              33/55 
  Verifying        : python3-pycparser-2.20-8.fc37.noarch                 34/55 
  Verifying        : python3-pylev-1.3.0-14.fc37.noarch                   35/55 
  Verifying        : python3-pyparsing-3.0.9-2.fc37.noarch                36/55 
  Verifying        : python3-pysocks-1.7.1-15.fc37.noarch                 37/55 
  Verifying        : python3-redis-4.3.3-3.fc37.noarch                    38/55 
  Verifying        : python3-requests-toolbelt-0.9.1-19.fc37.noarch       39/55 
  Verifying        : python3-secretstorage-3.3.3-1.fc37.noarch            40/55 
  Verifying        : python3-shellingham-1.4.0-2.fc37.noarch              41/55 
  Verifying        : python3-six-1.16.0-8.fc37.noarch                     42/55 
  Verifying        : python3-tomlkit-0.11.4-1.fc37.noarch                 43/55 
  Verifying        : python3-webencodings-0.5.1-19.fc37.noarch            44/55 
  Verifying        : python3-wrapt-1.14.0-3.fc37.x86_64                   45/55 
  Verifying        : python3-zipp-3.8.1-2.fc37.noarch                     46/55 
  Verifying        : libxcrypt-compat-4.4.36-1.fc37.x86_64                47/55 
  Verifying        : python3-cryptography-37.0.2-5.fc37.x86_64            48/55 
  Verifying        : python3-keyring-23.11.0-1.fc37.noarch                49/55 
  Verifying        : python3-pip-22.2.2-3.fc37.noarch                     50/55 
  Verifying        : python3-requests-2.28.1-3.fc37.noarch                51/55 
  Verifying        : python3-setuptools-62.6.0-3.fc37.noarch              52/55 
  Verifying        : python3-urllib3+socks-1.26.16-1.fc37.noarch          53/55 
  Verifying        : python3-urllib3-1.26.16-1.fc37.noarch                54/55 
  Verifying        : python3-virtualenv-20.21.1-1.fc37.noarch             55/55 

Installed:
  libxcrypt-compat-4.4.36-1.fc37.x86_64                                         
  poetry-1.1.14-1.fc37.noarch                                                   
  python-wheel-wheel-1:0.37.1-4.fc37.noarch                                     
  python3-CacheControl-0.12.11-3.fc37.noarch                                    
  python3-CacheControl+filecache-0.12.11-3.fc37.noarch                          
  python3-CacheControl+redis-0.12.11-3.fc37.noarch                              
  python3-async-timeout-4.0.2-5.fc37.noarch                                     
  python3-cachy-0.3.0-12.fc37.noarch                                            
  python3-cffi-1.15.1-2.fc37.x86_64                                             
  python3-charset-normalizer-2.1.0-2.fc37.noarch                                
  python3-cleo-0.8.1-7.fc37.noarch                                              
  python3-clikit-0.6.2-7.fc37.noarch                                            
  python3-crashtest-0.3.1-8.fc37.noarch                                         
  python3-cryptography-37.0.2-5.fc37.x86_64                                     
  python3-deprecated-1.2.13-3.fc37.noarch                                       
  python3-distlib-0.3.4-5.fc37.noarch                                           
  python3-filelock-3.7.1-1.fc37.noarch                                          
  python3-html5lib-1:1.1-10.fc37.noarch                                         
  python3-idna-3.3-4.fc37.noarch                                                
  python3-importlib-metadata-4.12.0-2.fc37.noarch                               
  python3-jaraco-9.0.0-3.fc37.noarch                                            
  python3-jaraco-classes-3.2.1-8.fc37.noarch                                    
  python3-jeepney-0.8.0-3.fc37.noarch                                           
  python3-keyring-23.11.0-1.fc37.noarch                                         
  python3-lockfile-1:0.12.2-8.fc37.noarch                                       
  python3-more-itertools-8.12.0-5.fc37.noarch                                   
  python3-msgpack-1.0.4-3.fc37.x86_64                                           
  python3-packaging-21.3-6.fc37.noarch                                          
  python3-pastel-0.2.0-9.fc37.noarch                                            
  python3-pexpect-4.8.0-13.fc37.noarch                                          
  python3-pip-22.2.2-3.fc37.noarch                                              
  python3-pkginfo-1.8.3-2.fc37.noarch                                           
  python3-platformdirs-2.5.2-3.fc37.noarch                                      
  python3-ply-3.11-17.fc37.noarch                                               
  python3-poetry-1.1.14-1.fc37.noarch                                           
  python3-poetry-core-1.0.8-3.fc37.noarch                                       
  python3-ptyprocess-0.6.0-17.fc37.noarch                                       
  python3-pycparser-2.20-8.fc37.noarch                                          
  python3-pylev-1.3.0-14.fc37.noarch                                            
  python3-pyparsing-3.0.9-2.fc37.noarch                                         
  python3-pysocks-1.7.1-15.fc37.noarch                                          
  python3-redis-4.3.3-3.fc37.noarch                                             
  python3-requests-2.28.1-3.fc37.noarch                                         
  python3-requests-toolbelt-0.9.1-19.fc37.noarch                                
  python3-secretstorage-3.3.3-1.fc37.noarch                                     
  python3-setuptools-62.6.0-3.fc37.noarch                                       
  python3-shellingham-1.4.0-2.fc37.noarch                                       
  python3-six-1.16.0-8.fc37.noarch                                              
  python3-tomlkit-0.11.4-1.fc37.noarch                                          
  python3-urllib3-1.26.16-1.fc37.noarch                                         
  python3-urllib3+socks-1.26.16-1.fc37.noarch                                   
  python3-virtualenv-20.21.1-1.fc37.noarch                                      
  python3-webencodings-0.5.1-19.fc37.noarch                                     
  python3-wrapt-1.14.0-3.fc37.x86_64                                            
  python3-zipp-3.8.1-2.fc37.noarch                                              

Complete!
42 files removed
--> e36a17a4732
STEP 9/13: RUN poetry config virtualenvs.create false && poetry install
Skipping virtualenv creation, as specified in config file.
/usr/lib/python3.11/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
Updating dependencies
Resolving dependencies...

It got to about 5GB in 10min... ;(

gridhead commented 1 year ago

Not only does the process take up excessive amounts of memory but it also nearly 100% of CPU resources, thus starving other containers and services of the resources that they need for their proper functioning. I started the build from the same Dockerfile (which previously had fedora:37 as the base container image) in a virtual machine in my homelab and I cancelled the build when it was stuck at the Resolving dependencies... stage and used up a little over 50% of the memory I allotted to the virtual machine.

Screenshot_20230913_105321

Screenshot_20230913_105354

gridhead commented 1 year ago

For debugging purposes, it is the Poetry v1:1.14-1.fc37 that was used in building the container image previously.

image

gridhead commented 1 year ago

I tried using fedora:38 as the base image but poetry failed to install the project when it was asked to not use a virtual environment. Here are the logs for debugging.

[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile 
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  355.3kB
Step 1/11 : FROM registry.fedoraproject.org/fedora:38
 ---> 72c9e4564235
Step 2/11 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
 ---> Using cache
 ---> 1daefb639266
Step 3/11 : EXPOSE 8080
 ---> Using cache
 ---> e933d9096523
Step 4/11 : COPY . /code
 ---> Using cache
 ---> 4cb42e4783ac
Step 5/11 : WORKDIR /code
 ---> Using cache
 ---> 51176d311652
Step 6/11 : ENV PYTHONUNBUFFERED=1
 ---> Using cache
 ---> cec5ca5416e6
Step 7/11 : RUN rm -rf /code/poetry.lock
 ---> Using cache
 ---> 50355168c01e
Step 8/11 : RUN dnf -y install python3-pip poetry && dnf -y clean all
 ---> Running in 282a96b7a866
Fedora 38 - x86_64                              8.0 MB/s |  83 MB     00:10    
Fedora 38 openh264 (From Cisco) - x86_64        847  B/s | 2.5 kB     00:03    
Fedora Modular 38 - x86_64                      556 kB/s | 2.8 MB     00:05    
Fedora 38 - x86_64 - Updates                    4.1 MB/s |  32 MB     00:07    
Fedora Modular 38 - x86_64 - Updates            363 kB/s | 2.1 MB     00:06    
Dependencies resolved.
================================================================================
 Package                          Arch     Version              Repo       Size
================================================================================
Installing:
 poetry                           noarch   1.3.2-3.fc38         fedora     17 k
 python3-pip                      noarch   22.3.1-3.fc38        updates   3.1 M
Installing dependencies:
 python-wheel-wheel               noarch   1:0.38.4-2.fc38      fedora     43 k
 python3-CacheControl             noarch   0.12.11-4.fc38       fedora     60 k
 python3-CacheControl+filecache   noarch   0.12.11-4.fc38       fedora    8.7 k
 python3-async-timeout            noarch   4.0.2-6.fc38         fedora     19 k
 python3-attrs                    noarch   22.2.0-2.fc38        fedora    124 k
 python3-cffi                     x86_64   1.15.1-4.fc38        fedora    311 k
 python3-charset-normalizer       noarch   3.1.0-1.fc38         fedora    107 k
 python3-cleo                     noarch   2.0.1-1.fc38         fedora    235 k
 python3-crashtest                noarch   0.4.1-1.fc38         fedora     33 k
 python3-cryptography             x86_64   37.0.2-8.fc38        fedora    1.2 M
 python3-deprecated               noarch   1.2.14-1.fc38        updates    26 k
 python3-distlib                  noarch   0.3.6-2.fc38         fedora    270 k
 python3-dulwich                  x86_64   0.21.2-1.fc38        fedora    605 k
 python3-filelock                 noarch   3.8.2-2.fc38         fedora     40 k
 python3-html5lib                 noarch   1:1.1-11.fc38        fedora    295 k
 python3-idna                     noarch   3.4-2.fc38           fedora    110 k
 python3-importlib-metadata       noarch   6.0.0-2.fc38         fedora     59 k
 python3-jaraco                   noarch   9.1.2-2.fc38         fedora     10 k
 python3-jaraco-classes           noarch   3.2.3-2.fc38         fedora     23 k
 python3-jeepney                  noarch   0.8.0-4.fc38         fedora    418 k
 python3-jsonschema               noarch   4.17.3-2.fc38        fedora    201 k
 python3-keyring                  noarch   23.11.0-3.fc38       fedora    113 k
 python3-lockfile                 noarch   1:0.12.2-9.fc38      fedora     40 k
 python3-more-itertools           noarch   8.13.0-2.fc38        fedora     95 k
 python3-msgpack                  x86_64   1.0.4-4.fc38         fedora     96 k
 python3-packaging                noarch   23.0-1.fc38          fedora    106 k
 python3-pexpect                  noarch   4.8.0-14.fc38        fedora    170 k
 python3-pkginfo                  noarch   1.9.6-1.fc38         fedora     51 k
 python3-platformdirs             noarch   2.6.0-2.fc38         fedora     42 k
 python3-ply                      noarch   3.11-18.fc38         fedora    139 k
 python3-poetry                   noarch   1.3.2-3.fc38         fedora    587 k
 python3-poetry-core              noarch   1.4.0-1.fc38         fedora    1.2 M
 python3-poetry-plugin-export     noarch   1.3.0-2.fc38         fedora     35 k
 python3-ptyprocess               noarch   0.7.0-3.fc38         fedora     36 k
 python3-pycparser                noarch   2.20-9.fc38          fedora    156 k
 python3-pyrsistent               x86_64   0.19.3-2.fc38        fedora    139 k
 python3-pysocks                  noarch   1.7.1-16.fc38        fedora     40 k
 python3-rapidfuzz                x86_64   2.13.7-1.fc38        fedora    1.5 M
 python3-redis                    noarch   4.3.4-2.fc38         fedora    502 k
 python3-requests                 noarch   2.28.2-2.fc38        updates   155 k
 python3-requests-toolbelt        noarch   0.10.1-3.fc38        fedora    122 k
 python3-secretstorage            noarch   3.3.3-2.fc38         fedora     46 k
 python3-setuptools               noarch   65.5.1-2.fc38        fedora    1.7 M
 python3-shellingham              noarch   1.5.0-2.fc38         fedora     33 k
 python3-six                      noarch   1.16.0-9.fc38        fedora     42 k
 python3-tomlkit                  noarch   0.11.4-2.fc38        fedora    117 k
 python3-trove-classifiers        noarch   2023.4.25-1.fc38     updates    26 k
 python3-urllib3                  noarch   1.26.16-1.fc38       updates   257 k
 python3-urllib3+socks            noarch   1.26.16-1.fc38       updates   9.7 k
 python3-virtualenv               noarch   20.21.1-1.fc38       updates   310 k
 python3-webencodings             noarch   0.5.1-20.fc38        fedora     36 k
 python3-wrapt                    x86_64   1.14.1-2.fc38        fedora     69 k
 python3-zipp                     noarch   3.12.0-1.fc38        fedora     22 k
Installing weak dependencies:
 libxcrypt-compat                 x86_64   4.4.36-1.fc38        updates    90 k
 python3-CacheControl+redis       noarch   0.12.11-4.fc38       fedora    8.7 k

Transaction Summary
================================================================================
Install  57 Packages

Total download size: 15 M
Installed size: 65 M
Downloading Packages:
(1/57): python3-CacheControl+filecache-0.12.11-  23 kB/s | 8.7 kB     00:00    
(2/57): poetry-1.3.2-3.fc38.noarch.rpm           32 kB/s |  17 kB     00:00    
(3/57): python3-CacheControl+redis-0.12.11-4.fc  56 kB/s | 8.7 kB     00:00    
(4/57): python-wheel-wheel-0.38.4-2.fc38.noarch  62 kB/s |  43 kB     00:00    
(5/57): python3-async-timeout-4.0.2-6.fc38.noar 111 kB/s |  19 kB     00:00    
(6/57): python3-CacheControl-0.12.11-4.fc38.noa 211 kB/s |  60 kB     00:00    
(7/57): python3-charset-normalizer-3.1.0-1.fc38 353 kB/s | 107 kB     00:00    
(8/57): python3-cffi-1.15.1-4.fc38.x86_64.rpm   544 kB/s | 311 kB     00:00    
(9/57): python3-cleo-2.0.1-1.fc38.noarch.rpm    760 kB/s | 235 kB     00:00    
(10/57): python3-crashtest-0.4.1-1.fc38.noarch. 200 kB/s |  33 kB     00:00    
(11/57): python3-distlib-0.3.6-2.fc38.noarch.rp 1.6 MB/s | 270 kB     00:00    
(12/57): python3-attrs-22.2.0-2.fc38.noarch.rpm 123 kB/s | 124 kB     00:01    
(13/57): python3-cryptography-37.0.2-8.fc38.x86 2.9 MB/s | 1.2 MB     00:00    
(14/57): python3-dulwich-0.21.2-1.fc38.x86_64.r 1.7 MB/s | 605 kB     00:00    
(15/57): python3-html5lib-1.1-11.fc38.noarch.rp 1.7 MB/s | 295 kB     00:00    
(16/57): python3-idna-3.4-2.fc38.noarch.rpm     676 kB/s | 110 kB     00:00    
(17/57): python3-importlib-metadata-6.0.0-2.fc3 395 kB/s |  59 kB     00:00    
(18/57): python3-filelock-3.8.2-2.fc38.noarch.r  73 kB/s |  40 kB     00:00    
(19/57): python3-jaraco-9.1.2-2.fc38.noarch.rpm  61 kB/s |  10 kB     00:00    
(20/57): python3-jaraco-classes-3.2.3-2.fc38.no 143 kB/s |  23 kB     00:00    
(21/57): python3-jsonschema-4.17.3-2.fc38.noarc 1.3 MB/s | 201 kB     00:00    
(22/57): python3-keyring-23.11.0-3.fc38.noarch. 686 kB/s | 113 kB     00:00    
(23/57): python3-lockfile-0.12.2-9.fc38.noarch. 237 kB/s |  40 kB     00:00    
(24/57): python3-more-itertools-8.13.0-2.fc38.n 529 kB/s |  95 kB     00:00    
(25/57): python3-msgpack-1.0.4-4.fc38.x86_64.rp 587 kB/s |  96 kB     00:00    
(26/57): python3-packaging-23.0-1.fc38.noarch.r 583 kB/s | 106 kB     00:00    
(27/57): python3-pexpect-4.8.0-14.fc38.noarch.r 1.1 MB/s | 170 kB     00:00    
(28/57): python3-pkginfo-1.9.6-1.fc38.noarch.rp 266 kB/s |  51 kB     00:00    
(29/57): python3-platformdirs-2.6.0-2.fc38.noar 282 kB/s |  42 kB     00:00    
(30/57): python3-poetry-1.3.2-3.fc38.noarch.rpm 2.6 MB/s | 587 kB     00:00    
(31/57): python3-ply-3.11-18.fc38.noarch.rpm    514 kB/s | 139 kB     00:00    
(32/57): python3-poetry-plugin-export-1.3.0-2.f 234 kB/s |  35 kB     00:00    
(33/57): python3-poetry-core-1.4.0-1.fc38.noarc 4.1 MB/s | 1.2 MB     00:00    
(34/57): python3-ptyprocess-0.7.0-3.fc38.noarch 236 kB/s |  36 kB     00:00    
(35/57): python3-pycparser-2.20-9.fc38.noarch.r 874 kB/s | 156 kB     00:00    
(36/57): python3-pyrsistent-0.19.3-2.fc38.x86_6 820 kB/s | 139 kB     00:00    
(37/57): python3-pysocks-1.7.1-16.fc38.noarch.r 254 kB/s |  40 kB     00:00    
(38/57): python3-redis-4.3.4-2.fc38.noarch.rpm  2.8 MB/s | 502 kB     00:00    
(39/57): python3-rapidfuzz-2.13.7-1.fc38.x86_64 4.3 MB/s | 1.5 MB     00:00    
(40/57): python3-secretstorage-3.3.3-2.fc38.noa 292 kB/s |  46 kB     00:00    
(41/57): python3-requests-toolbelt-0.10.1-3.fc3 651 kB/s | 122 kB     00:00    
(42/57): python3-shellingham-1.5.0-2.fc38.noarc 181 kB/s |  33 kB     00:00    
(43/57): python3-setuptools-65.5.1-2.fc38.noarc 5.1 MB/s | 1.7 MB     00:00    
(44/57): python3-six-1.16.0-9.fc38.noarch.rpm   284 kB/s |  42 kB     00:00    
(45/57): python3-tomlkit-0.11.4-2.fc38.noarch.r 614 kB/s | 117 kB     00:00    
(46/57): python3-webencodings-0.5.1-20.fc38.noa 193 kB/s |  36 kB     00:00    
(47/57): python3-wrapt-1.14.1-2.fc38.x86_64.rpm 416 kB/s |  69 kB     00:00    
(48/57): python3-zipp-3.12.0-1.fc38.noarch.rpm  123 kB/s |  22 kB     00:00    
(49/57): python3-deprecated-1.2.14-1.fc38.noarc  69 kB/s |  26 kB     00:00    
(50/57): libxcrypt-compat-4.4.36-1.fc38.x86_64. 183 kB/s |  90 kB     00:00    
(51/57): python3-requests-2.28.2-2.fc38.noarch. 626 kB/s | 155 kB     00:00    
(52/57): python3-trove-classifiers-2023.4.25-1. 199 kB/s |  26 kB     00:00    
(53/57): python3-urllib3+socks-1.26.16-1.fc38.n  76 kB/s | 9.7 kB     00:00    
(54/57): python3-urllib3-1.26.16-1.fc38.noarch. 1.0 MB/s | 257 kB     00:00    
(55/57): python3-virtualenv-20.21.1-1.fc38.noar 2.3 MB/s | 310 kB     00:00    
(56/57): python3-pip-22.3.1-3.fc38.noarch.rpm   2.1 MB/s | 3.1 MB     00:01    
(57/57): python3-jeepney-0.8.0-4.fc38.noarch.rp  59 kB/s | 418 kB     00:07    
--------------------------------------------------------------------------------
Total                                           1.4 MB/s |  15 MB     00:10     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : python3-six-1.16.0-9.fc38.noarch                      1/57 
  Installing       : python3-setuptools-65.5.1-2.fc38.noarch               2/57 
  Installing       : python3-poetry-core-1.4.0-1.fc38.noarch               3/57 
  Installing       : python3-platformdirs-2.6.0-2.fc38.noarch              4/57 
  Installing       : python3-packaging-23.0-1.fc38.noarch                  5/57 
  Installing       : python3-lockfile-1:0.12.2-9.fc38.noarch               6/57 
  Installing       : python3-jeepney-0.8.0-4.fc38.noarch                   7/57 
  Installing       : python3-idna-3.4-2.fc38.noarch                        8/57 
  Installing       : python3-filelock-3.8.2-2.fc38.noarch                  9/57 
  Installing       : python3-crashtest-0.4.1-1.fc38.noarch                10/57 
  Installing       : python3-pkginfo-1.9.6-1.fc38.noarch                  11/57 
  Installing       : python3-trove-classifiers-2023.4.25-1.fc38.noarch    12/57 
  Installing       : libxcrypt-compat-4.4.36-1.fc38.x86_64                13/57 
  Installing       : python3-zipp-3.12.0-1.fc38.noarch                    14/57 
  Installing       : python3-importlib-metadata-6.0.0-2.fc38.noarch       15/57 
  Installing       : python3-wrapt-1.14.1-2.fc38.x86_64                   16/57 
  Installing       : python3-deprecated-1.2.14-1.fc38.noarch              17/57 
  Installing       : python3-webencodings-0.5.1-20.fc38.noarch            18/57 
  Installing       : python3-html5lib-1:1.1-11.fc38.noarch                19/57 
  Installing       : python3-tomlkit-0.11.4-2.fc38.noarch                 20/57 
  Installing       : python3-shellingham-1.5.0-2.fc38.noarch              21/57 
  Installing       : python3-rapidfuzz-2.13.7-1.fc38.x86_64               22/57 
  Installing       : python3-cleo-2.0.1-1.fc38.noarch                     23/57 
  Installing       : python3-pysocks-1.7.1-16.fc38.noarch                 24/57 
  Installing       : python3-urllib3+socks-1.26.16-1.fc38.noarch          25/57 
  Installing       : python3-urllib3-1.26.16-1.fc38.noarch                26/57 
  Installing       : python3-dulwich-0.21.2-1.fc38.x86_64                 27/57 
  Installing       : python3-pyrsistent-0.19.3-2.fc38.x86_64              28/57 
  Installing       : python3-ptyprocess-0.7.0-3.fc38.noarch               29/57 
  Installing       : python3-pexpect-4.8.0-14.fc38.noarch                 30/57 
  Installing       : python3-ply-3.11-18.fc38.noarch                      31/57 
  Installing       : python3-pycparser-2.20-9.fc38.noarch                 32/57 
  Installing       : python3-cffi-1.15.1-4.fc38.x86_64                    33/57 
  Installing       : python3-cryptography-37.0.2-8.fc38.x86_64            34/57 
  Installing       : python3-secretstorage-3.3.3-2.fc38.noarch            35/57 
  Installing       : python3-msgpack-1.0.4-4.fc38.x86_64                  36/57 
  Installing       : python3-more-itertools-8.13.0-2.fc38.noarch          37/57 
  Installing       : python3-jaraco-9.1.2-2.fc38.noarch                   38/57 
  Installing       : python3-jaraco-classes-3.2.3-2.fc38.noarch           39/57 
  Installing       : python3-keyring-23.11.0-3.fc38.noarch                40/57 
  Installing       : python3-distlib-0.3.6-2.fc38.noarch                  41/57 
  Installing       : python3-charset-normalizer-3.1.0-1.fc38.noarch       42/57 
  Installing       : python3-requests-2.28.2-2.fc38.noarch                43/57 
  Installing       : python3-requests-toolbelt-0.10.1-3.fc38.noarch       44/57 
  Installing       : python3-attrs-22.2.0-2.fc38.noarch                   45/57 
  Installing       : python3-jsonschema-4.17.3-2.fc38.noarch              46/57 
  Installing       : python3-async-timeout-4.0.2-6.fc38.noarch            47/57 
  Installing       : python3-redis-4.3.4-2.fc38.noarch                    48/57 
  Installing       : python3-CacheControl+redis-0.12.11-4.fc38.noarch     49/57 
  Installing       : python3-CacheControl-0.12.11-4.fc38.noarch           50/57 
  Installing       : python3-CacheControl+filecache-0.12.11-4.fc38.noar   51/57 
  Installing       : python-wheel-wheel-1:0.38.4-2.fc38.noarch            52/57 
  Installing       : python3-virtualenv-20.21.1-1.fc38.noarch             53/57 
  Installing       : python3-poetry-plugin-export-1.3.0-2.fc38.noarch     54/57 
  Installing       : python3-poetry-1.3.2-3.fc38.noarch                   55/57 
  Installing       : poetry-1.3.2-3.fc38.noarch                           56/57 
  Installing       : python3-pip-22.3.1-3.fc38.noarch                     57/57 
  Running scriptlet: python3-pip-22.3.1-3.fc38.noarch                     57/57 
  Verifying        : poetry-1.3.2-3.fc38.noarch                            1/57 
  Verifying        : python-wheel-wheel-1:0.38.4-2.fc38.noarch             2/57 
  Verifying        : python3-CacheControl+filecache-0.12.11-4.fc38.noar    3/57 
  Verifying        : python3-CacheControl+redis-0.12.11-4.fc38.noarch      4/57 
  Verifying        : python3-CacheControl-0.12.11-4.fc38.noarch            5/57 
  Verifying        : python3-async-timeout-4.0.2-6.fc38.noarch             6/57 
  Verifying        : python3-attrs-22.2.0-2.fc38.noarch                    7/57 
  Verifying        : python3-cffi-1.15.1-4.fc38.x86_64                     8/57 
  Verifying        : python3-charset-normalizer-3.1.0-1.fc38.noarch        9/57 
  Verifying        : python3-cleo-2.0.1-1.fc38.noarch                     10/57 
  Verifying        : python3-crashtest-0.4.1-1.fc38.noarch                11/57 
  Verifying        : python3-cryptography-37.0.2-8.fc38.x86_64            12/57 
  Verifying        : python3-distlib-0.3.6-2.fc38.noarch                  13/57 
  Verifying        : python3-dulwich-0.21.2-1.fc38.x86_64                 14/57 
  Verifying        : python3-filelock-3.8.2-2.fc38.noarch                 15/57 
  Verifying        : python3-html5lib-1:1.1-11.fc38.noarch                16/57 
  Verifying        : python3-idna-3.4-2.fc38.noarch                       17/57 
  Verifying        : python3-importlib-metadata-6.0.0-2.fc38.noarch       18/57 
  Verifying        : python3-jaraco-9.1.2-2.fc38.noarch                   19/57 
  Verifying        : python3-jaraco-classes-3.2.3-2.fc38.noarch           20/57 
  Verifying        : python3-jeepney-0.8.0-4.fc38.noarch                  21/57 
  Verifying        : python3-jsonschema-4.17.3-2.fc38.noarch              22/57 
  Verifying        : python3-keyring-23.11.0-3.fc38.noarch                23/57 
  Verifying        : python3-lockfile-1:0.12.2-9.fc38.noarch              24/57 
  Verifying        : python3-more-itertools-8.13.0-2.fc38.noarch          25/57 
  Verifying        : python3-msgpack-1.0.4-4.fc38.x86_64                  26/57 
  Verifying        : python3-packaging-23.0-1.fc38.noarch                 27/57 
  Verifying        : python3-pexpect-4.8.0-14.fc38.noarch                 28/57 
  Verifying        : python3-pkginfo-1.9.6-1.fc38.noarch                  29/57 
  Verifying        : python3-platformdirs-2.6.0-2.fc38.noarch             30/57 
  Verifying        : python3-ply-3.11-18.fc38.noarch                      31/57 
  Verifying        : python3-poetry-1.3.2-3.fc38.noarch                   32/57 
  Verifying        : python3-poetry-core-1.4.0-1.fc38.noarch              33/57 
  Verifying        : python3-poetry-plugin-export-1.3.0-2.fc38.noarch     34/57 
  Verifying        : python3-ptyprocess-0.7.0-3.fc38.noarch               35/57 
  Verifying        : python3-pycparser-2.20-9.fc38.noarch                 36/57 
  Verifying        : python3-pyrsistent-0.19.3-2.fc38.x86_64              37/57 
  Verifying        : python3-pysocks-1.7.1-16.fc38.noarch                 38/57 
  Verifying        : python3-rapidfuzz-2.13.7-1.fc38.x86_64               39/57 
  Verifying        : python3-redis-4.3.4-2.fc38.noarch                    40/57 
  Verifying        : python3-requests-toolbelt-0.10.1-3.fc38.noarch       41/57 
  Verifying        : python3-secretstorage-3.3.3-2.fc38.noarch            42/57 
  Verifying        : python3-setuptools-65.5.1-2.fc38.noarch              43/57 
  Verifying        : python3-shellingham-1.5.0-2.fc38.noarch              44/57 
  Verifying        : python3-six-1.16.0-9.fc38.noarch                     45/57 
  Verifying        : python3-tomlkit-0.11.4-2.fc38.noarch                 46/57 
  Verifying        : python3-webencodings-0.5.1-20.fc38.noarch            47/57 
  Verifying        : python3-wrapt-1.14.1-2.fc38.x86_64                   48/57 
  Verifying        : python3-zipp-3.12.0-1.fc38.noarch                    49/57 
  Verifying        : libxcrypt-compat-4.4.36-1.fc38.x86_64                50/57 
  Verifying        : python3-deprecated-1.2.14-1.fc38.noarch              51/57 
  Verifying        : python3-pip-22.3.1-3.fc38.noarch                     52/57 
  Verifying        : python3-requests-2.28.2-2.fc38.noarch                53/57 
  Verifying        : python3-trove-classifiers-2023.4.25-1.fc38.noarch    54/57 
  Verifying        : python3-urllib3+socks-1.26.16-1.fc38.noarch          55/57 
  Verifying        : python3-urllib3-1.26.16-1.fc38.noarch                56/57 
  Verifying        : python3-virtualenv-20.21.1-1.fc38.noarch             57/57 

Installed:
  libxcrypt-compat-4.4.36-1.fc38.x86_64                                         
  poetry-1.3.2-3.fc38.noarch                                                    
  python-wheel-wheel-1:0.38.4-2.fc38.noarch                                     
  python3-CacheControl-0.12.11-4.fc38.noarch                                    
  python3-CacheControl+filecache-0.12.11-4.fc38.noarch                          
  python3-CacheControl+redis-0.12.11-4.fc38.noarch                              
  python3-async-timeout-4.0.2-6.fc38.noarch                                     
  python3-attrs-22.2.0-2.fc38.noarch                                            
  python3-cffi-1.15.1-4.fc38.x86_64                                             
  python3-charset-normalizer-3.1.0-1.fc38.noarch                                
  python3-cleo-2.0.1-1.fc38.noarch                                              
  python3-crashtest-0.4.1-1.fc38.noarch                                         
  python3-cryptography-37.0.2-8.fc38.x86_64                                     
  python3-deprecated-1.2.14-1.fc38.noarch                                       
  python3-distlib-0.3.6-2.fc38.noarch                                           
  python3-dulwich-0.21.2-1.fc38.x86_64                                          
  python3-filelock-3.8.2-2.fc38.noarch                                          
  python3-html5lib-1:1.1-11.fc38.noarch                                         
  python3-idna-3.4-2.fc38.noarch                                                
  python3-importlib-metadata-6.0.0-2.fc38.noarch                                
  python3-jaraco-9.1.2-2.fc38.noarch                                            
  python3-jaraco-classes-3.2.3-2.fc38.noarch                                    
  python3-jeepney-0.8.0-4.fc38.noarch                                           
  python3-jsonschema-4.17.3-2.fc38.noarch                                       
  python3-keyring-23.11.0-3.fc38.noarch                                         
  python3-lockfile-1:0.12.2-9.fc38.noarch                                       
  python3-more-itertools-8.13.0-2.fc38.noarch                                   
  python3-msgpack-1.0.4-4.fc38.x86_64                                           
  python3-packaging-23.0-1.fc38.noarch                                          
  python3-pexpect-4.8.0-14.fc38.noarch                                          
  python3-pip-22.3.1-3.fc38.noarch                                              
  python3-pkginfo-1.9.6-1.fc38.noarch                                           
  python3-platformdirs-2.6.0-2.fc38.noarch                                      
  python3-ply-3.11-18.fc38.noarch                                               
  python3-poetry-1.3.2-3.fc38.noarch                                            
  python3-poetry-core-1.4.0-1.fc38.noarch                                       
  python3-poetry-plugin-export-1.3.0-2.fc38.noarch                              
  python3-ptyprocess-0.7.0-3.fc38.noarch                                        
  python3-pycparser-2.20-9.fc38.noarch                                          
  python3-pyrsistent-0.19.3-2.fc38.x86_64                                       
  python3-pysocks-1.7.1-16.fc38.noarch                                          
  python3-rapidfuzz-2.13.7-1.fc38.x86_64                                        
  python3-redis-4.3.4-2.fc38.noarch                                             
  python3-requests-2.28.2-2.fc38.noarch                                         
  python3-requests-toolbelt-0.10.1-3.fc38.noarch                                
  python3-secretstorage-3.3.3-2.fc38.noarch                                     
  python3-setuptools-65.5.1-2.fc38.noarch                                       
  python3-shellingham-1.5.0-2.fc38.noarch                                       
  python3-six-1.16.0-9.fc38.noarch                                              
  python3-tomlkit-0.11.4-2.fc38.noarch                                          
  python3-trove-classifiers-2023.4.25-1.fc38.noarch                             
  python3-urllib3-1.26.16-1.fc38.noarch                                         
  python3-urllib3+socks-1.26.16-1.fc38.noarch                                   
  python3-virtualenv-20.21.1-1.fc38.noarch                                      
  python3-webencodings-0.5.1-20.fc38.noarch                                     
  python3-wrapt-1.14.1-2.fc38.x86_64                                            
  python3-zipp-3.12.0-1.fc38.noarch                                             

Complete!
42 files removed
Removing intermediate container 282a96b7a866
 ---> 6e57405404db
Step 9/11 : RUN poetry config virtualenvs.create false && poetry install
 ---> Running in 74f12f22e6e3
Skipping virtualenv creation, as specified in config file.
Updating dependencies
Resolving dependencies...

Writing lock file

Package operations: 68 installs, 18 updates, 0 removals

  • Updating attrs (22.2.0 /usr/lib/python3.11/site-packages -> 23.1.0)
  • Updating idna (3.4 /usr/lib/python3.11/site-packages -> 3.4)
  • Updating pycparser (2.20 /usr/lib/python3.11/site-packages -> 2.21)
  • Installing rpds-py (0.10.2)
  • Updating setuptools (65.5.1 /usr/lib/python3.11/site-packages -> 68.2.2)
  • Updating six (1.16.0 /usr/lib/python3.11/site-packages -> 1.16.0)
  • Installing automat (22.10.0)
  • Updating cffi (1.15.1 /usr/lib64/python3.11/site-packages -> 1.15.1)
  • Installing constantly (15.1.0)
  • Installing hyperlink (21.0.0)
  • Installing incremental (22.10.0)
  • Installing referencing (0.30.2)
  • Installing pyasn1 (0.5.0)
  • Installing typing-extensions (4.7.1)
  • Installing zope-interface (6.0)
  • Updating cryptography (37.0.2 /usr/lib64/python3.11/site-packages -> 41.0.3)
  • Installing frozenlist (1.4.0)
  • Installing iniconfig (2.0.0)
  • Installing jsonschema-specifications (2023.7.1)
  • Installing mdurl (0.1.2)
  • Installing multidict (6.0.4)
  • Updating packaging (23.0 /usr/lib/python3.11/site-packages -> 23.1)
  • Installing pluggy (1.3.0)
  • Installing pyasn1-modules (0.3.0)
  • Installing smmap (5.0.0)
  • Installing twisted (23.8.0)
  • Updating wrapt (1.14.1 /usr/lib64/python3.11/site-packages -> 1.15.0)
  • Installing aiosignal (1.3.1)
  • Updating async-timeout (4.0.2 /usr/lib/python3.11/site-packages -> 4.0.3)
  • Installing blinker (1.6.2)
  • Updating charset-normalizer (3.1.0 /usr/lib/python3.11/site-packages -> 3.2.0)
  • Installing click (8.1.7)
  • Installing crochet (2.1.1)
  • Updating distlib (0.3.6 /usr/lib/python3.11/site-packages -> 0.3.7)
  • Updating filelock (3.8.2 /usr/lib/python3.11/site-packages -> 3.12.3)
  • Installing gitdb (4.0.10)
  • Updating jsonschema (4.17.3 /usr/lib/python3.11/site-packages -> 4.19.0)
  • Installing markdown-it-py (3.0.0)
  • Installing mccabe (0.7.0)
  • Installing mypy-extensions (1.0.0)
  • Installing pathspec (0.11.2)
  • Installing pbr (5.11.1)
  • Installing pika (1.3.2)
  • Updating platformdirs (2.6.0 /usr/lib/python3.11/site-packages -> 3.10.0)
  • Installing pycodestyle (2.9.1)
  • Installing pyflakes (2.5.0)
  • Installing pygments (2.16.1)
  • Installing pyopenssl (23.2.0)
  • Installing pytest (7.4.2)
  • Installing pytz (2023.3.post1)
  • Installing service-identity (23.1.0)
  • Installing yarl (1.9.2)
  • Installing aiohttp (3.8.5)
  • Installing black (23.9.1)
  • Installing cachetools (5.3.1)
  • Installing certifi (2023.7.22)
  • Installing chardet (5.2.0)
  • Installing colorama (0.4.6)
  • Installing coverage (7.3.1)
  • Installing fedora-messaging (3.4.1)
  • Installing flake8 (5.0.4)
  • Installing gitpython (3.1.36)
  • Installing isort (5.12.0)
  • Installing pyproject-api (1.6.1)
  • Installing pytest-asyncio (0.21.1)
  • Installing pyyaml (6.0.1)
  • Installing rich (13.5.2)
  • Installing soupsieve (2.5)
  • Installing stevedore (5.1.0)
  • Installing toml (0.10.2)
  • Updating urllib3 (1.26.16 /usr/lib/python3.11/site-packages -> 2.0.4)
  • Updating virtualenv (20.21.1 /usr/lib/python3.11/site-packages -> 20.24.5)
  • Installing aiosqlite (0.19.0)
  • Installing bandit (1.7.5)
  • Installing beautifulsoup4 (4.12.2)
  • Installing gunicorn (20.1.0)
  • Installing mdapi-messages (1.0.0)
  • Installing pytest-aiohttp (1.0.5)
  • Installing pytest-black (0.3.12)
  • Installing pytest-cov (4.1.0)
  • Installing pytest-flake8 (1.1.1)
  • Installing pytest-isort (3.1.0)
  • Installing pyzstd (0.15.9)
  • Updating requests (2.28.2 /usr/lib/python3.11/site-packages -> 2.31.0)
  • Installing tox (4.11.3)
  • Installing uvloop (0.17.0)

Installing the current project: mdapi (3.1.2)
  - Failed to create mdapi.pth for /code

Unable to access any of "/usr/local/lib/python3.11/site-packages/mdapi-3.1.2.dist-info", "/usr/local/lib64/python3.11/site-packages/mdapi-3.1.2.dist-info"
The command '/bin/sh -c poetry config virtualenvs.create false && poetry install' returned a non-zero code: 1

I suspect that I will have to probably push these releases on PyPI and then install them onto the base container image using pip when building the container to install them without any active virtual environment and system-wide.

The aforementioned error has been reported twice (here https://github.com/python-poetry/poetry/issues/6459 and here https://github.com/python-poetry/poetry/issues/7200) and attempted to be fixed (here https://github.com/python-poetry/poetry/pull/7766) but to no avail. There are workarounds to create, activate and use a virtual environment from within a container but frankly, I do not find them convincing.

gridhead commented 1 year ago

This is interesting. I tried installing poetry via pip and then used poetry to install the project. From what I understand - as one of the dependencies of project six requires a certain specific version of setuptools that conflicts with the version of setuptools that is required by poetry, the installation does not go through.

[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile 
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  355.3kB
Step 1/12 : FROM registry.fedoraproject.org/fedora:38
 ---> 72c9e4564235
Step 2/12 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
 ---> Using cache
 ---> 1daefb639266
Step 3/12 : EXPOSE 8080
 ---> Using cache
 ---> e933d9096523
Step 4/12 : COPY . /code
 ---> 05602063e0ad
Step 5/12 : WORKDIR /code
 ---> Running in cd7bc4da0d5d
Removing intermediate container cd7bc4da0d5d
 ---> fd793d6de7da
Step 6/12 : ENV PYTHONUNBUFFERED=1
 ---> Running in 42f4b1ed5eb1
Removing intermediate container 42f4b1ed5eb1
 ---> 21d380eeb1f9
Step 7/12 : RUN rm -rf /code/poetry.lock
 ---> Running in d8d5a2721777
Removing intermediate container d8d5a2721777
 ---> e72ce3ce70ab
Step 8/12 : RUN dnf -y install python3-pip && dnf -y clean all
 ---> Running in 26a5dcb864fd
Fedora 38 - x86_64                              8.3 MB/s |  83 MB     00:09    
Fedora 38 openh264 (From Cisco) - x86_64        729  B/s | 2.5 kB     00:03    
Fedora Modular 38 - x86_64                      784 kB/s | 2.8 MB     00:03    
^C
[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile 
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  355.3kB
Step 1/12 : FROM registry.fedoraproject.org/fedora:38
 ---> 72c9e4564235
Step 2/12 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
 ---> Using cache
 ---> 1daefb639266
Step 3/12 : EXPOSE 8080
 ---> Using cache
 ---> e933d9096523
Step 4/12 : COPY . /code
 ---> Using cache
 ---> 05602063e0ad
Step 5/12 : WORKDIR /code
 ---> Using cache
 ---> fd793d6de7da
Step 6/12 : ENV PYTHONUNBUFFERED=1
 ---> Using cache
 ---> 21d380eeb1f9
Step 7/12 : RUN rm -rf /code/poetry.lock
 ---> Using cache
 ---> e72ce3ce70ab
Step 8/12 : RUN dnf -y install python3-pip && dnf -y clean all
 ---> Running in dbdbe60b1754
Fedora 38 - x86_64                              7.3 MB/s |  83 MB     00:11    
Fedora 38 openh264 (From Cisco) - x86_64        616  B/s | 2.5 kB     00:04    
Fedora Modular 38 - x86_64                      1.1 MB/s | 2.8 MB     00:02    
Fedora 38 - x86_64 - Updates                    4.6 MB/s |  32 MB     00:07    
Fedora Modular 38 - x86_64 - Updates            321 kB/s | 2.1 MB     00:06    
Dependencies resolved.
================================================================================
 Package                  Architecture Version              Repository     Size
================================================================================
Installing:
 python3-pip              noarch       22.3.1-3.fc38        updates       3.1 M
Installing weak dependencies:
 libxcrypt-compat         x86_64       4.4.36-1.fc38        updates        90 k
 python3-setuptools       noarch       65.5.1-2.fc38        fedora        1.7 M

Transaction Summary
================================================================================
Install  3 Packages

Total download size: 4.8 M
Installed size: 23 M
Downloading Packages:
(1/3): libxcrypt-compat-4.4.36-1.fc38.x86_64.rp 104 kB/s |  90 kB     00:00    
(2/3): python3-pip-22.3.1-3.fc38.noarch.rpm     2.1 MB/s | 3.1 MB     00:01    
(3/3): python3-setuptools-65.5.1-2.fc38.noarch. 1.0 MB/s | 1.7 MB     00:01    
--------------------------------------------------------------------------------
Total                                           1.5 MB/s | 4.8 MB     00:03     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : libxcrypt-compat-4.4.36-1.fc38.x86_64                  1/3 
  Installing       : python3-setuptools-65.5.1-2.fc38.noarch                2/3 
  Installing       : python3-pip-22.3.1-3.fc38.noarch                       3/3 
  Running scriptlet: python3-pip-22.3.1-3.fc38.noarch                       3/3 
  Verifying        : python3-setuptools-65.5.1-2.fc38.noarch                1/3 
  Verifying        : libxcrypt-compat-4.4.36-1.fc38.x86_64                  2/3 
  Verifying        : python3-pip-22.3.1-3.fc38.noarch                       3/3 

Installed:
  libxcrypt-compat-4.4.36-1.fc38.x86_64      python3-pip-22.3.1-3.fc38.noarch   
  python3-setuptools-65.5.1-2.fc38.noarch   

Complete!
42 files removed
Removing intermediate container dbdbe60b1754
 ---> 05c33163c515
Step 9/12 : RUN pip install --upgrade poetry
 ---> Running in a76cd578b19a
Collecting poetry
  Downloading poetry-1.6.1-py3-none-any.whl (232 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 232.8/232.8 kB 7.3 MB/s eta 0:00:00
Collecting build<0.11.0,>=0.10.0
  Downloading build-0.10.0-py3-none-any.whl (17 kB)
Collecting cachecontrol[filecache]<0.14.0,>=0.13.0
  Downloading cachecontrol-0.13.1-py3-none-any.whl (22 kB)
Collecting cleo<3.0.0,>=2.0.0
  Downloading cleo-2.0.1-py3-none-any.whl (77 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.3/77.3 kB 8.1 MB/s eta 0:00:00
Collecting crashtest<0.5.0,>=0.4.1
  Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB)
Collecting dulwich<0.22.0,>=0.21.2
  Downloading dulwich-0.21.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (513 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 513.8/513.8 kB 25.8 MB/s eta 0:00:00
Collecting installer<0.8.0,>=0.7.0
  Downloading installer-0.7.0-py3-none-any.whl (453 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 453.8/453.8 kB 36.4 MB/s eta 0:00:00
Collecting jsonschema<4.18.0,>=4.10.0
  Downloading jsonschema-4.17.3-py3-none-any.whl (90 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 90.4/90.4 kB 9.3 MB/s eta 0:00:00
Collecting keyring<25.0.0,>=24.0.0
  Downloading keyring-24.2.0-py3-none-any.whl (37 kB)
Collecting packaging>=20.4
  Downloading packaging-23.1-py3-none-any.whl (48 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 5.6 MB/s eta 0:00:00
Collecting pexpect<5.0.0,>=4.7.0
  Downloading pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.0/59.0 kB 5.4 MB/s eta 0:00:00
Collecting pkginfo<2.0.0,>=1.9.4
  Downloading pkginfo-1.9.6-py3-none-any.whl (30 kB)
Collecting platformdirs<4.0.0,>=3.0.0
  Downloading platformdirs-3.10.0-py3-none-any.whl (17 kB)
Collecting poetry-core==1.7.0
  Downloading poetry_core-1.7.0-py3-none-any.whl (426 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 426.4/426.4 kB 36.4 MB/s eta 0:00:00
Collecting poetry-plugin-export<2.0.0,>=1.5.0
  Downloading poetry_plugin_export-1.5.0-py3-none-any.whl (10 kB)
Collecting pyproject-hooks<2.0.0,>=1.0.0
  Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB)
Collecting requests<3.0,>=2.26
  Downloading requests-2.31.0-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 5.7 MB/s eta 0:00:00
Collecting requests-toolbelt<2,>=0.9.1
  Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.5/54.5 kB 5.0 MB/s eta 0:00:00
Collecting shellingham<2.0,>=1.5
  Downloading shellingham-1.5.3-py2.py3-none-any.whl (9.7 kB)
Collecting tomlkit<1.0.0,>=0.11.4
  Downloading tomlkit-0.12.1-py3-none-any.whl (37 kB)
Collecting trove-classifiers>=2022.5.19
  Downloading trove_classifiers-2023.8.7-py3-none-any.whl (13 kB)
Collecting virtualenv<21.0.0,>=20.22.0
  Downloading virtualenv-20.24.5-py3-none-any.whl (3.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.7/3.7 MB 36.1 MB/s eta 0:00:00
Collecting msgpack>=0.5.2
  Downloading msgpack-1.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (325 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 325.1/325.1 kB 19.4 MB/s eta 0:00:00
Collecting filelock>=3.8.0
  Downloading filelock-3.12.3-py3-none-any.whl (11 kB)
Collecting rapidfuzz<3.0.0,>=2.2.0
  Downloading rapidfuzz-2.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 34.8 MB/s eta 0:00:00
Collecting urllib3>=1.25
  Downloading urllib3-2.0.4-py3-none-any.whl (123 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.9/123.9 kB 13.7 MB/s eta 0:00:00
Collecting attrs>=17.4.0
  Downloading attrs-23.1.0-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 kB 5.6 MB/s eta 0:00:00
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
  Downloading pyrsistent-0.19.3-py3-none-any.whl (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 5.1 MB/s eta 0:00:00
Collecting jaraco.classes
  Downloading jaraco.classes-3.3.0-py3-none-any.whl (5.9 kB)
Collecting importlib-metadata>=4.11.4
  Downloading importlib_metadata-6.8.0-py3-none-any.whl (22 kB)
Collecting SecretStorage>=3.2
  Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB)
Collecting jeepney>=0.4.2
  Downloading jeepney-0.8.0-py3-none-any.whl (48 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.4/48.4 kB 4.4 MB/s eta 0:00:00
Collecting ptyprocess>=0.5
  Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting charset-normalizer<4,>=2
  Downloading charset_normalizer-3.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.6/199.6 kB 15.9 MB/s eta 0:00:00
Collecting idna<4,>=2.5
  Downloading idna-3.4-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 5.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
  Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.3/158.3 kB 15.7 MB/s eta 0:00:00
Collecting distlib<1,>=0.3.7
  Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 468.9/468.9 kB 31.9 MB/s eta 0:00:00
Collecting zipp>=0.5
  Downloading zipp-3.16.2-py3-none-any.whl (7.2 kB)
Collecting cryptography>=2.0
  Downloading cryptography-41.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.3/4.3 MB 36.3 MB/s eta 0:00:00
Collecting more-itertools
  Downloading more_itertools-10.1.0-py3-none-any.whl (55 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.8/55.8 kB 6.0 MB/s eta 0:00:00
Collecting cffi>=1.12
  Downloading cffi-1.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (462 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 462.6/462.6 kB 22.3 MB/s eta 0:00:00
Collecting pycparser
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 7.6 MB/s eta 0:00:00
Installing collected packages: trove-classifiers, ptyprocess, msgpack, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyrsistent, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, attrs, virtualenv, requests, jsonschema, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry
Successfully installed SecretStorage-3.3.3 attrs-23.1.0 build-0.10.0 cachecontrol-0.13.1 certifi-2023.7.22 cffi-1.15.1 charset-normalizer-3.2.0 cleo-2.0.1 crashtest-0.4.1 cryptography-41.0.3 distlib-0.3.7 dulwich-0.21.6 filelock-3.12.3 idna-3.4 importlib-metadata-6.8.0 installer-0.7.0 jaraco.classes-3.3.0 jeepney-0.8.0 jsonschema-4.17.3 keyring-24.2.0 more-itertools-10.1.0 msgpack-1.0.5 packaging-23.1 pexpect-4.8.0 pkginfo-1.9.6 platformdirs-3.10.0 poetry-1.6.1 poetry-core-1.7.0 poetry-plugin-export-1.5.0 ptyprocess-0.7.0 pycparser-2.21 pyproject-hooks-1.0.0 pyrsistent-0.19.3 rapidfuzz-2.15.1 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.3 tomlkit-0.12.1 trove-classifiers-2023.8.7 urllib3-2.0.4 virtualenv-20.24.5 zipp-3.16.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Removing intermediate container a76cd578b19a
 ---> 20bfa099f052
Step 10/12 : RUN poetry config virtualenvs.create false && poetry install
 ---> Running in 3829485d40dd
Skipping virtualenv creation, as specified in config file.
Updating dependencies
Resolving dependencies...

Package operations: 70 installs, 2 updates, 0 removals

  • Installing rpds-py (0.10.2)
  • Updating setuptools (65.5.1 /usr/lib/python3.11/site-packages -> 68.2.2)
  • Installing six (1.16.0)

  CalledProcessError

  Command '['/usr/bin/python3', '-m', 'pip', 'uninstall', 'setuptools', '-y']' returned non-zero exit status 1.

  at /usr/lib64/python3.11/subprocess.py:571 in run
       567│             # We don't call process.wait() as .__exit__ does that for us.
       568│             raise
       569│         retcode = process.poll()
       570│         if check and retcode:
    →  571│             raise CalledProcessError(retcode, process.args,
       572│                                      output=stdout, stderr=stderr)
       573│     return CompletedProcess(process.args, retcode, stdout, stderr)
       574│ 
       575│ 

The following error occurred when trying to handle this error:

  EnvCommandError

  Command ['/usr/bin/python3', '-m', 'pip', 'uninstall', 'setuptools', '-y'] errored with the following return code 1

  Output:
  Found existing installation: setuptools 65.5.1
  ERROR: Cannot uninstall setuptools 65.5.1, RECORD file not found. Hint: The package was installed by rpm.

  at /usr/local/lib/python3.11/site-packages/poetry/utils/env/base_env.py:363 in _run
      359│                 output = subprocess.check_output(
      360│                     cmd, stderr=stderr, env=env, text=True, **kwargs
      361│                 )
      362│         except CalledProcessError as e:
    → 363│             raise EnvCommandError(e, input=input_)
      364│ 
      365│         return output
      366│ 
      367│     def execute(self, bin: str, *args: str, **kwargs: Any) -> int:

The command '/bin/sh -c poetry config virtualenvs.create false && poetry install' returned a non-zero code: 1

Seems like installing from PyPI remains to be the last resort - what do you think @abompard ?

gridhead commented 1 year ago

I pushed a new release on GitHub https://github.com/fedora-infra/mdapi/releases/tag/3.1.3 and an associated new release on PyPI https://pypi.org/project/mdapi/3.1.3/, which happens to be the first release of the project on that platform. I also changed the Dockerfile to not remove the staged that required poetry to be installed and the project to be built/installed locally as we are not doing that anymore.

Dockerfile

FROM registry.fedoraproject.org/fedora:38

LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"

EXPOSE 8080

ENV PYTHONUNBUFFERED=1

RUN dnf -y install python3-pip && dnf -y clean all
RUN pip install --upgrade mdapi==3.1.3

# Uncomment the following MDAPI_CONFIG and comment the other MDAPI_CONFIG for local development builds
# ENV MDAPI_CONFIG=/code/mdapi/confdata/standard.py

# For deployment purposes, make a custom configuration in the /etc/mdapi/confdata directory
ENV MDAPI_CONFIG=/etc/mdapi/confdata/myconfig.py

ENTRYPOINT mdapi -c $MDAPI_CONFIG serveapp

This one works just fine.

[centvirt-slvb@centvirt-slvb mdapi-prod]$ docker build . -f Dockerfile -t mdapi:v3.1.3
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  355.3kB
Step 1/10 : FROM fedora:38
 ---> 6b9fae4fa405
Step 2/10 : LABEL maintainer "Akashdeep Dhar <t0xic0der@fedoraproject.org>"
 ---> Using cache
 ---> 55622f4a526f
Step 3/10 : EXPOSE 8080
 ---> Using cache
 ---> 9fbb663016e1
Step 4/10 : COPY . /code
 ---> 12b5b8bdcef8
Step 5/10 : WORKDIR /code
 ---> Running in dc178baee47b
Removing intermediate container dc178baee47b
 ---> 670a6a567fef
Step 6/10 : ENV PYTHONUNBUFFERED=1
 ---> Running in b70bed3e21b8
Removing intermediate container b70bed3e21b8
 ---> 790163180fc3
Step 7/10 : RUN dnf -y install python3-pip && dnf -y clean all
 ---> Running in 9f19721ebb61
Fedora 38 - x86_64                              2.7 MB/s |  83 MB     00:30    
Fedora 38 openh264 (From Cisco) - x86_64        752  B/s | 2.5 kB     00:03    
Fedora Modular 38 - x86_64                      814 kB/s | 2.8 MB     00:03    
Fedora 38 - x86_64 - Updates                    7.3 MB/s |  32 MB     00:04    
Fedora Modular 38 - x86_64 - Updates            562 kB/s | 2.1 MB     00:03    
Last metadata expiration check: 0:00:01 ago on Wed Sep 13 08:34:02 2023.
Dependencies resolved.
================================================================================
 Package                  Architecture Version              Repository     Size
================================================================================
Installing:
 python3-pip              noarch       22.3.1-3.fc38        updates       3.1 M
Installing weak dependencies:
 libxcrypt-compat         x86_64       4.4.36-1.fc38        updates        90 k
 python3-setuptools       noarch       65.5.1-2.fc38        fedora        1.7 M

Transaction Summary
================================================================================
Install  3 Packages

Total download size: 4.8 M
Installed size: 23 M
Downloading Packages:
(1/3): libxcrypt-compat-4.4.36-1.fc38.x86_64.rp 170 kB/s |  90 kB     00:00    
(2/3): python3-pip-22.3.1-3.fc38.noarch.rpm     2.0 MB/s | 3.1 MB     00:01    
(3/3): python3-setuptools-65.5.1-2.fc38.noarch. 780 kB/s | 1.7 MB     00:02    
--------------------------------------------------------------------------------
Total                                           1.2 MB/s | 4.8 MB     00:04     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : libxcrypt-compat-4.4.36-1.fc38.x86_64                  1/3 
  Installing       : python3-setuptools-65.5.1-2.fc38.noarch                2/3 
  Installing       : python3-pip-22.3.1-3.fc38.noarch                       3/3 
  Running scriptlet: python3-pip-22.3.1-3.fc38.noarch                       3/3 
  Verifying        : python3-setuptools-65.5.1-2.fc38.noarch                1/3 
  Verifying        : libxcrypt-compat-4.4.36-1.fc38.x86_64                  2/3 
  Verifying        : python3-pip-22.3.1-3.fc38.noarch                       3/3 

Installed:
  libxcrypt-compat-4.4.36-1.fc38.x86_64      python3-pip-22.3.1-3.fc38.noarch   
  python3-setuptools-65.5.1-2.fc38.noarch   

Complete!
42 files removed
Removing intermediate container 9f19721ebb61
 ---> eda9d0f1ab5c
Step 8/10 : RUN pip install --upgrade mdapi==3.1.3
 ---> Running in b079581ade2c
Collecting mdapi==3.1.3
  Downloading mdapi-3.1.3-py3-none-any.whl (37 kB)
Collecting aiohttp<4.0.0,>=3.8.1
  Downloading aiohttp-3.8.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 13.9 MB/s eta 0:00:00
Collecting aiosqlite<0.20.0,>=0.18.0
  Downloading aiosqlite-0.19.0-py3-none-any.whl (15 kB)
Collecting click<9.0.0,>=8.1.3
  Downloading click-8.1.7-py3-none-any.whl (97 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 8.7 MB/s eta 0:00:00
Collecting fedora-messaging<4.0.0,>=3.0.2
  Downloading fedora_messaging-3.4.1-py3-none-any.whl (109 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 109.2/109.2 kB 11.0 MB/s eta 0:00:00
Collecting gunicorn<21.0.0,>=20.1.0
  Downloading gunicorn-20.1.0-py3-none-any.whl (79 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.5/79.5 kB 9.0 MB/s eta 0:00:00
Collecting mdapi-messages<2.0.0,>=1.0.0
  Downloading mdapi_messages-1.0.0-py2.py3-none-any.whl (14 kB)
Collecting pyzstd<0.16.0,>=0.15.0
  Downloading pyzstd-0.15.9-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (412 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 412.3/412.3 kB 15.3 MB/s eta 0:00:00
Collecting requests<3.0.0,>=2.28.1
  Downloading requests-2.31.0-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 6.5 MB/s eta 0:00:00
Requirement already satisfied: setuptools in /usr/lib/python3.11/site-packages (from mdapi==3.1.3) (65.5.1)
Collecting uvloop<0.18.0,>=0.17.0
  Downloading uvloop-0.17.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.2/4.2 MB 30.0 MB/s eta 0:00:00
Collecting attrs>=17.3.0
  Downloading attrs-23.1.0-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 kB 7.1 MB/s eta 0:00:00
Collecting charset-normalizer<4.0,>=2.0
  Downloading charset_normalizer-3.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.6/199.6 kB 21.7 MB/s eta 0:00:00
Collecting multidict<7.0,>=4.5
  Downloading multidict-6.0.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (117 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.4/117.4 kB 10.3 MB/s eta 0:00:00
Collecting async-timeout<5.0,>=4.0.0a3
  Downloading async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Collecting yarl<2.0,>=1.0
  Downloading yarl-1.9.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 282.8/282.8 kB 16.6 MB/s eta 0:00:00
Collecting frozenlist>=1.1.1
  Downloading frozenlist-1.4.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 250.5/250.5 kB 19.4 MB/s eta 0:00:00
Collecting aiosignal>=1.1.2
  Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting blinker
  Downloading blinker-1.6.2-py3-none-any.whl (13 kB)
Collecting crochet
  Downloading crochet-2.1.1-py3-none-any.whl (31 kB)
Collecting jsonschema
  Downloading jsonschema-4.19.0-py3-none-any.whl (83 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.4/83.4 kB 9.4 MB/s eta 0:00:00
Collecting Twisted
  Downloading twisted-23.8.0-py3-none-any.whl (3.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 29.9 MB/s eta 0:00:00
Collecting pytz
  Downloading pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 502.5/502.5 kB 14.1 MB/s eta 0:00:00
Collecting PyOpenSSL
  Downloading pyOpenSSL-23.2.0-py3-none-any.whl (59 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.0/59.0 kB 6.0 MB/s eta 0:00:00
Collecting pika>=1.0.1
  Downloading pika-1.3.2-py3-none-any.whl (155 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.4/155.4 kB 13.3 MB/s eta 0:00:00
Collecting service-identity
  Downloading service_identity-23.1.0-py3-none-any.whl (12 kB)
Collecting idna<4,>=2.5
  Downloading idna-3.4-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 6.4 MB/s eta 0:00:00
Collecting urllib3<3,>=1.21.1
  Downloading urllib3-2.0.4-py3-none-any.whl (123 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.9/123.9 kB 12.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
  Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.3/158.3 kB 15.5 MB/s eta 0:00:00
Collecting wrapt
  Downloading wrapt-1.15.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (78 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.9/78.9 kB 7.6 MB/s eta 0:00:00
Collecting automat>=0.8.0
  Downloading Automat-22.10.0-py2.py3-none-any.whl (26 kB)
Collecting constantly>=15.1
  Downloading constantly-15.1.0-py2.py3-none-any.whl (7.9 kB)
Collecting hyperlink>=17.1.1
  Downloading hyperlink-21.0.0-py2.py3-none-any.whl (74 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.6/74.6 kB 7.6 MB/s eta 0:00:00
Collecting incremental>=22.10.0
  Downloading incremental-22.10.0-py2.py3-none-any.whl (16 kB)
Collecting typing-extensions>=3.10.0
  Downloading typing_extensions-4.7.1-py3-none-any.whl (33 kB)
Collecting zope-interface>=5
  Downloading zope.interface-6.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (249 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 249.0/249.0 kB 19.0 MB/s eta 0:00:00
Collecting jsonschema-specifications>=2023.03.6
  Downloading jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB)
Collecting referencing>=0.28.4
  Downloading referencing-0.30.2-py3-none-any.whl (25 kB)
Collecting rpds-py>=0.7.1
  Downloading rpds_py-0.10.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 30.0 MB/s eta 0:00:00
Collecting cryptography!=40.0.0,!=40.0.1,<42,>=38.0.0
  Downloading cryptography-41.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.3/4.3 MB 28.7 MB/s eta 0:00:00
Collecting pyasn1
  Downloading pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.9/83.9 kB 9.3 MB/s eta 0:00:00
Collecting pyasn1-modules
  Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 12.0 MB/s eta 0:00:00
Collecting six
  Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting cffi>=1.12
  Downloading cffi-1.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (462 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 462.6/462.6 kB 15.3 MB/s eta 0:00:00
Collecting pycparser
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 9.5 MB/s eta 0:00:00
Installing collected packages: pytz, incremental, constantly, zope-interface, wrapt, uvloop, urllib3, typing-extensions, six, rpds-py, pyzstd, pycparser, pyasn1, pika, multidict, idna, gunicorn, frozenlist, click, charset-normalizer, certifi, blinker, attrs, async-timeout, aiosqlite, yarl, requests, referencing, pyasn1-modules, hyperlink, cffi, automat, aiosignal, Twisted, jsonschema-specifications, cryptography, aiohttp, service-identity, PyOpenSSL, jsonschema, crochet, fedora-messaging, mdapi-messages, mdapi
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Successfully installed PyOpenSSL-23.2.0 Twisted-23.8.0 aiohttp-3.8.5 aiosignal-1.3.1 aiosqlite-0.19.0 async-timeout-4.0.3 attrs-23.1.0 automat-22.10.0 blinker-1.6.2 certifi-2023.7.22 cffi-1.15.1 charset-normalizer-3.2.0 click-8.1.7 constantly-15.1.0 crochet-2.1.1 cryptography-41.0.3 fedora-messaging-3.4.1 frozenlist-1.4.0 gunicorn-20.1.0 hyperlink-21.0.0 idna-3.4 incremental-22.10.0 jsonschema-4.19.0 jsonschema-specifications-2023.7.1 mdapi-3.1.3 mdapi-messages-1.0.0 multidict-6.0.4 pika-1.3.2 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pytz-2023.3.post1 pyzstd-0.15.9 referencing-0.30.2 requests-2.31.0 rpds-py-0.10.2 service-identity-23.1.0 six-1.16.0 typing-extensions-4.7.1 urllib3-2.0.4 uvloop-0.17.0 wrapt-1.15.0 yarl-1.9.2 zope-interface-6.0
Removing intermediate container b079581ade2c
 ---> 1d1000600cf2
Step 9/10 : ENV MDAPI_CONFIG=/etc/mdapi/confdata/myconfig.py
 ---> Running in 464062e18235
Removing intermediate container 464062e18235
 ---> 1e9b61e12322
Step 10/10 : ENTRYPOINT mdapi -c $MDAPI_CONFIG serveapp
 ---> Running in 82a640796bf5
Removing intermediate container 82a640796bf5
 ---> 958ebcfd83a4
Successfully built 958ebcfd83a4
Successfully tagged mdapi:v3.1.3

I am not sure if this is objectively the correct way of doing things but as this is working just fine and I do not have any other solutions present in hand at the moment, I am going to push the necessary changes to the develop and prod branches for the Dockerfile.

gridhead commented 1 year ago

@davidkirwan reported that the most recent version has successfully generated the container image and MDAPI v3.1.3 is now deployed in the production environment.

Closing this now as FIXED. Thanks for reporting this @nirik!