ReproNim / reproman

ReproMan (AKA NICEMAN, AKA ReproNim TRD3)
https://reproman.readthedocs.io
Other
24 stars 14 forks source link

reproman installation error when recompiling pyopenssl in dockerfile #582

Open satra opened 2 years ago

satra commented 2 years ago

i had to remove reproman from the abcd-repronim dockerfile as it tries to recompile pyopenssl and runs into an error which seems to be version dependent on a bunch of other libraries. i did not dig into all the dependencies of reproman, but the docker image is here: satra/abcd-repronim:2bd375 (same as latest currently) and the file that built the image is here: https://github.com/ABCD-ReproNim/reprohub/blob/b124d9fe5880ab8ee3ea9e3a13cf146e47e3c963/docker/Dockerfile . since this is based on the jupter datascience image the conda environment is already quite complex. but i think reproman should be installable in such an environment or at least determine what the conflicts are.

yarikoptic commented 2 years ago

Thank you @satra , we will try to troubleshoot ASAP

satra commented 2 years ago

@yarikoptic - @richford just added reproman back into the dockerfile and the build failed, and it reminded me why i had taken it out. any updates on this one?

yarikoptic commented 2 years ago

FWIW

on my debian system pip install reproman in a fresh venv works out just fine ```shell $> py=3; d=venvs/dev3-reproman-piponly; rm -fr $d && python$py -m venv -- $d && source $d/bin/activate && python3 -m pip install reproman Collecting reproman Downloading reproman-0.4.1.tar.gz (794 kB) |████████████████████████████████| 794 kB 475 kB/s Preparing metadata (setup.py) ... done Collecting appdirs Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Collecting attrs>=16.3.0 Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB) Collecting cryptography>=2.5 Using cached cryptography-36.0.1-cp36-abi3-manylinux_2_24_x86_64.whl (3.6 MB) Collecting etelemetry>=0.2.0 Using cached etelemetry-0.3.0-py3-none-any.whl (6.3 kB) Collecting fabric>=2.3.1 Downloading fabric-2.6.0-py2.py3-none-any.whl (53 kB) |████████████████████████████████| 53 kB 897 kB/s Collecting humanize Using cached humanize-4.0.0-py3-none-any.whl (97 kB) Collecting jinja2 Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB) Collecting pyOpenSSL==16.2.0 Downloading pyOpenSSL-16.2.0-py2.py3-none-any.whl (43 kB) |████████████████████████████████| 43 kB 840 kB/s Collecting pycrypto Downloading pycrypto-2.6.1.tar.gz (446 kB) |████████████████████████████████| 446 kB 2.5 MB/s Preparing metadata (setup.py) ... done Collecting pytz Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB) Collecting pyyaml Using cached PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB) Collecting requests Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB) Collecting rpaths Downloading rpaths-1.0.0-py2.py3-none-any.whl (12 kB) Collecting scp Downloading scp-0.14.4-py2.py3-none-any.whl (8.6 kB) Collecting tqdm Using cached tqdm-4.63.0-py2.py3-none-any.whl (76 kB) Collecting reprozip Downloading reprozip-1.1-cp39-cp39-manylinux2010_x86_64.whl (783 kB) |████████████████████████████████| 783 kB 3.0 MB/s Collecting six>=1.5.2 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting cffi>=1.12 Using cached cffi-1.15.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (444 kB) Collecting ci-info>=0.2 Using cached ci_info-0.2.0-py3-none-any.whl (6.9 kB) Collecting paramiko>=2.4 Downloading paramiko-2.10.2-py2.py3-none-any.whl (211 kB) |████████████████████████████████| 211 kB 3.9 MB/s Collecting pathlib2 Downloading pathlib2-2.3.7.post1-py2.py3-none-any.whl (18 kB) Collecting invoke<2.0,>=1.3 Downloading invoke-1.6.0-py3-none-any.whl (212 kB) |████████████████████████████████| 212 kB 3.2 MB/s Collecting MarkupSafe>=2.0 Using cached MarkupSafe-2.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB) Collecting distro Using cached distro-1.7.0-py3-none-any.whl (20 kB) Collecting usagestats>=0.3 Downloading usagestats-1.0.1-py2.py3-none-any.whl (10 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.8-py2.py3-none-any.whl (138 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting pynacl>=1.0.1 Using cached PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting bcrypt>=3.1.3 Downloading bcrypt-3.2.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (61 kB) |████████████████████████████████| 61 kB 560 kB/s Using legacy 'setup.py install' for reproman, since package 'wheel' is not installed. Using legacy 'setup.py install' for pycrypto, since package 'wheel' is not installed. Installing collected packages: pycparser, urllib3, six, idna, charset-normalizer, cffi, certifi, requests, pynacl, distro, cryptography, bcrypt, usagestats, rpaths, pyyaml, pathlib2, paramiko, MarkupSafe, invoke, ci-info, tqdm, scp, reprozip, pytz, pyOpenSSL, pycrypto, jinja2, humanize, fabric, etelemetry, attrs, appdirs, reproman Running setup.py install for pycrypto ... done Running setup.py install for reproman ... done Successfully installed MarkupSafe-2.1.0 appdirs-1.4.4 attrs-21.4.0 bcrypt-3.2.0 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 ci-info-0.2.0 cryptography-36.0.1 distro-1.7.0 etelemetry-0.3.0 fabric-2.6.0 humanize-4.0.0 idna-3.3 invoke-1.6.0 jinja2-3.0.3 paramiko-2.10.2 pathlib2-2.3.7.post1 pyOpenSSL-16.2.0 pycparser-2.21 pycrypto-2.6.1 pynacl-1.5.0 pytz-2021.3 pyyaml-6.0 reproman-0.4.1 reprozip-1.1 requests-2.27.1 rpaths-1.0.0 scp-0.14.4 six-1.16.0 tqdm-4.63.0 urllib3-1.26.8 usagestats-1.0.1 ```

and it does install (indirect dependency)

Collecting pyOpenSSL==16.2.0
  Downloading pyOpenSSL-16.2.0-py2.py3-none-any.whl (43 kB)
     |████████████████████████████████| 43 kB 840 kB/s       

from the whl. I will try to see what is so special about that docker env...

yarikoptic commented 2 years ago

FTR: started to prep a fresh release in #583 but apparently fixing is needed to the tests