Closed remtav closed 1 year ago
Describe the bug CI for all new PRs has failed (most probably) due to a change in one of our library versions. https://github.com/NRCan/geo-deep-learning/pulls To make sure the cause is not on our side, I reran a CI pipeline from PR #518 (https://github.com/NRCan/geo-deep-learning/pull/518) It had passed on May 18th: https://github.com/NRCan/geo-deep-learning/actions/runs/5015264810/attempts/1 But not May 31st: https://github.com/NRCan/geo-deep-learning/actions/runs/5015264810/jobs/9244379169?pr=518
To Reproduce Steps to reproduce the behavior:
docker pull continuumio/miniconda3 docker run -it --rm --mount type=bind,source=C:\path\to\geo-deep-learning,target=/geo-deep-learning continuumio/miniconda3:latest /bin/bash conda env create --file /geo-deep-learning/environment.yml
Expected behavior Environment should create succesfully with torch-gpu if running on gpu mahcine, or torch-cpu otherwise. Tests with mamba have succeeded by replacing: conda env create --file /geo-deep-learning/environment.yml with
conda env create --file /geo-deep-learning/environment.yml
conda install mamba -c conda-forge mamba env create -f /geo-deep-learning/environment.yml
Screenshots Env created with mamba (for future reference):
# packages in environment at /opt/conda/envs/geo_deep_env: # # Name Version Build Channel _libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 2_gnu conda-forge affine 2.4.0 pyhd8ed1ab_0 conda-forge alembic 1.11.1 pypi_0 pypi antlr-python-runtime 4.9.3 pyhd8ed1ab_1 conda-forge anyio 3.7.0 pyhd8ed1ab_1 conda-forge aom 3.5.0 h27087fc_0 conda-forge arrow 1.2.3 pyhd8ed1ab_0 conda-forge attrs 23.1.0 pyh71513ae_1 conda-forge autopage 0.5.1 pypi_0 pypi backports 1.0 pyhd8ed1ab_3 conda-forge backports.functools_lru_cache 1.6.4 pyhd8ed1ab_0 conda-forge bcrypt 3.2.2 py310h5764c6d_1 conda-forge beautifulsoup4 4.12.2 pyha770c72_0 conda-forge blas 1.0 mkl conda-forge blessed 1.19.1 pyhe4f9e05_2 conda-forge blinker 1.6.2 pypi_0 pypi blosc 1.21.4 h0f2a231_0 conda-forge boost-cpp 1.78.0 h5adbc97_2 conda-forge branca 0.6.0 pyhd8ed1ab_0 conda-forge brotli 1.0.9 h166bdaf_8 conda-forge brotli-bin 1.0.9 h166bdaf_8 conda-forge brunsli 0.1 h9c3ff4c_0 conda-forge bzip2 1.0.8 h7f98852_4 conda-forge c-ares 1.19.1 hd590300_0 conda-forge c-blosc2 2.9.2 hb4ffafa_0 conda-forge ca-certificates 2023.5.7 hbcca054_0 conda-forge cachecontrol 0.12.11 pyhd8ed1ab_1 conda-forge cachetools 5.3.1 pypi_0 pypi cachy 0.3.0 pyhd8ed1ab_1 conda-forge cairo 1.16.0 ha61ee94_1014 conda-forge certifi 2023.5.7 pyhd8ed1ab_0 conda-forge cffi 1.15.1 py310h255011f_3 conda-forge cfitsio 4.2.0 hd9d235c_0 conda-forge chardet 3.0.4 pypi_0 pypi charls 2.4.2 h59595ed_0 conda-forge charset-normalizer 3.1.0 pyhd8ed1ab_0 conda-forge cleo 0.8.1 pyhd8ed1ab_2 conda-forge click 8.1.3 unix_pyhd8ed1ab_2 conda-forge click-plugins 1.1.1 py_0 conda-forge cliff 4.3.0 pypi_0 pypi cligj 0.7.2 pyhd8ed1ab_1 conda-forge clikit 0.6.2 pyhd8ed1ab_2 conda-forge cloudpickle 2.2.1 pyhd8ed1ab_0 conda-forge cmaes 0.9.1 pypi_0 pypi cmd2 2.4.3 pypi_0 pypi colorama 0.4.6 pyhd8ed1ab_0 conda-forge colorlog 6.7.0 pypi_0 pypi contourpy 1.0.7 py310hdf3cbec_0 conda-forge coverage 7.2.7 py310h2372a71_0 conda-forge crashtest 0.3.1 pyhd8ed1ab_0 conda-forge croniter 1.3.15 pyhd8ed1ab_0 conda-forge cryptography 41.0.0 py310h75e40e8_0 conda-forge cudatoolkit 11.6.0 hecad31d_11 conda-forge curl 8.1.2 h409715c_0 conda-forge cycler 0.11.0 pyhd8ed1ab_0 conda-forge cytoolz 0.12.0 py310h5764c6d_1 conda-forge dask-core 2023.3.1 pyhd8ed1ab_0 conda-forge databricks-cli 0.17.6 pypi_0 pypi dateutils 0.6.12 py_0 conda-forge dav1d 1.2.0 hd590300_0 conda-forge dbus 1.13.6 h5008d03_3 conda-forge deepdiff 6.3.0 pyhd8ed1ab_0 conda-forge distlib 0.3.6 pyhd8ed1ab_0 conda-forge docker 5.0.3 pypi_0 pypi efficientnet-pytorch 0.7.1 pyhd8ed1ab_1 conda-forge einops 0.6.1 pyhd8ed1ab_0 conda-forge entrypoints 0.4 pypi_0 pypi exceptiongroup 1.1.1 pyhd8ed1ab_0 conda-forge expat 2.5.0 hcb278e6_1 conda-forge fastapi 0.88.0 pyhd8ed1ab_0 conda-forge ffmpeg 4.3 hf484d3e_0 pytorch filelock 3.12.0 pyhd8ed1ab_0 conda-forge fiona 1.9.1 py310ha325b7b_0 conda-forge flask 2.3.2 pypi_0 pypi folium 0.14.0 pyhd8ed1ab_0 conda-forge font-ttf-dejavu-sans-mono 2.37 hab24e00_0 conda-forge font-ttf-inconsolata 3.000 h77eed37_0 conda-forge font-ttf-source-code-pro 2.038 h77eed37_0 conda-forge font-ttf-ubuntu 0.83 hab24e00_0 conda-forge fontconfig 2.14.2 h14ed4e7_0 conda-forge fonts-conda-ecosystem 1 0 conda-forge fonts-conda-forge 1 0 conda-forge fonttools 4.39.4 py310h2372a71_0 conda-forge freetype 2.12.1 hca18f0e_1 conda-forge freexl 1.0.6 h166bdaf_1 conda-forge fsspec 2023.5.0 pyh1a96a4e_0 conda-forge gdal 3.6.2 py310hc1b7723_9 conda-forge geopandas 0.13.0 pyhd8ed1ab_0 conda-forge geopandas-base 0.13.0 pyha770c72_0 conda-forge geos 3.11.1 h27087fc_0 conda-forge geotiff 1.7.1 h7a142b4_6 conda-forge gettext 0.21.1 h27087fc_0 conda-forge giflib 5.2.1 h0b41bf4_3 conda-forge gitdb 4.0.10 pypi_0 pypi gitpython 3.1.31 pypi_0 pypi gmp 6.2.1 h58526e2_0 conda-forge gnutls 3.6.13 h85f3911_1 conda-forge greenlet 2.0.2 pypi_0 pypi gunicorn 20.1.0 pypi_0 pypi h11 0.14.0 pyhd8ed1ab_0 conda-forge hdf4 4.2.15 h9772cbc_5 conda-forge hdf5 1.12.2 nompi_h4df4325_101 conda-forge html5lib 1.1 pyh9f0ad1d_0 conda-forge huggingface_hub 0.14.1 pyhd8ed1ab_0 conda-forge hydra-colorlog 1.2.0 pypi_0 pypi hydra-core 1.3.2 pyhd8ed1ab_0 conda-forge hydra-optuna-sweeper 1.2.0 pypi_0 pypi icu 70.1 h27087fc_0 conda-forge idna 2.8 pypi_0 pypi imagecodecs 2023.1.23 py310ha3ed6a1_0 conda-forge imageio 2.28.1 pyh24c5eb1_0 conda-forge importlib-metadata 6.6.0 pypi_0 pypi importlib_resources 5.12.0 pyhd8ed1ab_0 conda-forge iniconfig 2.0.0 pyhd8ed1ab_0 conda-forge inquirer 3.1.3 pyhd8ed1ab_0 conda-forge intel-openmp 2023.1.0 hdb19cb5_46305 itsdangerous 2.1.2 pyhd8ed1ab_0 conda-forge jaraco.classes 3.2.3 pyhd8ed1ab_0 conda-forge jeepney 0.8.0 pyhd8ed1ab_0 conda-forge jinja2 3.1.2 pyhd8ed1ab_1 conda-forge joblib 1.2.0 pyhd8ed1ab_0 conda-forge jpeg 9e h0b41bf4_3 conda-forge json-c 0.16 hc379101_0 conda-forge jxrlib 1.1 h7f98852_2 conda-forge kealib 1.5.0 ha7026e8_0 conda-forge keyring 23.9.3 py310hff52083_1 conda-forge keyutils 1.6.1 h166bdaf_0 conda-forge kiwisolver 1.4.4 py310hbf28c38_1 conda-forge kornia 0.6.12 pyhd8ed1ab_0 conda-forge krb5 1.20.1 h81ceb04_0 conda-forge lame 3.100 h166bdaf_1003 conda-forge lazy_loader 0.2 pyhd8ed1ab_0 conda-forge lcms2 2.15 hfd0df8a_0 conda-forge ld_impl_linux-64 2.40 h41732ed_0 conda-forge lerc 4.0.0 h27087fc_0 conda-forge libaec 1.0.6 hcb278e6_1 conda-forge libavif 0.11.1 hff004cb_1 conda-forge libblas 3.9.0 1_h86c2bf4_netlib conda-forge libbrotlicommon 1.0.9 h166bdaf_8 conda-forge libbrotlidec 1.0.9 h166bdaf_8 conda-forge libbrotlienc 1.0.9 h166bdaf_8 conda-forge libcblas 3.9.0 5_h92ddd45_netlib conda-forge libcurl 8.1.2 h409715c_0 conda-forge libdeflate 1.17 h0b41bf4_0 conda-forge libedit 3.1.20191231 he28a2e2_2 conda-forge libev 4.33 h516909a_1 conda-forge libexpat 2.5.0 hcb278e6_1 conda-forge libffi 3.4.2 h7f98852_5 conda-forge libgcc-ng 12.2.0 h65d4601_19 conda-forge libgdal 3.6.2 h6c674c2_9 conda-forge libgfortran-ng 12.2.0 h69a702a_19 conda-forge libgfortran5 12.2.0 h337968e_19 conda-forge libglib 2.76.3 hebfc3b9_0 conda-forge libgomp 12.2.0 h65d4601_19 conda-forge libhwloc 2.9.1 hd6dc26d_0 conda-forge libiconv 1.17 h166bdaf_0 conda-forge libkml 1.3.0 h37653c0_1015 conda-forge liblapack 3.9.0 5_h92ddd45_netlib conda-forge libnetcdf 4.9.1 nompi_h34a3ff0_101 conda-forge libnghttp2 1.52.0 h61bc06f_0 conda-forge libnsl 2.0.0 h7f98852_0 conda-forge libpng 1.6.39 h753d276_0 conda-forge libpq 15.2 hb675445_0 conda-forge librttopo 1.1.0 ha49c73b_12 conda-forge libsodium 1.0.18 h36c2ea0_1 conda-forge libspatialindex 1.9.3 h9c3ff4c_4 conda-forge libspatialite 5.0.1 h221c8f1_23 conda-forge libsqlite 3.42.0 h2797004_0 conda-forge libssh2 1.10.0 hf14f497_3 conda-forge libstdcxx-ng 12.2.0 h46fd767_19 conda-forge libtiff 4.5.0 h6adf6a1_2 conda-forge libuuid 2.38.1 h0b41bf4_0 conda-forge libwebp-base 1.3.0 h0b41bf4_0 conda-forge libxcb 1.13 h7f98852_1004 conda-forge libxml2 2.10.3 hca2bb57_4 conda-forge libzip 1.9.2 hc929e4a_1 conda-forge libzlib 1.2.13 h166bdaf_4 conda-forge libzopfli 1.0.3 h9c3ff4c_0 conda-forge lightning 2.0.2 pyhd8ed1ab_0 conda-forge lightning-cloud 0.5.36 pyhd8ed1ab_0 conda-forge lightning-utilities 0.8.0 pyhd8ed1ab_0 conda-forge locket 1.0.0 pyhd8ed1ab_0 conda-forge lockfile 0.12.2 py_1 conda-forge lz4-c 1.9.4 hcb278e6_0 conda-forge mako 1.2.4 pypi_0 pypi mapclassify 2.5.0 pyhd8ed1ab_1 conda-forge markdown 3.4.3 pypi_0 pypi markdown-it-py 2.2.0 pyhd8ed1ab_0 conda-forge markupsafe 2.1.2 py310h1fa729e_0 conda-forge matplotlib-base 3.7.1 py310he60537e_0 conda-forge mdurl 0.1.0 pyhd8ed1ab_0 conda-forge mkl 2023.1.0 h6d00ec8_46342 mlflow 2.3.2 pypi_0 pypi more-itertools 9.1.0 pyhd8ed1ab_0 conda-forge morecantile 4.0.2 pypi_0 pypi msgpack-python 1.0.5 py310hdf3cbec_0 conda-forge munch 3.0.0 pyhd8ed1ab_0 conda-forge munkres 1.1.4 pyh9f0ad1d_0 conda-forge ncurses 6.3 h27087fc_1 conda-forge nettle 3.6 he412f7d_0 conda-forge networkx 3.1 pyhd8ed1ab_0 conda-forge nspr 4.35 h27087fc_0 conda-forge nss 3.89 he45b914_0 conda-forge numpy 1.24.3 py310ha4c1d20_0 conda-forge oauthlib 3.2.2 pypi_0 pypi omegaconf 2.3.0 pyhd8ed1ab_0 conda-forge opencv-python 4.7.0.72 pypi_0 pypi openh264 2.1.1 h780b84a_0 conda-forge openjpeg 2.5.0 hfec8fc6_2 conda-forge openssl 3.1.1 hd590300_1 conda-forge optuna 2.10.1 pypi_0 pypi ordered-set 4.1.0 pyhd8ed1ab_0 conda-forge orjson 3.8.14 py310h1e2579a_0 conda-forge packaging 20.9 pyh44b312d_0 conda-forge pandas 2.0.2 py310h7cbd5c2_0 conda-forge paramiko 3.2.0 pyhd8ed1ab_0 conda-forge partd 1.4.0 pyhd8ed1ab_0 conda-forge pastel 0.2.1 pyhd8ed1ab_0 conda-forge pbr 5.11.1 pypi_0 pypi pcre2 10.40 hc3806b6_0 conda-forge pexpect 4.8.0 pyh1a96a4e_2 conda-forge pillow 9.4.0 py310h023d228_1 conda-forge pip 23.1.2 pyhd8ed1ab_0 conda-forge pixman 0.40.0 h36c2ea0_0 conda-forge pkginfo 1.9.6 pyhd8ed1ab_0 conda-forge platformdirs 3.5.1 pyhd8ed1ab_0 conda-forge pluggy 1.0.0 pyhd8ed1ab_5 conda-forge poetry 1.1.15 pyhd8ed1ab_1 conda-forge poetry-core 1.0.8 py310hff52083_1 conda-forge pooch 1.7.0 pyha770c72_3 conda-forge poppler 23.03.0 h091648b_0 conda-forge poppler-data 0.4.12 hd8ed1ab_0 conda-forge postgresql 15.2 h3248436_0 conda-forge pretrainedmodels 0.7.4 pyhd8ed1ab_2 conda-forge prettytable 3.7.0 pypi_0 pypi proj 9.1.1 h8ffa02c_2 conda-forge protobuf 4.23.2 pypi_0 pypi psutil 5.9.5 py310h1fa729e_0 conda-forge pthread-stubs 0.4 h36c2ea0_1001 conda-forge ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge pyarrow 11.0.0 pypi_0 pypi pycparser 2.21 pyhd8ed1ab_0 conda-forge pydantic 1.10.8 py310h2372a71_0 conda-forge pygments 2.15.1 pyhd8ed1ab_0 conda-forge pyjwt 2.7.0 pyhd8ed1ab_0 conda-forge pylev 1.4.0 pyhd8ed1ab_0 conda-forge pynacl 1.5.0 py310h5764c6d_2 conda-forge pynvml 11.5.0 pyhd8ed1ab_0 conda-forge pyparsing 3.0.9 pyhd8ed1ab_0 conda-forge pyperclip 1.8.2 pypi_0 pypi pyproj 3.5.0 py310h15e2413_0 conda-forge pysocks 1.7.1 pyha2e5f31_6 conda-forge pystac 1.7.3 pyhd8ed1ab_0 conda-forge pytest 7.3.1 pyhd8ed1ab_0 conda-forge python 3.10.11 he550d4f_0_cpython conda-forge python-dateutil 2.8.2 pyhd8ed1ab_0 conda-forge python-editor 1.0.4 py_0 conda-forge python-multipart 0.0.6 pyhd8ed1ab_0 conda-forge python-tzdata 2023.3 pyhd8ed1ab_0 conda-forge python_abi 3.10 3_cp310 conda-forge pytorch 1.12.0 py3.10_cuda11.6_cudnn8.3.2_0 pytorch pytorch-lightning 2.0.2 pyhd8ed1ab_0 conda-forge pytorch-mutex 1.0 cuda pytorch pytz 2023.3 pyhd8ed1ab_0 conda-forge pywavelets 1.4.1 py310h0a54255_0 conda-forge pywin32-on-windows 0.1.0 pyh1179c8e_3 conda-forge pyyaml 6.0 py310h5764c6d_5 conda-forge querystring-parser 1.2.4 pypi_0 pypi rasterio 1.3.6 py310h3e853a9_0 conda-forge readchar 4.0.5 pyhd8ed1ab_0 conda-forge readline 8.2 h8228510_1 conda-forge requests 2.22.0 pypi_0 pypi requests-toolbelt 0.9.1 py_0 conda-forge rich 13.4.1 pyhd8ed1ab_0 conda-forge rio-cogeo 4.0.0 pypi_0 pypi rtree 1.0.1 py310hbdcdc62_1 conda-forge ruamel_yaml 0.15.80 py310h5764c6d_1008 conda-forge scikit-image 0.20.0 py310h9b08913_1 conda-forge scikit-learn 1.2.2 py310hf7d194e_2 conda-forge scipy 1.10.1 py310ha4c1d20_3 conda-forge secretstorage 3.3.3 py310hff52083_1 conda-forge segmentation-models-pytorch 0.3.2 pyhd8ed1ab_0 conda-forge setuptools 67.7.2 pyhd8ed1ab_0 conda-forge shapely 2.0.1 py310h8b84c32_0 conda-forge shellingham 1.5.1 pyhd8ed1ab_0 conda-forge six 1.16.0 pyh6c4a22f_0 conda-forge smmap 5.0.0 pypi_0 pypi snappy 1.1.10 h9fff704_0 conda-forge sniffio 1.3.0 pyhd8ed1ab_0 conda-forge snuggs 1.4.7 py_0 conda-forge solaris 0.0.1 pypi_0 pypi soupsieve 2.3.2.post1 pyhd8ed1ab_0 conda-forge sqlalchemy 2.0.15 pypi_0 pypi sqlite 3.42.0 h2c6b66d_0 conda-forge sqlparse 0.4.4 pypi_0 pypi starlette 0.22.0 pyhd8ed1ab_0 conda-forge starsessions 1.3.0 pyhd8ed1ab_0 conda-forge stevedore 5.1.0 pypi_0 pypi tabulate 0.9.0 pypi_0 pypi tbb 2021.9.0 hf52228f_0 conda-forge threadpoolctl 3.1.0 pyh8a188c0_0 conda-forge tifffile 2023.4.12 pyhd8ed1ab_0 conda-forge tiledb 2.13.2 hd532e3d_0 conda-forge timm 0.6.12 pyhd8ed1ab_0 conda-forge tk 8.6.12 h27826a3_0 conda-forge tomli 2.0.1 pyhd8ed1ab_0 conda-forge tomlkit 0.11.8 pyha770c72_0 conda-forge toolz 0.12.0 pyhd8ed1ab_0 conda-forge torchgeo 0.4.1 pyhd8ed1ab_0 conda-forge torchmetrics 0.11.4 pyhd8ed1ab_0 conda-forge torchvision 0.13.0 py310_cu116 pytorch tqdm 4.65.0 pyhd8ed1ab_1 conda-forge traitlets 5.9.0 pyhd8ed1ab_0 conda-forge ttach 0.0.3 pypi_0 pypi typing-extensions 4.6.2 hd8ed1ab_0 conda-forge typing_extensions 4.6.2 pyha770c72_0 conda-forge tzcode 2023c h0b41bf4_0 conda-forge tzdata 2023c h71feb2d_0 conda-forge unicodedata2 15.0.0 py310h5764c6d_0 conda-forge urllib3 1.25.11 pypi_0 pypi uvicorn 0.22.0 py310hff52083_0 conda-forge virtualenv 20.23.0 pyhd8ed1ab_0 conda-forge wcwidth 0.2.6 pyhd8ed1ab_0 conda-forge webencodings 0.5.1 py_1 conda-forge websocket-client 1.5.2 pyhd8ed1ab_0 conda-forge websockets 11.0.3 py310h2372a71_0 conda-forge werkzeug 2.3.4 pypi_0 pypi wheel 0.40.0 pyhd8ed1ab_0 conda-forge xerces-c 3.2.4 h55805fa_1 conda-forge xorg-kbproto 1.0.7 h7f98852_1002 conda-forge xorg-libice 1.1.1 hd590300_0 conda-forge xorg-libsm 1.2.4 h7391055_0 conda-forge xorg-libx11 1.8.4 h0b41bf4_0 conda-forge xorg-libxau 1.0.11 hd590300_0 conda-forge xorg-libxdmcp 1.1.3 h7f98852_0 conda-forge xorg-libxext 1.3.4 h0b41bf4_2 conda-forge xorg-libxrender 0.9.10 h7f98852_1003 conda-forge xorg-renderproto 0.11.1 h7f98852_1002 conda-forge xorg-xextproto 7.3.0 h0b41bf4_1003 conda-forge xorg-xproto 7.0.31 h7f98852_1007 conda-forge xyzservices 2023.5.0 pyhd8ed1ab_1 conda-forge xz 5.2.6 h166bdaf_0 conda-forge yaml 0.2.5 h7f98852_2 conda-forge zfp 1.0.0 h27087fc_3 conda-forge zipp 3.15.0 pyhd8ed1ab_0 conda-forge zlib 1.2.13 h166bdaf_4 conda-forge zlib-ng 2.0.7 h0b41bf4_0 conda-forge zstd 1.5.2 h3eb15da_6 conda-forge
closed with PR #531
remtav
commented
1 year ago
Describe the bug CI for all new PRs has failed (most probably) due to a change in one of our library versions. https://github.com/NRCan/geo-deep-learning/pulls To make sure the cause is not on our side, I reran a CI pipeline from PR #518 (https://github.com/NRCan/geo-deep-learning/pull/518) It had passed on May 18th: https://github.com/NRCan/geo-deep-learning/actions/runs/5015264810/attempts/1 But not May 31st: https://github.com/NRCan/geo-deep-learning/actions/runs/5015264810/jobs/9244379169?pr=518
To Reproduce Steps to reproduce the behavior:
Expected behavior Environment should create succesfully with torch-gpu if running on gpu mahcine, or torch-cpu otherwise. Tests with mamba have succeeded by replacing:
conda env create --file /geo-deep-learning/environment.ymlwithScreenshots Env created with mamba (for future reference):