conda / conda-lock

Lightweight lockfile for conda environments
https://conda.github.io/conda-lock/
Other
459 stars 102 forks source link

Failing with KeyError: 'openssl<1.1.2a' #417

Open amangup opened 1 year ago

amangup commented 1 year ago

Checklist

What happened?

I ran conda-lock -f environment.yml -p linux-64 and it failed with the following error:

Traceback (most recent call last):
  File "/home/aman/.local/pipx/venvs/conda-lock/lib/python3.11/site-packages/conda_lock/src_parser/__init__.py", line 488, in seperator_munge_get
    return d[key]
           ~^^^^^
KeyError: 'openssl<1.1.2a'

Conda Info

active environment : ai-search
    active env location : /home/aman/anaconda3/envs/ai-search
            shell level : 1
       user config file : /home/aman/.condarc
 populated config files : /home/aman/.condarc
          conda version : 23.3.1
    conda-build version : 3.24.0
         python version : 3.10.9.final.0
       virtual packages : __archspec=1=x86_64
                          __cuda=12.0=0
                          __glibc=2.37=0
                          __linux=6.2.0=0
                          __unix=0=0
       base environment : /home/aman/anaconda3  (writable)
      conda av data dir : /home/aman/anaconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/aman/anaconda3/pkgs
                          /home/aman/.conda/pkgs
       envs directories : /home/aman/anaconda3/envs
                          /home/aman/.conda/envs
               platform : linux-64
             user-agent : conda/23.3.1 requests/2.28.2 CPython/3.10.9 Linux/6.2.0-20-generic ubuntu/23.04 glibc/2.37
                UID:GID : 1000:1000
             netrc file : /home/aman/.netrc
           offline mode : False

Conda Config

==> /home/aman/.condarc <==
auto_activate_base: False
channel_priority: disabled

Conda list

# packages in environment at /home/aman/anaconda3/envs/ai-search:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main    defaults
_openmp_mutex             5.1                       1_gnu    defaults
accelerate                0.19.0             pyhd8ed1ab_0    conda-forge
aiohttp                   3.8.3            py39h5eee18b_0    defaults
aiosignal                 1.2.0              pyhd3eb1b0_0    defaults
alembic                   1.10.4             pyhd8ed1ab_0    conda-forge
anyio                     3.5.0            py39h06a4308_0    defaults
argon2-cffi               21.3.0             pyhd3eb1b0_0    defaults
argon2-cffi-bindings      21.2.0           py39h7f8727e_0    defaults
asttokens                 2.0.5              pyhd3eb1b0_0    defaults
async-timeout             4.0.2            py39h06a4308_0    defaults
attrs                     22.1.0           py39h06a4308_0    defaults
babel                     2.11.0           py39h06a4308_0    defaults
backcall                  0.2.0              pyhd3eb1b0_0    defaults
beautifulsoup4            4.12.2           py39h06a4308_0    defaults
blas                      1.0                         mkl    defaults
bleach                    4.1.0              pyhd3eb1b0_0    defaults
boto3                     1.24.28          py39h06a4308_0    anaconda
botocore                  1.27.59          py39h06a4308_0    defaults
bottleneck                1.3.5            py39h7deecbd_0    defaults
brotli                    1.0.9                h5eee18b_7    defaults
brotli-bin                1.0.9                h5eee18b_7    defaults
brotlipy                  0.7.0           py39h27cfd23_1003    defaults
bzip2                     1.0.8                h7b6447c_0    defaults
ca-certificates           2023.5.7             hbcca054_0    conda-forge
certifi                   2023.5.7         py39h06a4308_0    defaults
cffi                      1.15.1           py39h5eee18b_3    defaults
charset-normalizer        2.0.4              pyhd3eb1b0_0    defaults
click                     8.1.3           unix_pyhd8ed1ab_2    conda-forge
cmaes                     0.9.1              pyhd8ed1ab_0    conda-forge
colorama                  0.4.6            py39h06a4308_0    defaults
coloredlogs               15.0.1                   pypi_0    pypi
colorlog                  5.0.1            py39h06a4308_1    defaults
comm                      0.1.2            py39h06a4308_0    defaults
contentful                2.1.1                    pypi_0    pypi
contourpy                 1.0.5            py39hdb19cb5_0    defaults
cryptography              39.0.1           py39h9ce1e76_0    defaults
cuda-command-line-tools   11.8.0                        0    nvidia
cuda-compiler             12.1.1                        0    nvidia/label/cuda-12.1.1
cuda-cudart               11.8.89                       0    nvidia
cuda-cuobjdump            12.1.111                      0    nvidia/label/cuda-12.1.1
cuda-cupti                11.8.87                       0    nvidia
cuda-cuxxfilt             12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-gdb                  12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-libraries            11.8.0                        0    nvidia
cuda-libraries-dev        11.3.0               h3b286be_0    nvidia
cuda-memcheck             11.8.86                       0    nvidia
cuda-nvcc                 12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvdisasm             12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvml-dev             12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvprof               12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvprune              12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvrtc                11.8.89                       0    nvidia
cuda-nvtx                 11.8.86                       0    nvidia
cuda-nvvp                 12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-runtime              11.8.0                        0    nvidia
cuda-samples              11.6.101             h8efea70_0    nvidia
cuda-sanitizer-api        12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-thrust               11.4.43              h00096a5_0    nvidia
cuda-toolkit              11.3.0               h3b286be_0    nvidia
cuda-tools                11.3.0               h3b286be_0    nvidia
cuda-visual-tools         11.3.0               h3b286be_0    nvidia
cudatoolkit               11.3.1               h2bc3f7f_2    defaults
cycler                    0.11.0             pyhd3eb1b0_0    defaults
datasets                  2.12.0                   pypi_0    pypi
dbus                      1.13.18              hb2f20db_0    defaults
debugpy                   1.5.1            py39h295c915_0    defaults
decorator                 5.1.1              pyhd3eb1b0_0    defaults
defusedxml                0.7.1              pyhd3eb1b0_0    defaults
dill                      0.3.6                    pypi_0    pypi
entrypoints               0.4              py39h06a4308_0    defaults
et_xmlfile                1.1.0            py39h06a4308_0    defaults
executing                 0.8.3              pyhd3eb1b0_0    defaults
expat                     2.4.9                h6a678d5_0    defaults
faiss-gpu                 1.7.3           py3.9_h28a55e0_0_cuda11.3    pytorch
fastapi                   0.95.1             pyhd8ed1ab_0    conda-forge
ffmpeg                    4.3                  hf484d3e_0    pytorch
filelock                  3.12.0             pyhd8ed1ab_0    conda-forge
fontconfig                2.14.1               h4c34cd2_2    defaults
fonttools                 4.25.0             pyhd3eb1b0_0    defaults
freetype                  2.12.1               h4a9f257_0    defaults
frozenlist                1.3.3            py39h5eee18b_0    defaults
fsspec                    2023.5.0                 pypi_0    pypi
giflib                    5.2.1                h5eee18b_3    defaults
glib                      2.69.1               he621ea3_2    defaults
gmp                       6.2.1                h295c915_3    defaults
gmpy2                     2.1.2            py39heeb90bb_0    defaults
gnutls                    3.6.15               he1e5248_0    defaults
greenlet                  2.0.1            py39h6a678d5_0    defaults
gst-plugins-base          1.14.1               h6a678d5_1    defaults
gstreamer                 1.14.1               h5eee18b_1    defaults
h11                       0.14.0             pyhd8ed1ab_0    conda-forge
huggingface-hub           0.14.1                   pypi_0    pypi
humanfriendly             10.0                     pypi_0    pypi
icu                       58.2                 he6710b0_3    defaults
idna                      3.4              py39h06a4308_0    defaults
importlib-metadata        6.6.0              pyha770c72_0    conda-forge
importlib_resources       5.2.0              pyhd3eb1b0_1    defaults
intel-openmp              2023.1.0         hdb19cb5_46305    defaults
ipykernel                 6.19.2           py39hb070fc8_0    defaults
ipython                   8.12.0           py39h06a4308_0    defaults
ipython_genutils          0.2.0              pyhd3eb1b0_1    defaults
ipywidgets                8.0.4            py39h06a4308_0    defaults
jedi                      0.18.1           py39h06a4308_1    defaults
jinja2                    3.1.2            py39h06a4308_0    defaults
jmespath                  0.10.0             pyhd3eb1b0_0    defaults
joblib                    1.2.0              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   h5eee18b_1    defaults
json5                     0.9.6              pyhd3eb1b0_0    defaults
jsonschema                4.17.3           py39h06a4308_0    defaults
jupyter                   1.0.0            py39h06a4308_8    defaults
jupyter_client            7.4.9            py39h06a4308_0    defaults
jupyter_console           6.6.3            py39h06a4308_0    defaults
jupyter_core              5.3.0            py39h06a4308_0    defaults
jupyter_server            1.23.4           py39h06a4308_0    defaults
jupyterlab                3.5.3            py39h06a4308_0    defaults
jupyterlab_pygments       0.1.2                      py_0    defaults
jupyterlab_server         2.22.0           py39h06a4308_0    defaults
jupyterlab_widgets        3.0.5            py39h06a4308_0    defaults
kiwisolver                1.4.4            py39h6a678d5_0    defaults
krb5                      1.19.4               h568e23c_0    defaults
lame                      3.100                h7b6447c_0    defaults
lcms2                     2.12                 h3be6417_0    defaults
ld_impl_linux-64          2.38                 h1181459_1    defaults
lerc                      3.0                  h295c915_0    defaults
libbrotlicommon           1.0.9                h5eee18b_7    defaults
libbrotlidec              1.0.9                h5eee18b_7    defaults
libbrotlienc              1.0.9                h5eee18b_7    defaults
libclang                  14.0.6          default_hc6dbbc7_1    defaults
libclang13                14.0.6          default_he11475f_1    defaults
libcublas                 11.11.3.6                     0    nvidia
libcufft                  10.9.0.58                     0    nvidia
libcufile                 1.6.1.9                       0    nvidia/label/cuda-12.1.1
libcurand                 10.3.2.106                    0    nvidia/label/cuda-12.1.1
libcusolver               11.4.1.48                     0    nvidia
libcusparse               11.7.5.86                     0    nvidia
libdeflate                1.17                 h5eee18b_0    defaults
libedit                   3.1.20221030         h5eee18b_0    defaults
libevent                  2.1.12               h8f2d780_0    defaults
libfaiss                  1.7.3           hfc2d529_0_cuda11.3    pytorch
libffi                    3.4.4                h6a678d5_0    defaults
libgcc-ng                 11.2.0               h1234567_1    defaults
libgfortran-ng            12.2.0              h69a702a_19    conda-forge
libgfortran5              12.2.0              h337968e_19    conda-forge
libgomp                   11.2.0               h1234567_1    defaults
libiconv                  1.16                 h7f8727e_2    defaults
libidn2                   2.3.4                h5eee18b_0    defaults
libllvm14                 14.0.6               hdb19cb5_3    defaults
libnpp                    11.8.0.86                     0    nvidia
libnvjpeg                 11.9.0.86                     0    nvidia
libpng                    1.6.39               h5eee18b_0    defaults
libpq                     12.9                 h16c4e8d_3    defaults
libsodium                 1.0.18               h7b6447c_0    defaults
libstdcxx-ng              11.2.0               h1234567_1    defaults
libtasn1                  4.19.0               h5eee18b_0    defaults
libtiff                   4.5.0                h6a678d5_2    defaults
libunistring              0.9.10               h27cfd23_0    defaults
libuuid                   1.41.5               h5eee18b_0    defaults
libwebp                   1.2.4                h11a3e52_1    defaults
libwebp-base              1.2.4                h5eee18b_1    defaults
libxcb                    1.15                 h7f8727e_0    defaults
libxkbcommon              1.0.1                h5eee18b_1    defaults
libxml2                   2.10.3               hcbfbd50_0    defaults
libxslt                   1.1.37               h2085143_0    defaults
lxml                      4.9.2            py39h5eee18b_0    defaults
lz4-c                     1.9.4                h6a678d5_0    defaults
mako                      1.2.4              pyhd8ed1ab_0    conda-forge
markdown                  3.4.1            py39h06a4308_0    defaults
markupsafe                2.1.1            py39h7f8727e_0    defaults
matplotlib-base           3.7.1            py39h417a72b_1    defaults
matplotlib-inline         0.1.6            py39h06a4308_0    defaults
mistune                   0.8.4           py39h27cfd23_1000    defaults
mkl                       2023.1.0         h6d00ec8_46342    defaults
mkl-service               2.4.0            py39h5eee18b_1    defaults
mkl_fft                   1.3.6            py39h417a72b_1    defaults
mkl_random                1.2.2            py39h417a72b_1    defaults
mpc                       1.1.0                h10f8cd9_1    defaults
mpfr                      4.0.2                hb69a4c5_1    defaults
mpmath                    1.2.1            py39h06a4308_0    defaults
multidict                 6.0.2            py39h5eee18b_0    defaults
multiprocess              0.70.14                  pypi_0    pypi
munkres                   1.1.4                      py_0    defaults
nbclassic                 0.5.5            py39h06a4308_0    defaults
nbclient                  0.5.13           py39h06a4308_0    defaults
nbconvert                 6.5.4            py39h06a4308_0    defaults
nbformat                  5.7.0            py39h06a4308_0    defaults
ncurses                   6.4                  h6a678d5_0    defaults
nest-asyncio              1.5.6            py39h06a4308_0    defaults
nettle                    3.7.3                hbbd107a_1    defaults
networkx                  2.8.4            py39h06a4308_1    defaults
notebook                  6.5.4            py39h06a4308_0    defaults
notebook-shim             0.2.2            py39h06a4308_0    defaults
nspr                      4.33                 h295c915_0    defaults
nss                       3.74                 h0370c37_0    defaults
numexpr                   2.8.4            py39hc78ab66_1    defaults
numpy                     1.24.3           py39hf6e8229_1    defaults
numpy-base                1.24.3           py39h060ed82_1    defaults
openai                    0.27.4           py39h06a4308_0    defaults
openh264                  2.1.1                h4ff587b_0    defaults
openpyxl                  3.0.10           py39h5eee18b_0    defaults
openssl                   1.1.1t               h7f8727e_0    defaults
optimum                   1.8.6                    pypi_0    pypi
optuna                    3.1.1              pyhd8ed1ab_0    conda-forge
packaging                 23.1               pyhd8ed1ab_0    conda-forge
pandas                    1.5.3            py39h417a72b_0    defaults
pandas-stubs              1.5.3.230203     py39h06a4308_0    defaults
pandocfilters             1.5.0              pyhd3eb1b0_0    defaults
parso                     0.8.3              pyhd3eb1b0_0    defaults
pcre                      8.45                 h295c915_0    defaults
pexpect                   4.8.0              pyhd3eb1b0_3    defaults
pickleshare               0.7.5           pyhd3eb1b0_1003    defaults
pillow                    9.4.0            py39h6a678d5_0    defaults
pip                       23.0.1           py39h06a4308_0    defaults
platformdirs              3.5.0              pyhd8ed1ab_0    conda-forge
plotly                    5.9.0            py39h06a4308_0    defaults
ply                       3.11             py39h06a4308_0    defaults
pooch                     1.7.0              pyha770c72_3    conda-forge
prometheus_client         0.14.1           py39h06a4308_0    defaults
prompt-toolkit            3.0.36           py39h06a4308_0    defaults
prompt_toolkit            3.0.36               hd3eb1b0_0    defaults
protobuf                  3.20.2                   pypi_0    pypi
psutil                    5.9.0            py39h5eee18b_0    defaults
ptyprocess                0.7.0              pyhd3eb1b0_2    defaults
pure_eval                 0.2.2              pyhd3eb1b0_0    defaults
pyarrow                   12.0.0                   pypi_0    pypi
pycparser                 2.21               pyhd3eb1b0_0    defaults
pydantic                  1.10.2           py39h5eee18b_0    defaults
pygments                  2.15.1           py39h06a4308_1    defaults
pynvml                    11.5.0             pyhd8ed1ab_0    conda-forge
pyopenssl                 23.1.1             pyhd8ed1ab_0    conda-forge
pyparsing                 3.0.9            py39h06a4308_0    defaults
pyqt                      5.15.7           py39h6a678d5_1    defaults
pyqt5-sip                 12.11.0          py39h6a678d5_1    defaults
pyrsistent                0.18.0           py39heee7806_0    defaults
pysocks                   1.7.1            py39h06a4308_0    defaults
python                    3.9.16               h7a1cb2a_2    defaults
python-dateutil           2.8.2              pyhd3eb1b0_0    defaults
python-dotenv             0.21.0           py39h06a4308_0    defaults
python-fastjsonschema     2.16.2           py39h06a4308_0    defaults
python_abi                3.9                      2_cp39    conda-forge
pytorch                   2.0.0           py3.9_cuda11.8_cudnn8.7.0_0    pytorch
pytorch-cuda              11.8                 h7e8668a_3    pytorch
pytorch-mutex             1.0                        cuda    pytorch
pytz                      2022.7           py39h06a4308_0    defaults
pyyaml                    6.0              py39h5eee18b_1    defaults
pyzmq                     25.0.2           py39h6a678d5_0    defaults
qt-main                   5.15.2               h8373d8f_8    defaults
qt-webengine              5.15.9               hbbf29b9_6    defaults
qtconsole                 5.4.2            py39h06a4308_0    defaults
qtpy                      2.2.0            py39h06a4308_0    defaults
qtwebkit                  5.212                h3fafdc1_5    defaults
readline                  8.2                  h5eee18b_0    defaults
regex                     2023.5.5                 pypi_0    pypi
requests                  2.29.0           py39h06a4308_0    defaults
responses                 0.18.0                   pypi_0    pypi
s3transfer                0.6.0            py39h06a4308_0    defaults
scikit-learn              1.2.2            py39h6a678d5_0    defaults
scipy                     1.10.1           py39hf6e8229_1    defaults
send2trash                1.8.0              pyhd3eb1b0_1    defaults
setuptools                66.0.0           py39h06a4308_0    defaults
sip                       6.6.2            py39h6a678d5_0    defaults
six                       1.16.0             pyhd3eb1b0_1    defaults
sniffio                   1.2.0            py39h06a4308_1    defaults
soupsieve                 2.4              py39h06a4308_0    defaults
sqlalchemy                1.4.39           py39h5eee18b_0    defaults
sqlite                    3.41.2               h5eee18b_0    defaults
stack_data                0.2.0              pyhd3eb1b0_0    defaults
starlette                 0.26.1             pyhd8ed1ab_0    conda-forge
sympy                     1.11.1           py39h06a4308_0    defaults
tbb                       2021.8.0             hdb19cb5_0    defaults
tenacity                  8.2.2            py39h06a4308_0    defaults
terminado                 0.17.1           py39h06a4308_0    defaults
threadpoolctl             3.1.0              pyh8a188c0_0    conda-forge
tinycss2                  1.2.1            py39h06a4308_0    defaults
tk                        8.6.12               h1ccaba5_0    defaults
tokenizers                0.13.3                   pypi_0    pypi
toml                      0.10.2             pyhd3eb1b0_0    defaults
tomli                     2.0.1            py39h06a4308_0    defaults
torchaudio                2.0.0                py39_cu118    pytorch
torchtriton               2.0.0                      py39    pytorch
torchvision               0.15.0               py39_cu118    pytorch
tornado                   6.2              py39h5eee18b_0    defaults
tqdm                      4.65.0           py39hb070fc8_0    defaults
traitlets                 5.7.1            py39h06a4308_0    defaults
transformers              4.29.2                   pypi_0    pypi
types-pytz                2022.4.0.0       py39h06a4308_1    defaults
typing-extensions         4.5.0            py39h06a4308_0    defaults
typing_extensions         4.5.0            py39h06a4308_0    defaults
tzdata                    2023c                h04d1e81_0    defaults
urllib3                   1.26.15          py39h06a4308_0    defaults
uvicorn                   0.22.0           py39hf3d152e_0    conda-forge
wcwidth                   0.2.5              pyhd3eb1b0_0    defaults
webencodings              0.5.1            py39h06a4308_1    defaults
websocket-client          0.58.0           py39h06a4308_4    defaults
wheel                     0.38.4           py39h06a4308_0    defaults
widgetsnbextension        4.0.5            py39h06a4308_0    defaults
xxhash                    3.2.0                    pypi_0    pypi
xz                        5.4.2                h5eee18b_0    defaults
yaml                      0.2.5                h7b6447c_0    defaults
yarl                      1.8.1            py39h5eee18b_0    defaults
zeromq                    4.3.4                h2531618_0    defaults
zipp                      3.15.0             pyhd8ed1ab_0    conda-forge
zlib                      1.2.13               h5eee18b_0    defaults
zstd                      1.5.5                hc292b87_0    defaults

Additional Context

No response

maresb commented 1 year ago

Hi, thanks for the report. Could you please try the main branch of conda-lock and check if that fixes your issue?

Assuming you installed via pipx, you can install it with

pipx install --force git+https://github.com/conda/conda-lock@01e9529

where 01e9529 is the current SHA of main.

If you installed it in the current Conda environment or venv, then you can install it with

pip install git+https://github.com/conda/conda-lock@01e9529
nlipsyc commented 1 year ago

@maresb I was facing the same issue but using conda-lock at that commit fixed it.