conda environment file fails

[juancq]

When attempting installation of requisite packages (conda env create -n ${ENV_NAME} -f env_cpu.yml), a large portion of the packages (30+) are listed under ResolvePackageNotFound. This is under windows.

[mmcdermott]

Hi @juancq -- I've never tried to install this on windows, so it is possible that some packages don't exist. That being said, I'm surprised at the magnitude of the reported failures. Can you post a copy or screenshot of the command you're running and exact error you're getting, to help debug? I'll also try to set up an install on windows to see if I can figure it out as well. Additionally, can you provide the exact versions of the OS and software you're using to attempt the install?

[juancq]

@mmcdermott here is the output using the original environment file:

(base) H:\pyscripts\EventStreamGPT>conda env create -n helloworld -f env_cpu_original.yml python=3.10
Collecting package metadata (repodata.json): done
Solving environment: failed

ResolvePackageNotFound:
  - grpc-cpp==1.46.1=h33aed49_1
  - debugpy==1.5.1=py310h295c915_0
  - orc==1.7.4=hb3bc3d3_1
  - gstreamer==1.14.1=h5eee18b_1
  - prometheus_client==0.14.1=py310h06a4308_0
  - attrs==22.1.0=py310h06a4308_0
  - libopus==1.3.1=h7b6447c_0
  - huggingface_hub==0.10.1=py310h06a4308_0
  - pytz==2022.7=py310h06a4308_0
  - libgcc-ng==12.2.0=h65d4601_19
  - sqlite==3.41.1=h5eee18b_0
  - mistune==0.8.4=py310h7f8727e_1000
  - setproctitle==1.2.2=py310h7f8727e_0
  - lz4-c==1.9.4=h6a678d5_0
  - libxml2==2.10.3=hcbfbd50_0
  - comm==0.1.2=py310h06a4308_0
  - nbformat==5.7.0=py310h06a4308_0
  - jupyter_client==8.1.0=py310h06a4308_0
  - libnghttp2==1.46.0=hce63b2e_0
  - snappy==1.1.9=h295c915_0
  - websocket-client==0.58.0=py310h06a4308_4
  - xz==5.2.10=h5eee18b_1
  - c-ares==1.19.0=h5eee18b_0
  - jpeg==9e=h5eee18b_1
  - libbrotlidec==1.0.9=h5eee18b_7
  - scikit-learn==1.2.1=py310h6a678d5_0
  - cryptography==39.0.1=py310h9ce1e76_0
  - aws-checksums==0.1.9=he6710b0_0
  - ipywidgets==8.0.4=py310h06a4308_0
  - pandas==1.5.3=py310h1128e8f_0
  - numpy-base==1.22.3=py310h9585f30_0
  - expat==2.4.9=h6a678d5_0
  - libbrotlicommon==1.0.9=h5eee18b_7
  - x264==1!157.20191217=h7b6447c_0
  - polars==0.17.9=py310hcb5633a_0
  - qtconsole==5.4.0=py310h06a4308_0
  - ca-certificates==2023.01.10=h06a4308_0
  - uvicorn==0.21.1=py310hff52083_0
  - libpng==1.6.39=h5eee18b_0
  - matplotlib-inline==0.1.6=py310h06a4308_0
  - orjson==3.8.10=py310h38b9cce_0
  - libvpx==1.7.0=h439df22_0
  - nspr==4.33=h295c915_0
  - jsonschema==4.17.3=py310h06a4308_0
  - libstdcxx-ng==11.2.0=h1234567_1
  - zlib==1.2.13=h5eee18b_0
  - arrow-cpp==10.0.1=py310h7516544_0
  - ipython==8.12.0=py310h06a4308_0
  - python-xxhash==2.0.2=py310h5eee18b_1
  - certifi==2023.5.7=py310h06a4308_0
  - re2==2022.04.01=h295c915_0
  - bzip2==1.0.8=h7b6447c_0
  - gnutls==3.6.15=he1e5248_0
  - aws-c-common==0.4.57=he6710b0_1
  - rapidfuzz==2.13.7=py310h1128e8f_0
  - _libgcc_mutex==0.1=conda_forge
  - pcre==8.45=h295c915_0
  - utf8proc==2.6.1=h27cfd23_0
  - libtiff==4.5.0=h6a678d5_2
  - libpq==12.9=h16c4e8d_3
  - dal==2023.0.1=hdb19cb5_26647
  - typing-extensions==4.4.0=py310h06a4308_0
  - numpy==1.22.3=py310hfa59a62_0
  - pyrsistent==0.18.0=py310h7f8727e_0
  - abseil-cpp==20211102.0=hd4dd3e8_0
  - zstd==1.5.4=hc292b87_0
  - pyflakes==3.0.1=py310h06a4308_0
  - brotlipy==0.7.0=py310h7f8727e_1002
  - bottleneck==1.3.5=py310ha9d4c09_0
  - pyopenssl==23.0.0=py310h06a4308_0
  - libbrotlienc==1.0.9=h5eee18b_7
  - giflib==5.2.1=h5eee18b_3
  - tinycss2==1.2.1=py310h06a4308_0
  - dill==0.3.6=py310h06a4308_0
  - matplotlib-base==3.7.0=py310h1128e8f_0
  - soupsieve==2.4=py310h06a4308_0
  - websockets==11.0=py310h1fa729e_0
  - datasets==2.10.1=py310h06a4308_0
  - libgfortran4==7.5.0=ha8ba4b0_17
  - qtpy==2.2.0=py310h06a4308_0
  - libedit==3.1.20221030=h5eee18b_0
  - mkl==2021.4.0=h06a4308_640
  - joblib==1.1.1=py310h06a4308_0
  - brotli-bin==1.0.9=h5eee18b_7
  - notebook-shim==0.2.2=py310h06a4308_0
  - aws-sdk-cpp==1.8.185=hce553d0_0
  - jedi==0.18.1=py310h06a4308_1
  - mpich==3.3.2=hc856adb_0
  - icu==58.2=he6710b0_3
  - traitlets==5.7.1=py310h06a4308_0
  - tk==8.6.12=h1ccaba5_0
  - libssh2==1.10.0=h8f2d780_0
  - zipp==3.11.0=py310h06a4308_0
  - tomli==2.0.1=py310h06a4308_0
  - typing_extensions==4.4.0=py310h06a4308_0
  - markupsafe==2.1.1=py310h7f8727e_0
  - freetype==2.12.1=h4a9f257_0
  - gflags==2.2.2=he6710b0_0
  - matplotlib==3.7.0=py310h06a4308_0
  - libwebp-base==1.2.4=h5eee18b_1
  - jinja2==3.1.2=py310h06a4308_0
  - beautifulsoup4==4.12.0=py310h06a4308_0
  - gmp==6.2.1=h295c915_3
  - click==8.0.4=py310h06a4308_0
  - mkl-service==2.4.0=py310h7f8727e_0
  - lcms2==2.12=h3be6417_0
  - tokenizers==0.11.4=py310h3dcd8bd_1
  - networkx==2.8.4=py310h06a4308_1
  - fontconfig==2.14.1=h4c34cd2_2
  - lerc==3.0=h295c915_0
  - urllib3==1.26.15=py310h06a4308_0
  - entrypoints==0.4=py310h06a4308_0
  - libevent==2.1.12=h8f2d780_0
  - aiohttp==3.8.3=py310h5eee18b_0
  - importlib-metadata==6.0.0=py310h06a4308_0
  - libgfortran-ng==7.5.0=ha8ba4b0_17
  - libwebp==1.2.4=h11a3e52_1
  - keyring==23.13.1=py310hff52083_0
  - dbus==1.13.18=hb2f20db_0
  - async-timeout==4.0.2=py310h06a4308_0
  - terminado==0.17.1=py310h06a4308_0
  - multiprocess==0.70.14=py310h06a4308_0
  - frozenlist==1.3.3=py310h5eee18b_0
  - qt-webengine==5.15.9=hbbf29b9_6
  - qtwebkit==5.212=h3fafdc1_5
  - mpfr==4.0.2=hb69a4c5_1
  - libffi==3.4.2=h6a678d5_6
  - pycodestyle==2.10.0=py310h06a4308_0
  - openssl==1.1.1t=h7f8727e_0
  - gst-plugins-base==1.14.1=h6a678d5_1
  - fsspec==2023.3.0=py310h06a4308_0
  - jupyter_core==5.3.0=py310h06a4308_0
  - readline==8.2=h5eee18b_0
  - tornado==6.2=py310h5eee18b_0
  - dulwich==0.21.3=py310h1fa729e_0
  - filelock==3.9.0=py310h06a4308_0
  - jupyter_server==1.23.4=py310h06a4308_0
  - pysocks==1.7.1=py310h06a4308_0
  - libcurl==7.88.1=h91b91d3_0
  - nest-asyncio==1.5.6=py310h06a4308_0
  - multidict==6.0.2=py310h5eee18b_0
  - docutils==0.18.1=py310h06a4308_3
  - libxcb==1.15=h7f8727e_0
  - ffmpeg==4.2.2=h20bf706_0
  - pyqt==5.15.7=py310h6a678d5_1
  - nbclassic==0.5.4=py310h06a4308_0
  - sip==6.6.2=py310h6a678d5_0
  - platformdirs==2.5.2=py310h06a4308_0
  - libsodium==1.0.18=h7b6447c_0
  - flit-core==3.8.0=py310h06a4308_0
  - zeromq==4.3.4=h2531618_0
  - ncurses==6.4=h6a678d5_0
  - libidn2==2.3.2=h7f8727e_0
  - lxml==4.9.2=py310h5eee18b_0
  - pyarrow==10.0.1=py310h468efa6_0
  - libclang13==14.0.6=default_he11475f_1
  - scipy==1.7.3=py310hfa59a62_0
  - libclang==14.0.6=default_hc6dbbc7_1
  - sentry-sdk==1.9.0=py310h06a4308_0
  - tenacity==8.0.1=py310h06a4308_1
  - intel-openmp==2021.4.0=h06a4308_3561
  - libboost==1.73.0=h28710b8_12
  - flake8==6.0.0=py310h06a4308_0
  - kiwisolver==1.4.4=py310h6a678d5_0
  - _openmp_mutex==4.5=2_kmp_llvm
  - yarl==1.8.1=py310h5eee18b_0
  - widgetsnbextension==4.0.5=py310h06a4308_0
  - idna==3.4=py310h06a4308_0
  - ply==3.11=py310h06a4308_0
  - boost-cpp==1.73.0=h7f8727e_12
  - sympy==1.11.1=py310h06a4308_0
  - gmpy2==2.1.2=py310heeb90bb_0
  - pillow==9.4.0=py310h6a678d5_0
  - packaging==23.0=py310h06a4308_0
  - nss==3.74=h0370c37_0
  - argon2-cffi-bindings==21.2.0=py310h7f8727e_0
  - python-fastjsonschema==2.16.2=py310h06a4308_0
  - prompt-toolkit==3.0.36=py310h06a4308_0
  - wheel==0.38.4=py310h06a4308_0
  - qt-main==5.15.2=h8373d8f_8
  - psutil==5.9.0=py310h5eee18b_0
  - libdeflate==1.17=h5eee18b_0
  - mkl_random==1.2.2=py310h00e6091_0
  - contourpy==1.0.5=py310hdb19cb5_0
  - pyyaml==6.0=py310h5eee18b_1
  - cffi==1.15.1=py310h5eee18b_3
  - pip==23.0.1=py310h06a4308_0
  - libxslt==1.1.37=h2085143_0
  - gitpython==3.1.30=py310h06a4308_0
  - jupyterlab==3.5.3=py310h06a4308_0
  - anyio==3.5.0=py310h06a4308_0
  - nettle==3.7.3=hbbd107a_1
  - openh264==2.1.1=h4ff587b_0
  - brotli==1.0.9=h5eee18b_7
  - scikit-learn-intelex==2023.0.2=py310h06a4308_0
  - ld_impl_linux-64==2.38=h1181459_1
  - libunistring==0.9.10=h27cfd23_0
  - pyzmq==23.2.0=py310h6a678d5_0
  - libllvm14==14.0.6=hdb19cb5_2
  - setuptools==65.6.3=py310h06a4308_0
  - numexpr==2.8.4=py310h8879344_0
  - colorama==0.4.6=py310h06a4308_0
  - jupyter==1.0.0=py310h06a4308_8
  - daal4py==2023.0.2=py310h3c18c91_0
  - regex==2022.7.9=py310h5eee18b_0
  - krb5==1.19.4=h568e23c_0
  - yaml==0.2.5=h7b6447c_0
  - imagesize==1.4.1=py310h06a4308_0
  - protobuf==3.20.3=py310h6a678d5_0
  - libuuid==1.41.5=h5eee18b_0
  - glib==2.69.1=he621ea3_2
  - mkl_fft==1.3.1=py310hd6ae3a3_0
  - pydantic==1.10.7=py310h1fa729e_0
  - llvm-openmp==14.0.6=h9e868ea_0
  - babel==2.11.0=py310h06a4308_0
  - python==3.10.9=h7a1cb2a_2
  - libtasn1==4.19.0=h5eee18b_0
  - ipykernel==6.19.2=py310h2f386ee_0
  - jupyter_console==6.6.3=py310h06a4308_0
  - go==1.19.3=hb589e2e_0
  - msgpack-python==1.0.3=py310hbf28c38_1
  - libxkbcommon==1.0.1=h5eee18b_1
  - requests==2.28.1=py310h06a4308_1
  - jupyterlab_server==2.22.0=py310h06a4308_0
  - sphinx==5.0.2=py310h06a4308_0
  - lame==3.100=h7b6447c_0
  - xxhash==0.8.0=h7f8727e_3
  - libthrift==0.15.0=hcc01f38_0
  - secretstorage==3.3.3=py310hff52083_1
  - tbb==2021.8.0=hdb19cb5_0
  - webencodings==0.5.1=py310h06a4308_1
  - nbclient==0.5.13=py310h06a4308_0
  - aws-c-event-stream==0.1.6=h2531618_5
  - jupyterlab_widgets==3.0.5=py310h06a4308_0
  - sniffio==1.2.0=py310h06a4308_1
  - glog==0.5.0=h2531618_0
  - nbconvert==6.5.4=py310h06a4308_0
  - notebook==6.5.3=py310h06a4308_0
  - libprotobuf==3.20.3=he621ea3_0
  - mpc==1.1.0=h10f8cd9_1
  - libev==4.33=h7f8727e_1
  - pyparsing==3.0.9=py310h06a4308_0

Here is the output using the environment file with versions removed:

(base) H:\pyscripts\EventStreamGPT>conda env create -n helloworld -f env_cpu_original_noversion.yml python=3.10
Collecting package metadata (repodata.json): done
Solving environment: failed

ResolvePackageNotFound:
  - libunistring
  - readline
  - libgfortran-ng
  - libev
  - dbus
  - nspr
  - _openmp_mutex
  - nss
  - libtasn1
  - ld_impl_linux-64
  - secretstorage
  - nettle
  - libuuid
  - gnutls
  - libedit
  - libvpx
  - libnghttp2
  - libgfortran4
  - libgcc-ng
  - mpich
  - ncurses
  - libxkbcommon
  - gmp
  - libidn2
  - libstdcxx-ng

[juancq]

I have a version that seems to be working. I installed things manually, so it may include more than the minimum packages needed. In case it helps. https://github.com/juancq/EventStreamGPT/commit/305271be6543620abc2f897b18b94d01f6562f4e

[mmcdermott]

Thanks @juancq -- want to submit a PR with that file to the dev branch? I'm happy to copy it over as well but if you want to be reflected as the original author, happy to accept a PR.

[juancq]

I'm testing it on two different windows environments to make sure it doesn't generate any errors (it currently is). I'll make a PR request after I complete that.

[mmcdermott]

@juancq I'm closing this issue considering we no longer use a conda environment file, but instead can be installed via pip with the setup.py file, but feel free to re-open if there is need.