cant set up environment

[Nemunas]

mamba env create -f environment.yml pytorch/linux-64 Using cache pytorch/noarch Using cache nvidia/linux-64 Using cache nvidia/noarch Using cache conda-forge/linux-64 Using cache conda-forge/noarch Using cache pkgs/main/linux-64 No change pkgs/main/noarch No change pkgs/r/linux-64 No change pkgs/r/noarch No change nvidia/label/cuda-11.8.0/linux-64 No change https://aws-ml-conda-pre-prod-ec2.s3.us-west-2.a.. No change nvidia/label/cuda-11.8.0/noarch No change https://aws-ml-conda-pre-prod-ec2.s3.us-west-2.a.. No change

Looking for: ['cudatoolkit=11.6.0', 'cupy=10.4.0', 'faiss-gpu=1.7.2', 'fastparquet=0.5.0', 'nccl=2.12.12.1', 'pip=22.3.1', 'pyarrow=8.0.0', 'python=3.10.9', 'python-snappy=0.6.1', 'pytorch=1.13.1', 'pytorch-cuda=11.6', 'snappy=1.1.9', 'torchaudio=0.13.1', 'torchvision=0.14.1']

Could not solve for environment specs Encountered problems while solving:

• package nccl-2.12.12.1-h1a5f58c_0 is excluded by strict repo priority
• package fastparquet-0.5.0-py36h92226af_0 requires python_abi 3.6. _cp36m, but none of the providers can be installed
• package faiss-gpu-1.7.2-py3.6_h98e120b_0_cuda10.2 requires libfaiss 1.7.2 hdbd6f0c_0_cuda10.2, but none of the providers can be installed

The environment can't be solved, aborting the operation

[Nemunas]

solved by running: conda config --set channel_priority false

[darrinh]

Also having a problem with env setup. Intially installed on my 22.04 ubuntu desktop and it work without issue. Did a fresh install of 22.04 desktop on a new machine and get the following error: Could not solve for environment specs The following packages are incompatible ├─ fastparquet 0.6.3** is installable with the potential options │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.6,<3.7.0a0 , which can be installed; │ │ └─ python_abi 3.6.* *_cp36m, which can be installed; │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.7,<3.8.0a0 , which can be installed; │ │ └─ python_abi 3.7.* *_cp37m, which can be installed; │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.8,<3.9.0a0 , which can be installed; │ │ └─ python_abi 3.8.* *_cp38, which can be installed; │ └─ fastparquet 0.6.3 would require │ ├─ python >=3.9,<3.10.0a0 , which can be installed; │ └─ python_abi 3.9.* *_cp39, which can be installed; └─ python 3.10.9** is uninstallable because there are no viable options ├─ python 3.10.9 conflicts with any installable versions previously reported; └─ python 3.10.9 would require └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported. both desktops have the same version of python installed: 3.10.6.

thanks Darrin

[darrinh]

seemed to have fixed it by install python 3.9, odd i didn't have to do that on the first install.

[darrinh]

Didn't really work in the end, seems to be an issue with python3.10.6 and/or Ubuntu 22.04. A fresh server install gives the same above error as a fresh desktop install.

[hagope]

In my environment wsl2 I needed to downgrade to python 3.9 and upgrade to pytorch-cuda=11.7:

$ uname -r
5.15.90.1-microsoft-standard-WSL2
$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.3 LTS
Release:        20.04
Codename:       focal

conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia

Also, I had to pass in memory parameters to run on my RTX 3060 12gb python inference/bot.py --model togethercomputer/Pythia-Chat-Base-7B -g 0:11 -r 30 first number is VRAM limit (11gb), second is cpu RAM (30gb)

[darrinh]

Thanks, it installed cleanly on Ubuntu 20.04. I do have it installed on a 22.04 instance but that was a two or three weeks ago, so perhaps something has changed in the meantime.

[mauhcs]

I have a similar (same?) issue. this is my output:

~/OpenChatKit$ mamba env create -f environment.yml
nvidia/noarch                                        3.5kB @  35.1kB/s  0.1s
pytorch/noarch                                      10.2kB @  96.5kB/s  0.1s
nvidia/linux-64                                    120.2kB @   1.0MB/s  0.1s
pytorch/linux-64                                   167.3kB @   1.1MB/s  0.2s
pkgs/main/noarch                                   822.9kB @   1.9MB/s  0.4s
pkgs/r/linux-64                                      1.4MB @   2.5MB/s  0.5s
pkgs/r/noarch                                        1.3MB @   2.3MB/s  0.6s
pkgs/main/linux-64                                   5.7MB @   3.5MB/s  1.5s
conda-forge/noarch                                  12.2MB @   4.5MB/s  3.7s
conda-forge/linux-64                                31.4MB @   4.4MB/s 10.6s

Looking for: ['cudatoolkit=11.6.0', 'cupy=10.4.0', 'faiss-gpu=1.7.2', 'fastparquet=0.6.3', 'nccl=2.12.12.1', 'pip=22.3.1', 'pyarrow=8.0.0', 'python=3.10.9', 'python-snappy=0.6.1', 'pytorch=1.13.1', 'pytorch-cuda=11.6', 'snappy=1.1.9', 'torchaudio=0.13.1', 'torchvision=0.14.1']

Could not solve for environment specs
The following packages are incompatible
├─ fastparquet 0.6.3**  is installable with the potential options
│  ├─ fastparquet 0.6.3 would require
│  │  ├─ python >=3.6,<3.7.0a0 , which can be installed;
│  │  └─ python_abi 3.6.* *_cp36m, which can be installed;
│  ├─ fastparquet 0.6.3 would require
│  │  ├─ python >=3.7,<3.8.0a0 , which can be installed;
│  │  └─ python_abi 3.7.* *_cp37m, which can be installed;
│  ├─ fastparquet 0.6.3 would require
│  │  ├─ python >=3.8,<3.9.0a0 , which can be installed;
│  │  └─ python_abi 3.8.* *_cp38, which can be installed;
│  └─ fastparquet 0.6.3 would require
│     ├─ python >=3.9,<3.10.0a0 , which can be installed;
│     └─ python_abi 3.9.* *_cp39, which can be installed;
└─ python 3.10.9**  is uninstallable because there are no viable options
   ├─ python 3.10.9 conflicts with any installable versions previously reported;
   └─ python 3.10.9 would require
      └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported.

As suggested by @darrinh, I changed the - python 3.10.9 line to - python 3.9 in the environment.yml file and I did not have the same error anymore

After much tweaking, I feel it might be a conda/mamba issue with more recent versions.

I would love to know your versions. Here are mine:

mamba --version
mamba 1.4.2
conda 23.3.1

[mauhcs]

The above comment was done in Ubuntu 20 LTS. But I still cannot make it run on MacOS.

This is my output:

mamba env create -f environment.yml
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/7fb2ce72.json" was modified by another program
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/3e39a7aa.json" was modified by another program
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/dd44a73b.json" was modified by another program
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/4ea078d6.json" was modified by another program
pytorch/osx-64                                                No change
pytorch/noarch                                                No change
nvidia/osx-64                                                 No change
nvidia/noarch                                                 No change
anaconda/osx-64                                               No change
anaconda/noarch                                               No change
pkgs/main/noarch                                   822.9kB @   1.0MB/s  0.3s
pkgs/r/noarch                                        1.3MB @   1.4MB/s  0.6s
pkgs/r/osx-64                                      820.9kB @ 799.1kB/s  0.2s
pkgs/main/osx-64                                     5.4MB @   3.2MB/s  1.4s
conda-forge/noarch                                  12.2MB @   4.3MB/s  2.7s
conda-forge/osx-64                                  28.3MB @   4.7MB/s  7.1s

Looking for: ['cudatoolkit=11.6.0', 'cupy=10.4.0', 'faiss-gpu=1.7.2', 'fastparquet=0.6.3', 'nccl=2.12.12.1', 'pip=22.3.1', 'pyarrow=8.0.0', 'python=3.9', 'python-snappy=0.6.1', 'pytorch=1.13.1', 'pytorch-cuda=11.6', 'snappy=1.1.9', 'torchaudio=0.13.1', 'torchvision=0.14.1']

Could not solve for environment specs
The following packages are incompatible
├─ cudatoolkit 11.6.0**  does not exist (perhaps a typo or a missing channel);
├─ cupy 10.4.0**  does not exist (perhaps a typo or a missing channel);
├─ faiss-gpu 1.7.2**  does not exist (perhaps a typo or a missing channel);
├─ nccl 2.12.12.1**  does not exist (perhaps a typo or a missing channel);
└─ pytorch-cuda 11.6**  is uninstallable because it requires
   └─ cuda 11.6.* , which does not exist (perhaps a missing channel).

Mamba and Conda versions are the same as the ubuntu version:

% mamba --version                      
mamba 1.4.2
conda 23.3.1

Am I supposed to be able to install in MacOS to begin with?

[zuketo]

To follow up on @mauhcs comment, this also fixed it for me:

As suggested by @darrinh, I changed the - python 3.10.9 line to - python 3.9 in the environment.yml file and I did not have the same error anymore

[mgleavitt]

I'm seeing pretty much the same thing as @mauhcs on my Mac The Python version in my base env is 3.10.11

(bold == red/error text) Could not solve for environment specs The following packages are incompatible ├─ cudatoolkit 11.6.0 does not exist (perhaps a typo or a missing channel); ├─ cupy 10.4.0 does not exist (perhaps a typo or a missing channel); ├─ faiss-gpu 1.7.2 does not exist (perhaps a typo or a missing channel); ├─ fastparquet 0.6.3 is installable with the potential options │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.6,<3.7.0a0 , which can be installed; │ │ └─ python_abi 3.6. _cp36m, which can be installed; │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.7,<3.8.0a0 , which can be installed; │ │ └─ python_abi 3.7. _cp37m, which can be installed; │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.8,<3.9.0a0 , which can be installed; │ │ └─ python_abi 3.8. _cp38, which can be installed; │ └─ fastparquet 0.6.3 would require │ ├─ python >=3.9,<3.10.0a0 , which can be installed; │ └─ python_abi 3.9. _cp39, which can be installed; ├─ nccl 2.12.12.1 does not exist (perhaps a typo or a missing channel); ├─ python 3.10.9 is uninstallable because there are no viable options │ ├─ python 3.10.9 conflicts with any installable versions previously reported; │ └─ python 3.10.9 would require │ └─ python_abi 3.10. _cp310, which conflicts with any installable versions previously reported; └─ pytorch-cuda 11.6 is uninstallable because it requires └─ cuda 11.6.* , which does not exist (perhaps a missing channel).**

[orangetin]

@mauhcs @mgleavitt see this comment to setup the env for Mac