search

ShivamShrirao / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
https://huggingface.co/docs/diffusers
Apache License 2.0
1.89k stars 509 forks source link

Unable to install dependencies #236

Open NadaComa opened 1 year ago

NadaComa commented 1 year ago

Describe the bug

Hi all, sorry for this but I am stuck. I am definitely lacking experience with setting up python properly.

Anyways: when I try to follow the documentation I run into two issues

  1. Running pip install git+https://github.com/ShivamShrirao/diffusers.git works fine but then pip install -U -r requirements.txt does not find the requirements.txt

  2. Checking out the code via git and running this in there results in issues with xformers `Collecting xformers Using cached xformers-0.0.17-cp310-cp310-manylinux2014_x86_64.whl (123.6 MB) Using cached xformers-0.0.16-cp310-cp310-manylinux2014_x86_64.whl (50.9 MB) Using cached xformers-0.0.13.tar.gz (292 kB) Preparing metadata (setup.py) ... error error: subprocess-exited-with-error

    × python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [8 lines of output] Traceback (most recent call last): File "", line 2, in File "", line 34, in File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 239, in ext_modules=get_extensions(), File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 157, in get_extensions raise RuntimeError( RuntimeError: CUTLASS submodule not found. Did you forget to run git submodule update --init --recursive ? [end of output] `

Reproduction

This is what I am actually doing on the command line. Python 3.10.10 and PyTorch 2.1.0.dev20230513 previously installed via miniconda

python3 -m venv diffuser.env source diffuser.env/bin/activate pip install git+https://github.com/ShivamShrirao/diffusers.git pip install -U -r requirements.txt #Does not work, so doing the next three lines in downloaded source. Where is my requirements.txt? git clone https://github.com/ShivamShrirao/diffusers.git cd diffusers/examples/dreambooth pip install -U -r requirements.txt

Now I get the error message

Logs

Collecting accelerate
  Using cached accelerate-0.19.0-py3-none-any.whl (219 kB)
Collecting torchvision
  Using cached torchvision-0.15.2-cp310-cp310-manylinux1_x86_64.whl (6.0 MB)
Collecting transformers>=4.25.1
  Using cached transformers-4.29.2-py3-none-any.whl (7.1 MB)
Collecting ftfy
  Using cached ftfy-6.1.1-py3-none-any.whl (53 kB)
Collecting tensorboard
  Using cached tensorboard-2.13.0-py3-none-any.whl (5.6 MB)
Requirement already satisfied: Jinja2 in /home/ai/diffuser.env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (3.1.2)
Collecting safetensors
  Using cached safetensors-0.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
Requirement already satisfied: xformers in /home/ai/diffuser.env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (0.0.19)
Requirement already satisfied: packaging>=20.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (23.1)
Requirement already satisfied: numpy>=1.17 in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (1.24.3)
Collecting psutil
  Using cached psutil-5.9.5-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
Requirement already satisfied: pyyaml in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (6.0)
Requirement already satisfied: torch>=1.6.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: requests in /home/ai/diffuser.env/lib/python3.10/site-packages (from torchvision->-r requirements.txt (line 2)) (2.30.0)
Collecting torch>=1.6.0
  Using cached torch-2.0.1-cp310-cp310-manylinux1_x86_64.whl (619.9 MB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torchvision->-r requirements.txt (line 2)) (9.5.0)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (10.9.0.58)
Requirement already satisfied: filelock in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (3.12.0)
Requirement already satisfied: typing-extensions in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (4.5.0)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (10.2.10.91)
Requirement already satisfied: networkx in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (3.1)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.4.0.1)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.101)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.4.91)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: sympy in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (1.12)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.10.3.66)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (2.14.3)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (8.5.0.96)
Requirement already satisfied: wheel in /home/ai/diffuser.env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (0.40.0)
Requirement already satisfied: setuptools in /home/ai/diffuser.env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (65.5.0)
Requirement already satisfied: cmake in /home/ai/diffuser.env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (3.26.3)
Requirement already satisfied: lit in /home/ai/diffuser.env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (16.0.5)
Requirement already satisfied: tqdm>=4.27 in /home/ai/diffuser.env/lib/python3.10/site-packages (from transformers>=4.25.1->-r requirements.txt (line 3)) (4.65.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /home/ai/diffuser.env/lib/python3.10/site-packages (from transformers>=4.25.1->-r requirements.txt (line 3)) (0.14.1)
Requirement already satisfied: regex!=2019.12.17 in /home/ai/diffuser.env/lib/python3.10/site-packages (from transformers>=4.25.1->-r requirements.txt (line 3)) (2023.5.5)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1
  Using cached tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)
Collecting wcwidth>=0.2.5
  Using cached wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.3.4-py3-none-any.whl (242 kB)
Collecting tensorboard-data-server<0.8.0,>=0.7.0
  Using cached tensorboard_data_server-0.7.0-py3-none-manylinux2014_x86_64.whl (6.6 MB)
Collecting protobuf>=3.19.6
  Using cached protobuf-4.23.0-cp37-abi3-manylinux2014_x86_64.whl (304 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting absl-py>=0.4
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting google-auth<3,>=1.6.3
  Using cached google_auth-2.18.0-py2.py3-none-any.whl (178 kB)
Collecting grpcio>=1.48.2
  Using cached grpcio-1.54.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.1 MB)
Collecting google-auth-oauthlib<1.1,>=0.5
  Using cached google_auth_oauthlib-1.0.0-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from Jinja2->-r requirements.txt (line 6)) (2.1.2)
Requirement already satisfied: pyre-extensions==0.0.29 in /home/ai/diffuser.env/lib/python3.10/site-packages (from xformers->-r requirements.txt (line 8)) (0.0.29)
Collecting xformers
  Using cached xformers-0.0.19-cp310-cp310-manylinux2014_x86_64.whl (108.2 MB)
  Using cached xformers-0.0.18-cp310-cp310-manylinux2014_x86_64.whl (123.8 MB)
Collecting pyre-extensions==0.0.23
  Using cached pyre_extensions-0.0.23-py3-none-any.whl (11 kB)
Collecting xformers
  Using cached xformers-0.0.17-cp310-cp310-manylinux2014_x86_64.whl (123.6 MB)
  Using cached xformers-0.0.16-cp310-cp310-manylinux2014_x86_64.whl (50.9 MB)
  Using cached xformers-0.0.13.tar.gz (292 kB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [8 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 239, in <module>
          ext_modules=get_extensions(),
        File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 157, in get_extensions
          raise RuntimeError(
      RuntimeError: CUTLASS submodule not found. Did you forget to run `git submodule update --init --recursive` ?
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

System Info

Linux MINT Debian Edition (Bullseye) with RTX 3060

Python 3.10.10 and PyTorch 2.1.0.dev20230513 installed via miniconda