search

AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
142.43k stars 26.86k forks source link

[Bug]: Unable to install xformers on Linux with CUDA 12.1 #10125

Closed seadra closed 1 year ago

seadra commented 1 year ago

Is there an existing issue for this?

What happened?

Current stable version of CUDA is 12.1, that's what ships on Arch Linux.

Currently, the built-in installation of xformers fails on Linux due to #10124, so as a work around, I installed xformers manually source venv/bin/activate followed by pip install xformers which tried to install xformers-0.0.16.

However, the installation fails with the following error

The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.

Steps to reproduce the problem

  1. Go to stable-diffusion-webui
  2. Run ./webui.sh --xformers
  3. It fails, so run source venv/bin/activate followed by pip install xformers

What should have happened?

Should have run normally

Commit where the problem happens

5ab7f21

What platforms do you use to access the UI ?

Linux

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

./webui.sh --xformers

List of extensions

No

Console logs

$ pip install xformers
Collecting xformers
  Using cached xformers-0.0.16.tar.gz (7.3 MB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: torch>=1.12 in ./venv/lib/python3.11/site-packages (from xformers) (2.0.0)
Requirement already satisfied: numpy in ./venv/lib/python3.11/site-packages (from xformers) (1.23.5)
Collecting pyre-extensions==0.0.23
  Using cached pyre_extensions-0.0.23-py3-none-any.whl (11 kB)
Collecting typing-inspect
  Using cached typing_inspect-0.8.0-py3-none-any.whl (8.7 kB)
Requirement already satisfied: typing-extensions in ./venv/lib/python3.11/site-packages (from pyre-extensions==0.0.23->xformers) (4.5.0)
Requirement already satisfied: filelock in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (3.12.0)
Requirement already satisfied: sympy in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (1.11.1)
Requirement already satisfied: networkx in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (3.1)
Requirement already satisfied: jinja2 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (11.7.91)
Requirement already satisfied: triton==2.0.0 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers) (2.0.0)
Requirement already satisfied: setuptools in ./venv/lib/python3.11/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.12->xformers) (65.5.0)
Requirement already satisfied: wheel in ./venv/lib/python3.11/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.12->xformers) (0.40.0)
Requirement already satisfied: cmake in ./venv/lib/python3.11/site-packages (from triton==2.0.0->torch>=1.12->xformers) (3.26.3)
Requirement already satisfied: lit in ./venv/lib/python3.11/site-packages (from triton==2.0.0->torch>=1.12->xformers) (16.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.11/site-packages (from jinja2->torch>=1.12->xformers) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.11/site-packages (from sympy->torch>=1.12->xformers) (1.3.0)
Collecting mypy-extensions>=0.3.0
  Using cached mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Building wheels for collected packages: xformers
  Building wheel for xformers (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [239 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.linux-x86_64-cpython-311
      creating build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/version.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/utils.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/test.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/info.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/_cpp_lib.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/bert_padding.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/fused_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      creating build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/sum_strided.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_sum.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_fused_matmul_fw.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_fused_matmul_bw.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_activations.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/fused_linear_layer.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      creating build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/csr_tensor.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/blocksparse_tensor.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/_csr_ops.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      creating build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/unbind.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/swiglu_op.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/common.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      creating build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/timm_sparse_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/test_utils.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/hierarchical_configs.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      creating build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/weight_init.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/model_factory.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/hydra_helper.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/block_factory.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/block_configs.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      creating build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/simplicial_embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/reversible.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/residual.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/patch_embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/multi_head_dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/input_projection.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/activations.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_vit_timm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_stride_sum.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_transformer.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_revnet.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_pytorch_transformer.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nvfuser.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_encoder.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_core.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/rotary.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/bert.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/gpt.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/vit.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/block.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mha.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/gelu_activation.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/benchmark.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/distributed.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/generation.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/pretrained.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      creating build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/triton.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/tensor_with_seqlen.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/small_k.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/flash.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/cutlass.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/common.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      creating build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/vocab.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/sine.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/rotary.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/param.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      creating build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res_layernorm.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_act_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      creating build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/fused_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/conv_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      creating build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/visual.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/sparsity_config.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/scaled_dot_product.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/random.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/pooling.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/ortho.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/nystrom.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/local.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/linformer.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/lambda_layer.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/global_tokens.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/fourier_mix.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/favor.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/core.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/compositional.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/attention_patterns.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/attention_mask.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/_sputnik_sparse.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      creating build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      running build_ext
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-r9d7pas3/xformers_d4efc1369ae641eeb480dfbd2ff23f80/setup.py", line 363, in <module>
          setuptools.setup(
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
          dist.run_commands()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 968, in run_commands
          self.run_command(cmd)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/wheel/bdist_wheel.py", line 343, in run
          self.run_command("build")
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 132, in run
          self.run_command(cmd_name)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 84, in run
          _build_ext.run(self)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
          self.build_extensions()
        File "/tmp/pip-install-r9d7pas3/xformers_d4efc1369ae641eeb480dfbd2ff23f80/setup.py", line 308, in build_extensions
          super().build_extensions()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 387, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for xformers
  Running setup.py clean for xformers
Failed to build xformers
Installing collected packages: mypy-extensions, typing-inspect, pyre-extensions, xformers
  Running setup.py install for xformers ... error
  error: subprocess-exited-with-error

  × Running setup.py install for xformers did not run successfully.
  │ exit code: 1
  ╰─> [244 lines of output]
      running install
      /home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
        warnings.warn(
      running build
      running build_py
      creating build
      creating build/lib.linux-x86_64-cpython-311
      creating build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/version.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/utils.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/test.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/info.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/_cpp_lib.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/fused_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/bert_padding.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      creating build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/sum_strided.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_sum.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_fused_matmul_fw.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_fused_matmul_bw.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_activations.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/fused_linear_layer.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      creating build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/csr_tensor.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/blocksparse_tensor.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/_csr_ops.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      creating build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/unbind.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/swiglu_op.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/common.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      creating build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/timm_sparse_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/test_utils.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/hierarchical_configs.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      creating build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/weight_init.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/model_factory.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/hydra_helper.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/block_factory.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/block_configs.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      creating build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/simplicial_embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/reversible.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/residual.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/patch_embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/multi_head_dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/input_projection.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/activations.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_vit_timm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_stride_sum.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_transformer.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_revnet.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_pytorch_transformer.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nvfuser.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_encoder.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_core.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/pretrained.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/generation.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/distributed.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/benchmark.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/gelu_activation.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mha.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/block.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/vit.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/gpt.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/bert.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/rotary.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      creating build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/triton.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/tensor_with_seqlen.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/small_k.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/flash.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/cutlass.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/common.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      creating build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/vocab.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/sine.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/rotary.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/param.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      creating build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res_layernorm.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_act_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      creating build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/fused_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/conv_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      creating build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/visual.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/sparsity_config.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/scaled_dot_product.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/random.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/pooling.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/ortho.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/nystrom.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/local.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/linformer.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/lambda_layer.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/global_tokens.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/fourier_mix.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/favor.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/core.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/compositional.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/attention_patterns.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/attention_mask.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/_sputnik_sparse.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      creating build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      running build_ext
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-r9d7pas3/xformers_d4efc1369ae641eeb480dfbd2ff23f80/setup.py", line 363, in <module>
          setuptools.setup(
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
          dist.run_commands()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 968, in run_commands
          self.run_command(cmd)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/command/install.py", line 68, in run
          return orig.install.run(self)
                 ^^^^^^^^^^^^^^^^^^^^^^
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/install.py", line 698, in run
          self.run_command('build')
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 132, in run
          self.run_command(cmd_name)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 84, in run
          _build_ext.run(self)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
          self.build_extensions()
        File "/tmp/pip-install-r9d7pas3/xformers_d4efc1369ae641eeb480dfbd2ff23f80/setup.py", line 308, in build_extensions
          super().build_extensions()
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "/home/user/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 387, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> xformers

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

[notice] A new release of pip available: 22.3.1 -> 23.1.2
[notice] To update, run: pip install --upgrade pip

Additional information

No response

seadra commented 1 year ago

Trying to switch to an older version of CUDA using CUDA_PATH as a work around also fails, due to a recent switch to gcc 13 in Arch Linux:

RuntimeError: The current installed version of g++ (13.1.1) is greater than the maximum required version by CUDA 11.1

ablechow29 commented 1 year ago

I am also experiencing the same problem. If I install xformers as instructed on the wiki, I encounter the issue described in this the post "issus 10124". 

[able@archlinux ~]$ stable-diffusion-webui/webui.sh --xformers

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye)
################################################################

################################################################
Running on able user
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Using TCMalloc: libtcmalloc.so.4
Python 3.11.3 (main, Apr  5 2023, 15:52:25) [GCC 12.2.1 20230201]
Commit hash: 5ab7f213bec2f816f9c5644becb32eb72c8ffb89
Installing xformers
Traceback (most recent call last):
  File "/home/able/stable-diffusion-webui/launch.py", line 352, in <module>
    prepare_environment()
  File "/home/able/stable-diffusion-webui/launch.py", line 278, in prepare_environment
    run_pip(f"install {xformers_package}", "xformers")
  File "/home/able/stable-diffusion-webui/launch.py", line 128, in run_pip
    return run(f'"{python}" -m pip {command} --prefer-binary{index_url_line}', desc=f"Installing {desc}", errdesc=f"Couldn't install {desc}", live=live)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/able/stable-diffusion-webui/launch.py", line 96, in run
    raise RuntimeError(message)
RuntimeError: Couldn't install xformers.
Command: "/home/able/stable-diffusion-webui/venv/bin/python3" -m pip install xformers==0.0.16 --prefer-binary
Error code: 1
stdout: Collecting xformers==0.0.16
  Using cached xformers-0.0.16.tar.gz (7.3 MB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: torch>=1.12 in ./venv/lib/python3.11/site-packages (from xformers==0.0.16) (2.0.0+cu118)
Requirement already satisfied: numpy in ./venv/lib/python3.11/site-packages (from xformers==0.0.16) (1.23.5)
Collecting pyre-extensions==0.0.23 (from xformers==0.0.16)
  Using cached pyre_extensions-0.0.23-py3-none-any.whl (11 kB)
Requirement already satisfied: typing-inspect in ./venv/lib/python3.11/site-packages (from pyre-extensions==0.0.23->xformers==0.0.16) (0.8.0)
Requirement already satisfied: typing-extensions in ./venv/lib/python3.11/site-packages (from pyre-extensions==0.0.23->xformers==0.0.16) (4.5.0)
Requirement already satisfied: filelock in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers==0.0.16) (3.12.0)
Requirement already satisfied: sympy in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers==0.0.16) (1.11.1)
Requirement already satisfied: networkx in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers==0.0.16) (3.1)
Requirement already satisfied: jinja2 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers==0.0.16) (3.1.2)
Requirement already satisfied: triton==2.0.0 in ./venv/lib/python3.11/site-packages (from torch>=1.12->xformers==0.0.16) (2.0.0)
Requirement already satisfied: cmake in ./venv/lib/python3.11/site-packages (from triton==2.0.0->torch>=1.12->xformers==0.0.16) (3.26.3)
Requirement already satisfied: lit in ./venv/lib/python3.11/site-packages (from triton==2.0.0->torch>=1.12->xformers==0.0.16) (16.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.11/site-packages (from jinja2->torch>=1.12->xformers==0.0.16) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.11/site-packages (from sympy->torch>=1.12->xformers==0.0.16) (1.3.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./venv/lib/python3.11/site-packages (from typing-inspect->pyre-extensions==0.0.23->xformers==0.0.16) (1.0.0)
Building wheels for collected packages: xformers
  Building wheel for xformers (setup.py): started
  Building wheel for xformers (setup.py): finished with status 'error'
  Running setup.py clean for xformers
Failed to build xformers

stderr:   error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [241 lines of output]
      running bdist_wheel
      /home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py:476: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
        warnings.warn(msg.format('we could not find ninja.'))
      running build
      running build_py
      creating build
      creating build/lib.linux-x86_64-cpython-311
      creating build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/version.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/utils.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/test.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/info.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/_cpp_lib.py -> build/lib.linux-x86_64-cpython-311/xformers
      copying xformers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/bert_padding.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      copying xformers/_flash_attn/fused_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn
      creating build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/sum_strided.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_sum.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_fused_matmul_fw.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_fused_matmul_bw.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/k_activations.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/fused_linear_layer.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      copying xformers/triton/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/triton
      creating build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/csr_tensor.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/blocksparse_tensor.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/_csr_ops.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      copying xformers/sparse/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/sparse
      creating build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/unbind.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/swiglu_op.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/common.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      copying xformers/ops/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/ops
      creating build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/timm_sparse_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/test_utils.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/hierarchical_configs.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      copying xformers/helpers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/helpers
      creating build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/weight_init.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/model_factory.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/hydra_helper.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/block_factory.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/block_configs.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      copying xformers/factory/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/factory
      creating build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/simplicial_embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/reversible.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/residual.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/patch_embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/multi_head_dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/input_projection.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/activations.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      copying xformers/components/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_vit_timm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_stride_sum.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_transformer.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_revnet.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_pytorch_transformer.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nvfuser.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_encoder.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_core.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      copying xformers/benchmarks/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/rotary.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/layers
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/losses
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/bert.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/gpt.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/vit.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/models
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/block.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/embedding.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mha.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/modules
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/gelu_activation.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/ops
      creating build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/benchmark.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/distributed.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/generation.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/pretrained.py -> build/lib.linux-x86_64-cpython-311/xformers/_flash_attn/utils
      creating build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/triton.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/tensor_with_seqlen.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/small_k.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/flash.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/dispatch.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/cutlass.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/common.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      copying xformers/ops/fmha/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/ops/fmha
      creating build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/vocab.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/sine.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/rotary.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/param.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/positional_embedding
      creating build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res_layernorm.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_act_dropout.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      copying xformers/components/nvfuser/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/nvfuser
      creating build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/fused_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/conv_mlp.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      copying xformers/components/feedforward/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/feedforward
      creating build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/visual.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/utils.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/sparsity_config.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/scaled_dot_product.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/random.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/pooling.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/ortho.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/nystrom.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/local.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/linformer.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/lambda_layer.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/global_tokens.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/fourier_mix.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/favor.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/core.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/compositional.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/blocksparse.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/attention_patterns.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/attention_mask.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/_sputnik_sparse.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      copying xformers/components/attention/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention
      creating build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/softmax.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/base.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/components/attention/feature_maps
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA
      creating build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/__init__.py -> build/lib.linux-x86_64-cpython-311/xformers/benchmarks/LRA/code
      running build_ext
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-imw7d_fe/xformers_a3877377bde94e46ba899e041217b070/setup.py", line 363, in <module>
          setuptools.setup(
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
          dist.run_commands()
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 968, in run_commands
          self.run_command(cmd)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/wheel/bdist_wheel.py", line 343, in run
          self.run_command("build")
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 132, in run
          self.run_command(cmd_name)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 84, in run
          _build_ext.run(self)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 346, in run
          self.build_extensions()
        File "/tmp/pip-install-imw7d_fe/xformers_a3877377bde94e46ba899e041217b070/setup.py", line 308, in build_extensions
          super().build_extensions()
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "/home/able/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 387, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.8). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for xformers
ERROR: Could not build wheels for xformers, which is required to install pyproject.toml-based projects
Wh1t3Fox commented 1 year ago

This is an xformers issue not sd-webui issue

Sakura-Luna commented 1 year ago

PyTorch does not yet support cuda12.

neural-oracle commented 1 year ago

At end of July pytorch pip selecter tool on its webpage supports Cuda 12.1 so wondering wy xformers does not support cuda 12.1