search

facebookresearch / audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
MIT License
20.71k stars 2.11k forks source link

xformers installs but could not build wheels for it. #317

Closed rer0dgers closed 11 months ago

rer0dgers commented 11 months ago

This is the error I receive:

File "H:\Program Files\Python311\Lib\site-packages\setuptools_distutils\util.py", line 139, in convert_path raise ValueError("path '%s' cannot be absolute" % pathname) ValueError: path '/__w/xformers/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.cpp' cannot be absolute [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for xformers Running setup.py clean for xformers Failed to build xformers ERROR: Could not build wheels for xformers, which is required to install pyproject.toml-based projects`

I was able to install xformers 0.0.20 and I was able to remove it and install xformers 0.0.22.

pip install xformer==0.0.22

I even installed from the source on pypi.org. They all give the same error making wheels. There is an absolute path somewhere that python hates.

rer0dgers commented 11 months ago

Here is my current PIP List: H:\MUSIC\audiocraft>pip list Package Version

certifi 2023.7.22 charset-normalizer 3.3.0 filelock 3.12.4 idna 3.4 Jinja2 3.1.2 MarkupSafe 2.1.3 mpmath 1.3.0 mypy-extensions 1.0.0 networkx 3.1 ninja 1.11.1.1 numpy 1.26.0 Pillow 10.0.1 pip 23.2.1 pyre-extensions 0.0.29 requests 2.31.0 setuptools 65.5.0 sympy 1.12 torch 2.0.1+cu118 torchvision 0.15.2+cu118 typing_extensions 4.8.0 typing-inspect 0.9.0 urllib3 2.0.6 wheel 0.41.2 xformers 0.0.22

rer0dgers commented 11 months ago

This is on Windows by the way. Python version 3.11

0xlws commented 11 months ago

looks like there is an issue with latest xformers, they did a commit few hours ago, https://github.com/facebookresearch/xformers/commit/16e4245e02f47883b6b43065a0e26dfb12e14e33 so it may be fixed already if not, an older version (0.0.20) is suggested: https://github.com/facebookresearch/xformers/issues/886#issuecomment-1762922926

rer0dgers commented 11 months ago

looks like there is an issue with latest xformers, they did a commit few hours ago, facebookresearch/xformers@16e4245 so it may be fixed already if not, an older version (0.0.20) is suggested: facebookresearch/xformers#886 (comment)

Thanks. I'll give it a try in a few minutes. I did try the older version. It installs too, but the wheels step still errors our. Lets hope they do have it fixed already.

rer0dgers commented 11 months ago

Its fixed. Thanks!

zeke-john commented 10 months ago

@rer0dgers @0xlws I am also getting the same error, even after installing 0.0.20. I am running this on an m1 macbook air. Any suggestions?

pip list:

appdirs            1.4.4
audioread          3.0.1
certifi            2023.11.17
cffi               1.16.0
charset-normalizer 3.3.2
click              8.1.7
decorator          5.1.1
docker-pycreds     0.4.0
filelock           3.13.1
fsspec             2023.10.0
gitdb              4.0.11
GitPython          3.1.40
idna               3.6
Jinja2             3.1.2
joblib             1.3.2
lazy_loader        0.3
librosa            0.10.1
llvmlite           0.41.1
MarkupSafe         2.1.3
mpmath             1.3.0
msgpack            1.0.7
networkx           3.2.1
numba              0.58.1
numpy              1.26.2
packaging          23.2
pip                23.3.1
platformdirs       4.0.0
pooch              1.8.0
protobuf           4.25.1
psutil             5.9.6
pycparser          2.21
pydu               0.7.2
pydub              0.25.1
PyYAML             6.0.1
requests           2.31.0
scikit-learn       1.3.2
scipy              1.11.4
sentry-sdk         1.37.1
setproctitle       1.3.3
setuptools         69.0.2
six                1.16.0
smmap              5.0.1
soundfile          0.12.1
soxr               0.3.7
sympy              1.12
threadpoolctl      3.2.0
torch              2.1.1
torchaudio         2.1.1
typing_extensions  4.8.0
urllib3            2.1.0
wandb              0.16.0
wheel              0.42.0

Full Error log (pip install xformers==0.0.20):

Collecting xformers==0.0.20
  Using cached xformers-0.0.20.tar.gz (7.6 MB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: torch>=1.12 in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from xformers==0.0.20) (2.1.1)
Requirement already satisfied: numpy in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from xformers==0.0.20) (1.26.2)
Collecting pyre-extensions==0.0.29 (from xformers==0.0.20)
  Using cached pyre_extensions-0.0.29-py3-none-any.whl (12 kB)
Collecting typing-inspect (from pyre-extensions==0.0.29->xformers==0.0.20)
  Using cached typing_inspect-0.9.0-py3-none-any.whl.metadata (1.5 kB)
Requirement already satisfied: typing-extensions in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from pyre-extensions==0.0.29->xformers==0.0.20) (4.8.0)
Requirement already satisfied: filelock in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from torch>=1.12->xformers==0.0.20) (3.13.1)
Requirement already satisfied: sympy in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from torch>=1.12->xformers==0.0.20) (1.12)
Requirement already satisfied: networkx in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from torch>=1.12->xformers==0.0.20) (3.2.1)
Requirement already satisfied: jinja2 in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from torch>=1.12->xformers==0.0.20) (3.1.2)
Requirement already satisfied: fsspec in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from torch>=1.12->xformers==0.0.20) (2023.10.0)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from jinja2->torch>=1.12->xformers==0.0.20) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages (from sympy->torch>=1.12->xformers==0.0.20) (1.3.0)
Collecting mypy-extensions>=0.3.0 (from typing-inspect->pyre-extensions==0.0.29->xformers==0.0.20)
  Using cached mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Using cached typing_inspect-0.9.0-py3-none-any.whl (8.8 kB)
Building wheels for collected packages: xformers
  Building wheel for xformers (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [216 lines of output]
      running bdist_wheel
      /Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages/torch/utils/cpp_extension.py:502: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
        warnings.warn(msg.format('we could not find ninja.'))
      running build
      running build_py
      creating build
      creating build/lib.macosx-13.0-x86_64-cpython-39
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers
      copying xformers/version.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers
      copying xformers/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers
      copying xformers/test.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers
      copying xformers/utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers
      copying xformers/_cpp_lib.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers
      copying xformers/info.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/fused_linear_layer.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/sum_strided.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_activations.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_layer_norm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_sum.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_fused_matmul_fw.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/dropout.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_dropout.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/softmax.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/layer_norm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_fused_matmul_bw.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      copying xformers/triton/k_softmax.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/triton
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/simplicial_embedding.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/residual.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/reversible.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/activations.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/multi_head_dispatch.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/input_projection.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      copying xformers/components/patch_embedding.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nvfuser.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_indexing.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_mlp.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_stride_sum.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_transformer.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_revnet.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_encoder.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_pytorch_transformer.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      copying xformers/benchmarks/benchmark_core.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops
      copying xformers/ops/swiglu_op.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops
      copying xformers/ops/unbind.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops
      copying xformers/ops/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops
      copying xformers/ops/common.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops
      copying xformers/ops/indexing.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/profiler
      copying xformers/profiler/device_limits.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/profiler
      copying xformers/profiler/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/profiler
      copying xformers/profiler/api.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/profiler
      copying xformers/profiler/slow_ops_profiler.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/profiler
      copying xformers/profiler/profiler.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/profiler
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/sparse
      copying xformers/sparse/_csr_ops.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/sparse
      copying xformers/sparse/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/sparse
      copying xformers/sparse/utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/sparse
      copying xformers/sparse/blocksparse_tensor.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/sparse
      copying xformers/sparse/csr_tensor.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/sparse
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/helpers
      copying xformers/helpers/test_utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/helpers
      copying xformers/helpers/hierarchical_configs.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/helpers
      copying xformers/helpers/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/helpers
      copying xformers/helpers/timm_sparse_attention.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/helpers
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/fused_softmax.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/bert_padding.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attention.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      copying xformers/factory/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      copying xformers/factory/hydra_helper.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      copying xformers/factory/block_factory.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      copying xformers/factory/model_factory.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      copying xformers/factory/block_configs.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      copying xformers/factory/weight_init.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/factory
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/global_tokens.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/ortho.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/blocksparse.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/local.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/compositional.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/pooling.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/_sputnik_sparse.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/core.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/lambda_layer.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/random.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/fourier_mix.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/scaled_dot_product.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/attention_mask.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/linformer.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/attention_patterns.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/visual.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/sparsity_config.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/nystrom.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/favor.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      copying xformers/components/attention/base.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      copying xformers/components/feedforward/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      copying xformers/components/feedforward/mlp.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      copying xformers/components/feedforward/conv_mlp.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      copying xformers/components/feedforward/fused_mlp.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      copying xformers/components/feedforward/base.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/feedforward
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/vocab.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/param.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/sine.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/rotary.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      copying xformers/components/positional_embedding/base.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/positional_embedding
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res_layernorm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_act_dropout.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/nvfuser
      copying xformers/components/nvfuser/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/nvfuser
      copying xformers/components/nvfuser/utils.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/nvfuser
      copying xformers/components/nvfuser/bias_dropout_res.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/nvfuser
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/softmax.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention/feature_maps
      copying xformers/components/attention/feature_maps/base.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/components/attention/feature_maps
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA/code
      copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/benchmarks/LRA/code
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/triton.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/dispatch.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/attn_bias.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/common.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/flash.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/small_k.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      copying xformers/ops/fmha/cutlass.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/ops/fmha
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/losses
      copying xformers/_flash_attn/losses/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/losses
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/layers
      copying xformers/_flash_attn/layers/rotary.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/layers
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/pretrained.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/generation.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/benchmark.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/utils
      copying xformers/_flash_attn/utils/distributed.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/utils
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/gptj.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/opt.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/llama.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/vit.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/bert.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/gpt_neox.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      copying xformers/_flash_attn/models/gpt.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/models
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/activations.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/rms_norm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/ops
      copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/ops
      creating build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/embedding.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/__init__.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mlp.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/block.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/modules
      copying xformers/_flash_attn/modules/mha.py -> build/lib.macosx-13.0-x86_64-cpython-39/xformers/_flash_attn/modules
      running build_ext
      building 'xformers._C' extension
      creating build/temp.macosx-13.0-x86_64-cpython-39
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc/attention
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc/attention/autograd
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc/attention/cpu
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc/indexing
      creating build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc/swiglu
      clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/68/3ggd1s152nj5_9nny6bd89rc0000gn/T/pip-install-yqqzzttz/xformers_3bf70afcc4b141d58aa2fdd2f23c8b17/xformers/csrc -I/Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages/torch/include -I/Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -I/Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages/torch/include/TH -I/Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/lib/python3.9/site-packages/torch/include/THC -I/Users/zeke/.pyenv/versions/3.9.0/envs/MusicGenDemo/include -I/Users/zeke/.pyenv/versions/3.9.0/include/python3.9 -c xformers/csrc/attention/attention.cpp -o build/temp.macosx-13.0-x86_64-cpython-39/xformers/csrc/attention/attention.o -O3 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_clang\" -DPYBIND11_STDLIB=\"_libcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1002\" -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
      clang: error: unsupported option '-fopenmp'
      error: command '/usr/bin/clang' failed with exit code 1
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for xformers
  Running setup.py clean for xformers
Failed to build xformers
ERROR: Could not build wheels for xformers, which is required to install pyproject.toml-based projects
Goekdeniz-Guelmez commented 9 months ago

@zeke-john what worked for me (M1) is installing it though a Conda env, you can also try installing it from source.

Travis-Barton commented 3 months ago

I'm having the same issue, and i'm in a conda env

KeerthanaMurugaraj commented 2 months ago

hello Can you please help me install on M3 ? I am facing the same issue

Travis-Barton commented 2 months ago

Can we re-open this?

7maram7 commented 2 weeks ago

having same issue on an Intel Mac