Error during package installation

okaypatrick commented 1 year ago

Ran pip install -U -r requirements.txt -r requirements-dev.txt python setup.py install and got the following error below. (Yes I upgraded pip). Any ideas?

Error output below: ` Collecting en-spacy-pii-distilbert==any (from -r requirements-dev.txt (line 3)) Downloading https://huggingface.co/beki/en_spacy_pii_distilbert/resolve/main/en_spacy_pii_distilbert-any-py3-none-any.whl (243.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 243.1/243.1 MB 11.7 MB/s eta 0:00:00 Collecting en-spacy-pii-fast==any (from -r requirements-dev.txt (line 4)) Downloading https://huggingface.co/beki/en_spacy_pii_fast/resolve/main/en_spacy_pii_fast-any-py3-none-any.whl (6.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.9/6.9 MB 32.8 MB/s eta 0:00:00 Collecting detect-secrets==1.4.0 (from -r requirements.txt (line 1)) Using cached detect_secrets-1.4.0-py3-none-any.whl (116 kB) Collecting faker==19.6.1 (from -r requirements.txt (line 2)) Using cached Faker-19.6.1-py3-none-any.whl.metadata (15 kB) Collecting FlagEmbedding==1.1.3 (from -r requirements.txt (line 3)) Using cached FlagEmbedding-1.1.3-py3-none-any.whl Collecting lingua-language-detector==1.3.3 (from -r requirements.txt (line 4)) Using cached lingua_language_detector-1.3.3-py3-none-any.whl.metadata (282 kB) Collecting nltk==3.8.1 (from -r requirements.txt (line 5)) Using cached nltk-3.8.1-py3-none-any.whl (1.5 MB) Collecting presidio-analyzer==2.2.33 (from -r requirements.txt (line 6)) Using cached presidio_analyzer-2.2.33-py3-none-any.whl.metadata (2.4 kB) Collecting presidio-anonymizer==2.2.33 (from -r requirements.txt (line 7)) Using cached presidio_anonymizer-2.2.33-py3-none-any.whl.metadata (8.0 kB) Collecting protobuf==3.20.3 (from -r requirements.txt (line 8)) Using cached protobuf-3.20.3-py2.py3-none-any.whl (162 kB) Collecting regex==2023.10.3 (from -r requirements.txt (line 9)) Using cached regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (40 kB) Collecting sentencepiece==0.1.99 (from -r requirements.txt (line 10)) Using cached sentencepiece-0.1.99-cp310-cp310-macosx_10_9_x86_64.whl (1.2 MB) Collecting tiktoken==0.5.1 (from -r requirements.txt (line 11)) Using cached tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (6.6 kB) Collecting torch==2.0.1 (from -r requirements.txt (line 12)) Using cached torch-2.0.1-cp310-none-macosx_10_9_x86_64.whl (143.4 MB) Collecting transformers==4.25.1 (from -r requirements.txt (line 13)) Using cached transformers-4.25.1-py3-none-any.whl (5.8 MB) Collecting xformers==0.0.21 (from -r requirements.txt (line 14)) Using cached xformers-0.0.21.tar.gz (22.3 MB) Installing build dependencies ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [17 lines of output] Traceback (most recent call last): File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in main() File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main json_out['return_val'] = hook(**hook_input['kwargs']) File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel return hook(config_settings) File "/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-build-env-kzgmilqs/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 355, in get_requires_for_build_wheel return self._get_build_requires(config_settings, requirements=['wheel']) File "/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-build-env-kzgmilqs/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 325, in _get_build_requires self.run_setup() File "/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-build-env-kzgmilqs/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 507, in run_setup super(_BuildMetaLegacyBackend, self).run_setup(setup_script=setup_script) File "/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-build-env-kzgmilqs/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in run_setup exec(code, locals()) File "", line 23, in ModuleNotFoundError: No module named 'torch' [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output. `

asofter commented 1 year ago

Hey @okaypatrick , thanks for reaching out. Please try to run pip install torch before running your commands.

okaypatrick commented 1 year ago

Tried that already. Looks like it could be some sort of C compiler issue:

`Building wheels for collected packages: xformers Building wheel for xformers (setup.py) ... error error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [342 lines of output] running bdist_wheel running build running build_py creating build creating build/lib.macosx-12.3-x86_64-cpython-310 creating build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/_deprecation_warning.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/version.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/checkpoint.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/test.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/_cpp_lib.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers copying xformers/info.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/fused_linear_layer.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/sum_strided.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/vararg_kernel.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_activations.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_layer_norm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_sum.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_fused_matmul_fw.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/dropout.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_dropout.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/softmax.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/layer_norm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_fused_matmul_bw.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton copying xformers/triton/k_softmax.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/triton creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/simplicial_embedding.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/residual.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/reversible.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/activations.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/multi_head_dispatch.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/input_projection.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components copying xformers/components/patch_embedding.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_indexing.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_mlp.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_stride_sum.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_mem_eff_attn_decoder.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_transformer.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_revnet.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_attn_decoding.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_core.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/rmsnorm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/swiglu_op.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/unbind.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/rope_padded.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/common.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops copying xformers/ops/indexing.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/profiler copying xformers/profiler/device_limits.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/profiler copying xformers/profiler/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/profiler copying xformers/profiler/api.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/profiler copying xformers/profiler/slow_ops_profiler.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/profiler copying xformers/profiler/profiler.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/profiler creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/sparse copying xformers/sparse/_csr_ops.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/sparse copying xformers/sparse/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/sparse copying xformers/sparse/utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/sparse copying xformers/sparse/blocksparse_tensor.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/sparse copying xformers/sparse/csr_tensor.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/sparse creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/helpers copying xformers/helpers/test_utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/helpers copying xformers/helpers/hierarchical_configs.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/helpers copying xformers/helpers/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/helpers copying xformers/helpers/timm_sparse_attention.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/helpers creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/fused_softmax.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/bert_padding.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory copying xformers/factory/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory copying xformers/factory/hydra_helper.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory copying xformers/factory/block_factory.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory copying xformers/factory/model_factory.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory copying xformers/factory/block_configs.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory copying xformers/factory/weight_init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/factory creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/global_tokens.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/ortho.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/blocksparse.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/local.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/compositional.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/pooling.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/_sputnik_sparse.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/core.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/lambda_layer.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/random.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/fourier_mix.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/scaled_dot_product.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/utils.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/attention_mask.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/linformer.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/attention_patterns.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/visual.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/sparsity_config.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/nystrom.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/favor.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/base.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/mlp.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/conv_mlp.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/fused_mlp.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/base.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/feedforward creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/vocab.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/param.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/sine.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/rotary.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/base.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/positional_embedding creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/softmax.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/base.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/components/attention/feature_maps creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/benchmarks/LRA/code creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/k_scaled_index_add.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/rope_padded_kernels.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/k_index_select_cat.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/rmsnorm_kernels.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/_triton creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/decoder.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/triton.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/dispatch.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/attn_bias.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/common.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/flash.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/small_k.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/cutlass.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/triton_splitk.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/ops/fmha creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/losses copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/losses copying xformers/_flash_attn/losses/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/losses creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/rotary.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/layers creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/pretrained.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/generation.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/benchmark.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/distributed.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/utils creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/bigcode.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gptj.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/opt.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/llama.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/vit.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/baichuan.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/bert.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/falcon.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gpt_neox.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gpt.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/models creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/activations.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/rms_norm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/embedding.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/mlp.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/block.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/mha.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/modules creating build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/cross_entropy.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/linear.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/k_activations.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/init.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/mlp.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/rotary.py -> build/lib.macosx-12.3-x86_64-cpython-310/xformers/_flash_attn/ops/triton running build_ext building 'xformers._C' extension creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310 creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/autograd creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu creating /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu Emitting ninja build file /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/build.ninja... Compiling objects... Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N) [1/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/attention.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/attention.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/attention.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/attention.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/attention.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/attention.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/attention.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [2/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/autograd/matmul.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/autograd/matmul.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/autograd/matmul.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/autograd/matmul.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/autograd/matmul.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/autograd/matmul.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/autograd/matmul.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [3/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/matmul.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/matmul.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/matmul.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/matmul.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/matmul.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/matmul.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/matmul.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [4/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/matmul.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/matmul.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/matmul.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/matmul.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/matmul.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/matmul.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/matmul.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [5/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/spmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/spmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/spmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/spmm.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/spmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/spmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/spmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [6/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sparse_softmax.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/sparse_softmax.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sparse_softmax.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sparse_softmax.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sparse_softmax.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/sparse_softmax.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sparse_softmax.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [7/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sddmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/sddmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sddmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sddmm.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sddmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/sddmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sddmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [8/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sddmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/sddmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sddmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sddmm.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sddmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/sddmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/sddmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [9/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/spmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/spmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/spmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/spmm.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/spmm.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/spmm.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/spmm.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [10/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_op.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/swiglu/swiglu_op.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_op.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_op.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_op.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/swiglu/swiglu_op.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_op.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [11/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sparse_softmax.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/sparse_softmax.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sparse_softmax.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sparse_softmax.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sparse_softmax.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/attention/cpu/sparse_softmax.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/attention/cpu/sparse_softmax.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' [12/12] c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_packedw.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/swiglu/swiglu_packedw.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_packedw.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 FAILED: /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_packedw.o c++ -MMD -MF /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_packedw.o.d -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include -I/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/TH -I/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/include/THC -I/Users/patgaw/repos/llm-guard/.venv/include -I/Users/patgaw/.pyenv/versions/3.10.4/include/python3.10 -c -c /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/xformers/csrc/swiglu/swiglu_packedw.cpp -o /private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/build/temp.macosx-12.3-x86_64-cpython-310/xformers/csrc/swiglu/swiglu_packedw.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_clang"' '-DPYBIND11_STDLIB="_libcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1002"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' ninja: build stopped: subcommand failed. Traceback (most recent call last): File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2100, in _run_ninja_build subprocess.run( File "/Users/patgaw/.pyenv/versions/3.10.4/lib/python3.10/subprocess.py", line 524, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

  The above exception was the direct cause of the following exception:

  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/setup.py", line 419, in <module>
      setuptools.setup(
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/__init__.py", line 103, in setup
      return distutils.core.setup(**attrs)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
      self.run_command(cmd)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/dist.py", line 989, in run_command
      super().run_command(command)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/wheel/bdist_wheel.py", line 369, in run
      self.run_command("build")
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/dist.py", line 989, in run_command
      super().run_command(command)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/command/build.py", line 131, in run
      self.run_command(cmd_name)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/dist.py", line 989, in run_command
      super().run_command(command)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 88, in run
      _build_ext.run(self)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
      self.build_extensions()
    File "/private/var/folders/s4/qk25j17n2zxfc1z52gcxfl580000gr/T/pip-install-supenarp/xformers_6999bca91381410982a2c5ef5915ce6a/setup.py", line 364, in build_extensions
      super().build_extensions()
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 873, in build_extensions
      build_ext.build_extensions(self)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
      self._build_extensions_serial()
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
      self.build_extension(ext)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 249, in build_extension
      _build_ext.build_extension(self, ext)
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
      objects = self.compiler.compile(
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 686, in unix_wrap_ninja_compile
      _write_ninja_file_and_compile_objects(
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
      _run_ninja_build(
    File "/Users/patgaw/repos/llm-guard/.venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2116, in _run_ninja_build
      raise RuntimeError(message) from e
  RuntimeError: Error compiling objects for extension
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for xformers Running setup.py clean for xformers`

asofter commented 12 months ago

Please share more information about the environment. I've seen something similar on AWS Graviton instance but it was solved by reinitiating virtual environment

arun-niranjan-bud commented 11 months ago

I have the same issue (I'm on MacOS), these are the commands I used which reproduce the problem:

python3 -m venv venv
source venv/bin/activate
pip install --upgrade pip
pip install torch // Doesn't make a difference running this or not!
pip install llm-guard

last command fails on the step Getting requirements to build wheel with the error: ModuleNotFoundError: No module named 'torch'

If I run pip show torch I get:

Name: torch
Version: 2.1.0
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /Users/.../venv/lib/python3.11/site-packages
Requires: filelock, fsspec, jinja2, networkx, sympy, typing-extensions

arun-niranjan-bud commented 11 months ago

As a follow up, I've verified that this error does not occur on linux (manjaro OS)

arun-niranjan-bud commented 11 months ago

Ok I think the missing step on Mac is to run pip install wheel before running pip install llm-guard, as per this Stack Overflow post. let me know if that works for you @okaypatrick?

I can now run llm-guard in native mode on MacOS (still no luck with the onnx runtime though, I've installed it but llm-guard refuses to use it, and it takes 1-5 seconds to perform a single prompt toxicity scan, whereas on my linux machine it takes 20ms)

asofter commented 11 months ago

Hey @arun-niranjan-bud , thanks for checking it. I will also mention it in the documentation.

On Mac with M1 processors, we rely on MPS device (Metal) instead of CPU thus, ONNX is disabled by default.

asofter commented 11 months ago

In our Dockerfile of API, we solved by installing torch using pip install torch. Locally, I use virtual environment on my Mac.

arun-niranjan-bud commented 11 months ago

I was also using a virtual environment on my Mac - I guess it's one of those python quirks as to which extra setup tools come across into the virtual environment when it's created.

arun-niranjan-bud commented 11 months ago

another thing to add - I was using Python 3.11.5, I believe the xformers error may still occur with Python 3.9

protectai / llm-guard

Error during package installation #36