search

Uminosachi / open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).
Apache License 2.0
39 stars 5 forks source link

build failed on Mac / M1 #8

Open alexng88 opened 1 year ago

alexng88 commented 1 year ago

Hello, I follow the instruction and run pip install -r requirememts_mac.txt. and it shows the error

Building wheels for collected packages: xformers Building wheel for xformers (setup.py) ... error error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [216 lines of output] running bdist_wheel /Users/development/opt/anaconda3/envs/ollm/lib/python3.10/site-packages/torch/utils/cpp_extension.py:476: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend. warnings.warn(msg.format('we could not find ninja.')) running build running build_py creating build creating build/lib.macosx-10.9-x86_64-cpython-310 creating build/lib.macosx-10.9-x86_64-cpython-310/xformers copying xformers/version.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers copying xformers/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers copying xformers/test.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers copying xformers/utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers copying xformers/_cpp_lib.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers copying xformers/info.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/fused_linear_layer.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/sum_strided.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_activations.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_layer_norm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_sum.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_fused_matmul_fw.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/dropout.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_dropout.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/softmax.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/layer_norm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_fused_matmul_bw.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton copying xformers/triton/k_softmax.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/triton creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/simplicial_embedding.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/residual.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/reversible.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/activations.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/multi_head_dispatch.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/input_projection.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components copying xformers/components/patch_embedding.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_nvfuser.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_indexing.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_mlp.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_stride_sum.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_transformer.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_revnet.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_encoder.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_pytorch_transformer.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_core.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops copying xformers/ops/swiglu_op.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops copying xformers/ops/unbind.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops copying xformers/ops/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops copying xformers/ops/common.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops copying xformers/ops/indexing.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/profiler copying xformers/profiler/device_limits.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/profiler copying xformers/profiler/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/profiler copying xformers/profiler/api.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/profiler copying xformers/profiler/slow_ops_profiler.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/profiler copying xformers/profiler/profiler.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/profiler creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/sparse copying xformers/sparse/_csr_ops.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/sparse copying xformers/sparse/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/sparse copying xformers/sparse/utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/sparse copying xformers/sparse/blocksparse_tensor.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/sparse copying xformers/sparse/csr_tensor.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/sparse creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/helpers copying xformers/helpers/test_utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/helpers copying xformers/helpers/hierarchical_configs.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/helpers copying xformers/helpers/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/helpers copying xformers/helpers/timm_sparse_attention.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/helpers creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/fused_softmax.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/bert_padding.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attention.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory copying xformers/factory/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory copying xformers/factory/hydra_helper.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory copying xformers/factory/block_factory.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory copying xformers/factory/model_factory.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory copying xformers/factory/block_configs.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory copying xformers/factory/weight_init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/factory creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/global_tokens.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/ortho.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/blocksparse.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/local.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/compositional.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/pooling.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/_sputnik_sparse.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/core.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/lambda_layer.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/random.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/fourier_mix.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/scaled_dot_product.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/attention_mask.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/linformer.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/attention_patterns.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/visual.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/sparsity_config.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/nystrom.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/favor.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention copying xformers/components/attention/base.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/mlp.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/conv_mlp.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/fused_mlp.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/base.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/feedforward creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/vocab.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/param.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/sine.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/rotary.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/base.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/positional_embedding creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/nvfuser copying xformers/components/nvfuser/bias_dropout_res_layernorm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/nvfuser copying xformers/components/nvfuser/bias_act_dropout.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/nvfuser copying xformers/components/nvfuser/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/nvfuser copying xformers/components/nvfuser/utils.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/nvfuser copying xformers/components/nvfuser/bias_dropout_res.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/nvfuser creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/softmax.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/base.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/components/attention/feature_maps creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/benchmarks/LRA/code creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/triton.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/dispatch.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/attn_bias.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/common.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/flash.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/small_k.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/cutlass.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/ops/fmha creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/losses copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/losses copying xformers/_flash_attn/losses/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/losses creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/rotary.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/layers creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/pretrained.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/generation.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/benchmark.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/distributed.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/utils creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gptj.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/opt.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/llama.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/vit.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/bert.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gpt_neox.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gpt.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/models creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/activations.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/rms_norm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/ops creating build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/embedding.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/init.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/mlp.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/block.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/mha.py -> build/lib.macosx-10.9-x86_64-cpython-310/xformers/_flash_attn/modules running build_ext building 'xformers._C' extension creating build/temp.macosx-10.9-x86_64-cpython-310 creating build/temp.macosx-10.9-x86_64-cpython-310/xformers creating build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc creating build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc/attention creating build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc/attention/autograd creating build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc/attention/cpu creating build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc/indexing creating build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc/swiglu clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /Users/development/opt/anaconda3/envs/ollm/include -fPIC -O2 -isystem /Users/development/opt/anaconda3/envs/ollm/include -I/private/var/folders/0m/fj0bcx4n16dd2snclpw414080000gn/T/pip-install-9pmf8iz7/xformers_fec6780c30d34980ba5c4acf372654b4/xformers/csrc -I/Users/development/opt/anaconda3/envs/ollm/lib/python3.10/site-packages/torch/include -I/Users/development/opt/anaconda3/envs/ollm/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/development/opt/anaconda3/envs/ollm/lib/python3.10/site-packages/torch/include/TH -I/Users/development/opt/anaconda3/envs/ollm/lib/python3.10/site-packages/torch/include/THC -I/Users/development/opt/anaconda3/envs/ollm/include/python3.10 -c xformers/csrc/attention/attention.cpp -o build/temp.macosx-10.9-x86_64-cpython-310/xformers/csrc/attention/attention.o -O3 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_clang\" -DPYBIND11_STDLIB=\"_libcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1002\" -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 clang: error: unsupported option '-fopenmp' error: command '/usr/bin/clang' failed with exit code 1 [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for xformers Running setup.py clean for xformers Failed to build xformers ERROR: Could not build wheels for xformers, which is required to install pyproject.toml-based projects

Uminosachi commented 1 year ago

In order to build xformers on an M1 Mac, you need to install some additional libraries, namely libomp and llvm. You can use the brew package manager to do this.

If you haven't installed Homebrew yet, install it:

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install.sh)"
echo 'export PATH="/opt/homebrew/bin:$PATH"' >> ~/.zshrc
echo 'export PATH="/opt/homebrew/sbin:$PATH"' >> ~/.zshrc
source ~/.zshrc

Install libomp:

arch -arm64 brew install libomp
echo 'export PATH="/opt/homebrew/opt/libomp/bin:$PATH"' >> ~/.zshrc
source ~/.zshrc

Install llvm:

arch -arm64 brew install llvm
echo 'export PATH="/opt/homebrew/opt/llvm/bin:$PATH"' >> ~/.zshrc
source ~/.zshrc
alexng88 commented 1 year ago

thanks it works! How can we download another model? for example if i want to add llama2 how can we add?

thanks

Uminosachi commented 1 year ago

I am considering adding Llama2 to the list in ollm_model_ids within ollm_app.py. However, to download the Llama2 model, one needs to obtain prior access from Meta AI, so this might take some time.

You can try Llama2 on the following demo site:

https://huggingface.co/spaces/ysharma/Explore_llamav2_with_TGI

AbdulwahabDev commented 2 months ago

hi @Uminosachi
facing same error with M1

pip freeze accelerate==0.33.0 aiohappyeyeballs==2.3.7 aiohttp==3.10.4 aiosignal==1.3.1 annotated-types==0.7.0 anyio==4.4.0 appnope==0.1.4 argon2-cffi==23.1.0 argon2-cffi-bindings==21.2.0 arrow==1.3.0 asttokens==2.4.1 async-lru==2.0.4 async-timeout==4.0.3 attrs==24.2.0 babel==2.16.0 beautifulsoup4==4.12.3 bitsandbytes==0.42.0 bleach==6.1.0 build==1.2.1 certifi==2024.7.4 cffi==1.17.0 charset-normalizer==3.3.2 click==8.1.7 comm==0.2.2 contourpy==1.2.1 cycler==0.12.1 dacite==1.8.1 dataclasses-json==0.6.7 datasets==2.21.0 debugpy==1.8.5 decorator==5.1.1 defusedxml==0.7.1 dill==0.3.8 distro==1.9.0 exceptiongroup==1.2.2 executing==2.0.1 faiss-cpu==1.8.0.post1 fastapi==0.112.1 fastjsonschema==2.20.0 filelock==3.15.4 fonttools==4.53.1 fqdn==1.5.1 frozenlist==1.4.1 fsspec==2024.6.1 grpcio==1.65.5 grpcio-tools==1.65.5 h11==0.14.0 h2==4.1.0 hpack==4.0.0 htmlmin==0.1.12 httpcore==1.0.5 httpx==0.27.0 huggingface-hub==0.24.5 hyperframe==6.0.1 idna==3.7 ImageHash==4.3.1 ipykernel==6.29.5 ipython==8.26.0 isoduration==20.11.0 jedi==0.19.1 Jinja2==3.1.4 jiter==0.5.0 joblib==1.4.2 json5==0.9.25 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.23.0 jsonschema-specifications==2023.12.1 jupyter-events==0.10.0 jupyter-lsp==2.2.5 jupyter_client==8.6.2 jupyter_core==5.7.2 jupyter_server==2.14.2 jupyter_server_terminals==0.5.3 jupyterlab==4.2.4 jupyterlab_pygments==0.3.0 jupyterlab_server==2.27.3 kiwisolver==1.4.5 langchain==0.2.14 langchain-community==0.2.12 langchain-core==0.2.33 langchain-text-splitters==0.2.2 langsmith==0.1.99 llvmlite==0.43.0 MarkupSafe==2.1.5 marshmallow==3.21.3 matplotlib==3.9.2 matplotlib-inline==0.1.7 mistune==3.0.2 mpmath==1.3.0 multidict==6.0.5 multimethod==1.12 multiprocess==0.70.16 mypy-extensions==1.0.0 nbclient==0.10.0 nbconvert==7.16.4 nbformat==5.10.4 nest-asyncio==1.6.0 networkx==3.3 notebook==7.2.1 notebook_shim==0.2.4 numba==0.60.0 numpy==1.26.4 openai==1.41.0 orjson==3.10.7 overrides==7.7.0 packaging==24.1 pandas==2.2.2 pandocfilters==1.5.1 parso==0.8.4 patsy==0.5.6 peft==0.12.0 pexpect==4.9.0 phik==0.12.4 pillow==10.4.0 pip-tools==7.4.1 platformdirs==4.2.2 portalocker==2.10.1 prometheus_client==0.20.0 prompt_toolkit==3.0.47 protobuf==5.27.3 psutil==6.0.0 ptyprocess==0.7.0 pure_eval==0.2.3 pyarrow==17.0.0 pycparser==2.22 pydantic==2.8.2 pydantic_core==2.20.1 Pygments==2.18.0 pyparsing==3.1.2 pyproject_hooks==1.1.0 python-dateutil==2.9.0.post0 python-json-logger==2.0.7 pytz==2024.1 PyWavelets==1.7.0 PyYAML==6.0.2 pyzmq==26.1.0 qdrant-client==1.11.0 referencing==0.35.1 regex==2024.7.24 requests==2.32.3 rfc3339-validator==0.1.4 rfc3986-validator==0.1.1 rpds-py==0.20.0 safetensors==0.4.4 scikit-learn==1.5.1 scipy==1.13.1 seaborn==0.13.2 Send2Trash==1.8.3 sentence-transformers==3.0.1 six==1.16.0 sniffio==1.3.1 soupsieve==2.6 SQLAlchemy==2.0.32 stack-data==0.6.3 starlette==0.38.2 statsmodels==0.14.2 sympy==1.13.2 tenacity==8.5.0 terminado==0.18.1 threadpoolctl==3.5.0 tinycss2==1.3.0 tokenizers==0.19.1 tomli==2.0.1 torch==2.4.0 tornado==6.4.1 tqdm==4.66.5 traitlets==5.14.3 transformers==4.44.0 typeguard==4.3.0 types-python-dateutil==2.9.0.20240316 typing-inspect==0.9.0 typing_extensions==4.12.2 tzdata==2024.1 uri-template==1.3.0 urllib3==2.2.2 uvicorn==0.30.6 visions==0.7.6 wcwidth==0.2.13 webcolors==24.8.0 webencodings==0.5.1 websocket-client==1.8.0 wordcloud==1.9.3 XlsxWriter==3.2.0 xxhash==3.5.0 yarl==1.9.4 ydata-profiling==4.9.0 
libomp 18.1.8 is already installed and up-to-date.
llvm 18.1.8 is already installed and up-to-date.
pip install xformers error Collecting xformers Using cached xformers-0.0.27.post2.tar.gz (4.4 MB) Preparing metadata (setup.py) ... done Requirement already satisfied: torch>=2.2 in ./.env/lib/python3.10/site-packages (from xformers) (2.4.0) Requirement already satisfied: numpy in ./.env/lib/python3.10/site-packages (from xformers) (1.26.4) Requirement already satisfied: filelock in ./.env/lib/python3.10/site-packages (from torch>=2.2->xformers) (3.15.4) Requirement already satisfied: typing-extensions>=4.8.0 in ./.env/lib/python3.10/site-packages (from torch>=2.2->xformers) (4.12.2) Requirement already satisfied: sympy in ./.env/lib/python3.10/site-packages (from torch>=2.2->xformers) (1.13.2) Requirement already satisfied: networkx in ./.env/lib/python3.10/site-packages (from torch>=2.2->xformers) (3.3) Requirement already satisfied: jinja2 in ./.env/lib/python3.10/site-packages (from torch>=2.2->xformers) (3.1.4) Requirement already satisfied: fsspec in ./.env/lib/python3.10/site-packages (from torch>=2.2->xformers) (2024.6.1) Requirement already satisfied: MarkupSafe>=2.0 in ./.env/lib/python3.10/site-packages (from jinja2->torch>=2.2->xformers) (2.1.5) Requirement already satisfied: mpmath<1.4,>=1.1.0 in ./.env/lib/python3.10/site-packages (from sympy->torch>=2.2->xformers) (1.3.0) Building wheels for collected packages: xformers Building wheel for xformers (setup.py) ... error error: subprocess-exited-with-error × python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [232 lines of output] running bdist_wheel /Users/abdulwahabmac/Desktop/MyFiles/Projects/Training/Tuwaiq/LLM_App_With_Fine_tuning/.env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:495: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend. warnings.warn(msg.format('we could not find ninja.')) running build running build_py creating build creating build/lib.macosx-14-arm64-cpython-310 creating build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/_deprecation_warning.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/attn_bias_utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/checkpoint.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/test.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/_cpp_lib.py -> build/lib.macosx-14-arm64-cpython-310/xformers copying xformers/info.py -> build/lib.macosx-14-arm64-cpython-310/xformers creating build/lib.macosx-14-arm64-cpython-310/xformers/triton copying xformers/triton/vararg_kernel.py -> build/lib.macosx-14-arm64-cpython-310/xformers/triton copying xformers/triton/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/triton creating build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/simplicial_embedding.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/residual.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/reversible.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/activations.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/multi_head_dispatch.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/input_projection.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components copying xformers/components/patch_embedding.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components creating build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_indexing.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_revnet.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_merge_attentions.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_tiled_matmul.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_attn_decoding.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_sequence_parallel_fused.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_sp24.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks copying xformers/benchmarks/benchmark_core.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks creating build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/rmsnorm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/modpar_layers.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/swiglu_op.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/unbind.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/rope_padded.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/seqpar.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/ipc.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/sequence_parallel_fused_ops.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/sp24.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/common.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/differentiable_collectives.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/tiled_matmul.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops copying xformers/ops/indexing.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops creating build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/device_limits.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/find_slowest.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/profiler_dcgm_impl.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/profiler_dcgm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/api.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/slow_ops_profiler.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/profile_analyzer.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler copying xformers/profiler/profiler.py -> build/lib.macosx-14-arm64-cpython-310/xformers/profiler creating build/lib.macosx-14-arm64-cpython-310/xformers/sparse copying xformers/sparse/_csr_ops.py -> build/lib.macosx-14-arm64-cpython-310/xformers/sparse copying xformers/sparse/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/sparse copying xformers/sparse/utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers/sparse copying xformers/sparse/blocksparse_tensor.py -> build/lib.macosx-14-arm64-cpython-310/xformers/sparse copying xformers/sparse/csr_tensor.py -> build/lib.macosx-14-arm64-cpython-310/xformers/sparse creating build/lib.macosx-14-arm64-cpython-310/xformers/helpers copying xformers/helpers/test_utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers/helpers copying xformers/helpers/hierarchical_configs.py -> build/lib.macosx-14-arm64-cpython-310/xformers/helpers copying xformers/helpers/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/helpers copying xformers/helpers/timm_sparse_attention.py -> build/lib.macosx-14-arm64-cpython-310/xformers/helpers creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/fused_softmax.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/bert_padding.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn creating build/lib.macosx-14-arm64-cpython-310/xformers/factory copying xformers/factory/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/factory copying xformers/factory/hydra_helper.py -> build/lib.macosx-14-arm64-cpython-310/xformers/factory copying xformers/factory/block_factory.py -> build/lib.macosx-14-arm64-cpython-310/xformers/factory copying xformers/factory/model_factory.py -> build/lib.macosx-14-arm64-cpython-310/xformers/factory copying xformers/factory/block_configs.py -> build/lib.macosx-14-arm64-cpython-310/xformers/factory copying xformers/factory/weight_init.py -> build/lib.macosx-14-arm64-cpython-310/xformers/factory creating build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/global_tokens.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/ortho.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/blocksparse.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/local.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/compositional.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/pooling.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/_sputnik_sparse.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/core.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/lambda_layer.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/random.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/fourier_mix.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/scaled_dot_product.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/utils.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/attention_mask.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/linformer.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/attention_patterns.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/visual.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/sparsity_config.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/nystrom.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/favor.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention copying xformers/components/attention/base.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention creating build/lib.macosx-14-arm64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/mlp.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/conv_mlp.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/feedforward copying xformers/components/feedforward/base.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/feedforward creating build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/vocab.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/param.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/sine.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/rotary.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding copying xformers/components/positional_embedding/base.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/positional_embedding creating build/lib.macosx-14-arm64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/softmax.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention/feature_maps copying xformers/components/attention/feature_maps/base.py -> build/lib.macosx-14-arm64-cpython-310/xformers/components/attention/feature_maps creating build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA creating build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA/code copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.macosx-14-arm64-cpython-310/xformers/benchmarks/LRA/code creating build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/k_scaled_index_add.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/rope_padded_kernels.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/sequence_parallel_fused_kernels.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/tiled_matmul_kernels.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/k_index_select_cat.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton copying xformers/ops/_triton/rmsnorm_kernels.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/_triton creating build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/decoder.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/dispatch.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/attn_bias.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/ck.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/common.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/torch_attention_compat.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/ck_decoder.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/flash.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/small_k.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/cutlass.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/ck_splitk.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha copying xformers/ops/fmha/triton_splitk.py -> build/lib.macosx-14-arm64-cpython-310/xformers/ops/fmha creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/losses copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/losses copying xformers/_flash_attn/losses/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/losses creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/layers copying xformers/_flash_attn/layers/rotary.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/layers creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/pretrained.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/generation.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/benchmark.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/utils copying xformers/_flash_attn/utils/distributed.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/utils creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/bigcode.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gptj.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/opt.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/llama.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/vit.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/btlm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/baichuan.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/bert.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/falcon.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gpt_neox.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models copying xformers/_flash_attn/models/gpt.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/models creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/activations.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/rms_norm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/embedding.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/mlp.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/block.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/modules copying xformers/_flash_attn/modules/mha.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/modules creating build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/cross_entropy.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/linear.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/k_activations.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/__init__.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/mlp.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/rotary.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton copying xformers/_flash_attn/ops/triton/layer_norm.py -> build/lib.macosx-14-arm64-cpython-310/xformers/_flash_attn/ops/triton running build_ext building 'xformers._C' extension creating build/temp.macosx-14-arm64-cpython-310 creating build/temp.macosx-14-arm64-cpython-310/xformers creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc/attention creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc/attention/autograd creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc/attention/cpu creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc/sequence_parallel_fused creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc/sparse24 creating build/temp.macosx-14-arm64-cpython-310/xformers/csrc/swiglu clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX14.sdk -I/private/var/folders/hq/scvbwj_55y366k5jlzy80rx40000gn/T/pip-install-xbl9dk4u/xformers_03967e9f1f4042ada42ab0669198b16c/xformers/csrc -I/Users/abdulwahabmac/Desktop/MyFiles/Projects/Training/Tuwaiq/LLM_App_With_Fine_tuning/.env/lib/python3.10/site-packages/torch/include -I/Users/abdulwahabmac/Desktop/MyFiles/Projects/Training/Tuwaiq/LLM_App_With_Fine_tuning/.env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/Users/abdulwahabmac/Desktop/MyFiles/Projects/Training/Tuwaiq/LLM_App_With_Fine_tuning/.env/lib/python3.10/site-packages/torch/include/TH -I/Users/abdulwahabmac/Desktop/MyFiles/Projects/Training/Tuwaiq/LLM_App_With_Fine_tuning/.env/lib/python3.10/site-packages/torch/include/THC -I/Users/abdulwahabmac/Desktop/MyFiles/Projects/Training/Tuwaiq/LLM_App_With_Fine_tuning/.env/include -I/opt/homebrew/opt/python@3.10/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c xformers/csrc/attention/attention.cpp -o build/temp.macosx-14-arm64-cpython-310/xformers/csrc/attention/attention.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_clang\" -DPYBIND11_STDLIB=\"_libcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1002\" -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 clang: error: unsupported option '-fopenmp' error: command '/usr/bin/clang' failed with exit code 1 [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for xformers Running setup.py clean for xformers Failed to build xformers ERROR: Could not build wheels for xformers, which is required to install pyproject.toml-based projects

Any help :(

Uminosachi commented 2 months ago

As commented out in requirements.txt, xformers is not necessary for the operation of this web application.