search

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.5k stars 5.31k forks source link

It stopped working on Intel MacOS 12 #4246

Closed estebanavv closed 10 months ago

estebanavv commented 1 year ago

Describe the bug

Last week after updating it stopped working opted for a reinstall.

At the end of the installation there are warnings and errors.

  Attempting uninstall: tiktoken
    Found existing installation: tiktoken 0.3.3
    Uninstalling tiktoken-0.3.3:
      Successfully uninstalled tiktoken-0.3.3
  Attempting uninstall: flask_cloudflared
    Found existing installation: flask-cloudflared 0.0.14
    Uninstalling flask-cloudflared-0.0.14:
      Successfully uninstalled flask-cloudflared-0.0.14
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
openai-whisper 20230918 requires tiktoken==0.3.3, but you have tiktoken 0.5.1 which is incompatible.
Ignoring bitsandbytes: markers 'platform_system == "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0"' don't match your environment
ERROR: llama_cpp_python-0.2.11-cp310-cp310-macosx_12_0_x86_64.whl is not a supported wheel on this platform.
Command '. "/Users/esteban/localDocs/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/esteban/localDocs/text-generation-webui/installer_files/env" && python -m pip install -r temp_requirements.txt --upgrade' failed with exit status code '1'.

Exiting now.
Try running the start/update script again.

Then when attempting to execute I get this error.

➜  text-generation-webui git:(main) ✗ ./start_macos.sh 

*******************************************************************
* WARNING: You haven't downloaded any model yet.
* Once the web UI launches, head over to the "Model" tab and download one.
*******************************************************************

Traceback (most recent call last):
  File "/Users/esteban/localDocs/text-generation-webui/server.py", line 13, in <module>
    import gradio as gr
ModuleNotFoundError: No module named 'gradio'```

### Is there an existing issue for this?

- [X] I have searched the existing issues

### Reproduction

Install in a MacOS12 Intel

### Screenshot

_No response_

### Logs

```shell
➜  text-generation-webui git:(main) ✗ ./start_macos.sh 
Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.3.1-0-MacOSX-x86_64.sh to /Users/esteban/localDocs/text-generation-webui/installer_files/miniconda_installer.sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 44.0M  100 44.0M    0     0  9405k      0  0:00:04  0:00:04 --:--:--  9.7M
PREFIX=/Users/esteban/localDocs/text-generation-webui/installer_files/conda
Unpacking payload ...

Installing base environment...

Downloading and Extracting Packages

Downloading and Extracting Packages

Preparing transaction: done
Executing transaction: - 
done
installation finished.
Miniconda version:
conda 23.3.1
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 23.9.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.9.0

## Package Plan ##

  environment location: /Users/esteban/localDocs/text-generation-webui/installer_files/env

  added / updated specs:
    - python=3.10

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ca-certificates-2023.08.22 |       hecd8cb5_0         124 KB
    libffi-3.4.4               |       hecd8cb5_0         132 KB
    openssl-3.0.11             |       hca72f7f_2         4.5 MB
    pip-23.2.1                 |  py310hecd8cb5_0         2.7 MB
    python-3.10.13             |       h5ee71fb_0        13.1 MB
    setuptools-68.0.0          |  py310hecd8cb5_0         955 KB
    sqlite-3.41.2              |       h6c40b1e_0         1.2 MB
    wheel-0.41.2               |  py310hecd8cb5_0         110 KB
    xz-5.4.2                   |       h6c40b1e_0         372 KB
    ------------------------------------------------------------
                                           Total:        23.1 MB

The following NEW packages will be INSTALLED:

  bzip2              pkgs/main/osx-64::bzip2-1.0.8-h1de35cc_0 
  ca-certificates    pkgs/main/osx-64::ca-certificates-2023.08.22-hecd8cb5_0 
  libffi             pkgs/main/osx-64::libffi-3.4.4-hecd8cb5_0 
  ncurses            pkgs/main/osx-64::ncurses-6.4-hcec6c5f_0 
  openssl            pkgs/main/osx-64::openssl-3.0.11-hca72f7f_2 
  pip                pkgs/main/osx-64::pip-23.2.1-py310hecd8cb5_0 
  python             pkgs/main/osx-64::python-3.10.13-h5ee71fb_0 
  readline           pkgs/main/osx-64::readline-8.2-hca72f7f_0 
  setuptools         pkgs/main/osx-64::setuptools-68.0.0-py310hecd8cb5_0 
  sqlite             pkgs/main/osx-64::sqlite-3.41.2-h6c40b1e_0 
  tk                 pkgs/main/osx-64::tk-8.6.12-h5d9f67b_0 
  tzdata             pkgs/main/noarch::tzdata-2023c-h04d1e81_0 
  wheel              pkgs/main/osx-64::wheel-0.41.2-py310hecd8cb5_0 
  xz                 pkgs/main/osx-64::xz-5.4.2-h6c40b1e_0 
  zlib               pkgs/main/osx-64::zlib-1.2.13-h4dc903c_0 

Downloading and Extracting Packages

Preparing transaction: done                                                                                                                                                                                                                                
Verifying transaction: done                                                                                                                                                                                                                                
Executing transaction: done                                                                                                                                                                                                                                
#                                                                                                                                                                                                                                                          
# To activate this environment, use                                                                                                                                                                                                                        
#                                                                                                                                                                                                                                                          
#     $ conda activate /Users/esteban/localDocs/text-generation-webui/installer_files/env                                                                                                                                                                  
#                                                                                                                                                                                                                                                          
# To deactivate an active environment, use
#
#     $ conda deactivate

What is your GPU?

A) NVIDIA
B) AMD (Linux/MacOS only. Requires ROCm SDK 5.6 on Linux)
C) Apple M Series
D) Intel Arc (IPEX)
N) None (I want to run models in CPU mode)

Input> B
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 23.9.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.9.0

## Package Plan ##

  environment location: /Users/esteban/localDocs/text-generation-webui/installer_files/env

  added / updated specs:
    - git
    - ninja

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    c-ares-1.19.1              |       h6c40b1e_0         107 KB
    curl-8.2.1                 |       h04015c4_0          78 KB
    expat-2.5.0                |       hcec6c5f_0         140 KB
    gdbm-1.18                  |       hdccc71a_4         142 KB
    gettext-0.21.0             |       he85b6c0_1         3.0 MB
    git-2.40.1                 | pl5340hb824c65_1         8.7 MB
    icu-73.1                   |       hcec6c5f_0        25.1 MB
    krb5-1.20.1                |       h428f121_1         1.2 MB
    libcurl-8.2.1              |       hf20ceda_0         361 KB
    libcxx-14.0.6              |       h9765a3e_0         968 KB
    libedit-3.1.20221030       |       h6c40b1e_0         155 KB
    libev-4.33                 |       h9ed2024_1         106 KB
    libiconv-1.16              |       hca72f7f_2         695 KB
    libnghttp2-1.52.0          |       h9beae6a_1         662 KB
    libssh2-1.10.0             |       h04015c4_2         274 KB
    libxml2-2.10.4             |       h1bd7e62_1         665 KB
    llvm-openmp-14.0.6         |       h0dcd299_0         288 KB
    ninja-1.10.2               |       hecd8cb5_5           9 KB
    ninja-base-1.10.2          |       haf03e11_5         118 KB
    pcre2-10.42                |       h9b97e30_0         1.3 MB
    perl-5.34.0                |       h435f0c2_2        15.0 MB
    ------------------------------------------------------------
                                           Total:        58.9 MB

The following NEW packages will be INSTALLED:

  c-ares             pkgs/main/osx-64::c-ares-1.19.1-h6c40b1e_0 
  curl               pkgs/main/osx-64::curl-8.2.1-h04015c4_0 
  expat              pkgs/main/osx-64::expat-2.5.0-hcec6c5f_0 
  gdbm               pkgs/main/osx-64::gdbm-1.18-hdccc71a_4 
  gettext            pkgs/main/osx-64::gettext-0.21.0-he85b6c0_1 
  git                pkgs/main/osx-64::git-2.40.1-pl5340hb824c65_1 
  icu                pkgs/main/osx-64::icu-73.1-hcec6c5f_0 
  krb5               pkgs/main/osx-64::krb5-1.20.1-h428f121_1 
  libcurl            pkgs/main/osx-64::libcurl-8.2.1-hf20ceda_0 
  libcxx             pkgs/main/osx-64::libcxx-14.0.6-h9765a3e_0 
  libedit            pkgs/main/osx-64::libedit-3.1.20221030-h6c40b1e_0 
  libev              pkgs/main/osx-64::libev-4.33-h9ed2024_1 
  libiconv           pkgs/main/osx-64::libiconv-1.16-hca72f7f_2 
  libnghttp2         pkgs/main/osx-64::libnghttp2-1.52.0-h9beae6a_1 
  libssh2            pkgs/main/osx-64::libssh2-1.10.0-h04015c4_2 
  libxml2            pkgs/main/osx-64::libxml2-2.10.4-h1bd7e62_1 
  llvm-openmp        pkgs/main/osx-64::llvm-openmp-14.0.6-h0dcd299_0 
  ninja              pkgs/main/osx-64::ninja-1.10.2-hecd8cb5_5 
  ninja-base         pkgs/main/osx-64::ninja-base-1.10.2-haf03e11_5 
  pcre2              pkgs/main/osx-64::pcre2-10.42-h9b97e30_0 
  perl               pkgs/main/osx-64::perl-5.34.0-h435f0c2_2 

Downloading and Extracting Packages

Preparing transaction: done                                                                                                                                                                                                                                
Verifying transaction: done                                                                                                                                                                                                                                
Executing transaction: done                                                                                                                                                                                                                                
Collecting torch                                                                                                                                                                                                                                           
  Obtaining dependency information for torch from https://files.pythonhosted.org/packages/67/d8/98b2836bd83707ecf27d66587fab9dedcfe746efab775042b93cd146d027/torch-2.1.0-cp310-none-macosx_10_9_x86_64.whl.metadata                                        
  Using cached torch-2.1.0-cp310-none-macosx_10_9_x86_64.whl.metadata (24 kB)                                                                                                                                                                              
Collecting torchvision                                                                                                                                                                                                                                     
  Obtaining dependency information for torchvision from https://files.pythonhosted.org/packages/76/89/0cdc6f497cbbb83dd51804cd4f788b7f5bd529f07b5417b50fe9c5655b76/torchvision-0.16.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata                         
  Using cached torchvision-0.16.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata (6.6 kB)                                                                                                                                                                    
Collecting torchaudio                                                                                                                                                                                                                                      
  Obtaining dependency information for torchaudio from https://files.pythonhosted.org/packages/03/ae/535192c2b9c53290d44d89d1267083c79663b5cf2fbfe13ccc28709d80d4/torchaudio-2.1.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata                            
  Using cached torchaudio-2.1.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata (5.7 kB)                                                                                                                                                                      
Collecting filelock (from torch)                                                                                                                                                                                                                           
  Obtaining dependency information for filelock from https://files.pythonhosted.org/packages/5e/5d/97afbafd9d584ff1b45fcb354a479a3609bd97f912f8f1f6c563cb1fae21/filelock-3.12.4-py3-none-any.whl.metadata                                                  
  Using cached filelock-3.12.4-py3-none-any.whl.metadata (2.8 kB)                                                                                                                                                                                          
Collecting typing-extensions (from torch)                                                                                                                                                                                                                  
  Obtaining dependency information for typing-extensions from https://files.pythonhosted.org/packages/24/21/7d397a4b7934ff4028987914ac1044d3b7d52712f30e2ac7a2ae5bc86dd0/typing_extensions-4.8.0-py3-none-any.whl.metadata                                 
  Using cached typing_extensions-4.8.0-py3-none-any.whl.metadata (3.0 kB)                                                                                                                                                                                  
Collecting sympy (from torch)                                                                                                                                                                                                                              
  Using cached sympy-1.12-py3-none-any.whl (5.7 MB)                                                                                                                                                                                                        
Collecting networkx (from torch)
  Using cached networkx-3.1-py3-none-any.whl (2.1 MB)
Collecting jinja2 (from torch)
  Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting fsspec (from torch)
  Obtaining dependency information for fsspec from https://files.pythonhosted.org/packages/fe/d3/e1aa96437d944fbb9cc95d0316e25583886e9cd9e6adc07baad943524eda/fsspec-2023.9.2-py3-none-any.whl.metadata
  Using cached fsspec-2023.9.2-py3-none-any.whl.metadata (6.7 kB)
Collecting numpy (from torchvision)
  Obtaining dependency information for numpy from https://files.pythonhosted.org/packages/be/f8/034752c5131c46e10364e4db241974f2eb6bb31bbfc4335344c19e17d909/numpy-1.26.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numpy-1.26.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (53 kB)
Collecting requests (from torchvision)
  Obtaining dependency information for requests from https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl.metadata
  Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision)
  Obtaining dependency information for pillow!=8.3.*,>=5.3.0 from https://files.pythonhosted.org/packages/8c/34/4e02804420b1cd9371ce5f7c0da7024a8450e6b092c336d3233d6c6448d9/Pillow-10.0.1-cp310-cp310-macosx_10_10_x86_64.whl.metadata
  Using cached Pillow-10.0.1-cp310-cp310-macosx_10_10_x86_64.whl.metadata (9.5 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch)
  Obtaining dependency information for MarkupSafe>=2.0 from https://files.pythonhosted.org/packages/f7/9c/86cbd8e0e1d81f0ba420f20539dd459c50537c7751e28102dbfee2b6f28c/MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests->torchvision)
  Obtaining dependency information for charset-normalizer<4,>=2 from https://files.pythonhosted.org/packages/5f/b3/7f69cf4d4f18b6c058c928da0853a44e4804359a617e57402709e82f1fdd/charset_normalizer-3.3.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached charset_normalizer-3.3.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (32 kB)
Collecting idna<4,>=2.5 (from requests->torchvision)
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->torchvision)
  Obtaining dependency information for urllib3<3,>=1.21.1 from https://files.pythonhosted.org/packages/26/40/9957270221b6d3e9a3b92fdfba80dd5c9661ff45a664b47edd5d00f707f5/urllib3-2.0.6-py3-none-any.whl.metadata
  Using cached urllib3-2.0.6-py3-none-any.whl.metadata (6.6 kB)
Collecting certifi>=2017.4.17 (from requests->torchvision)
  Obtaining dependency information for certifi>=2017.4.17 from https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl.metadata
  Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting mpmath>=0.19 (from sympy->torch)
  Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Using cached torch-2.1.0-cp310-none-macosx_10_9_x86_64.whl (147.0 MB)
Using cached torchvision-0.16.0-cp310-cp310-macosx_10_13_x86_64.whl (1.7 MB)
Using cached torchaudio-2.1.0-cp310-cp310-macosx_10_13_x86_64.whl (3.4 MB)
Using cached Pillow-10.0.1-cp310-cp310-macosx_10_10_x86_64.whl (3.7 MB)
Using cached filelock-3.12.4-py3-none-any.whl (11 kB)
Using cached fsspec-2023.9.2-py3-none-any.whl (173 kB)
Using cached numpy-1.26.0-cp310-cp310-macosx_10_9_x86_64.whl (20.6 MB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached charset_normalizer-3.3.0-cp310-cp310-macosx_10_9_x86_64.whl (119 kB)
Using cached MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl (13 kB)
Using cached urllib3-2.0.6-py3-none-any.whl (123 kB)
Installing collected packages: mpmath, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, fsspec, filelock, charset-normalizer, certifi, requests, jinja2, torch, torchvision, torchaudio
Successfully installed MarkupSafe-2.1.3 certifi-2023.7.22 charset-normalizer-3.3.0 filelock-3.12.4 fsspec-2023.9.2 idna-3.4 jinja2-3.1.2 mpmath-1.3.0 networkx-3.1 numpy-1.26.0 pillow-10.0.1 requests-2.31.0 sympy-1.12 torch-2.1.0 torchaudio-2.1.0 torchvision-0.16.0 typing-extensions-4.8.0 urllib3-2.0.6
Collecting py-cpuinfo==9.0.0
  Using cached py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Installing collected packages: py-cpuinfo
Successfully installed py-cpuinfo-9.0.0
Enter passphrase for key '/Users/esteban/.ssh/id_rsa': 
Already up to date.

*******************************************************************
* Installing extensions requirements.
*******************************************************************

Collecting ngrok==0.* (from -r extensions/ngrok/requirements.txt (line 1))
  Obtaining dependency information for ngrok==0.* from https://files.pythonhosted.org/packages/36/36/67609b956c839446c7787c359f6cb29cc07db3ab55092406f51e87faded1/ngrok-0.11.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.metadata
  Using cached ngrok-0.11.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.metadata (16 kB)
Using cached ngrok-0.11.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (5.0 MB)
Installing collected packages: ngrok
Successfully installed ngrok-0.11.0
Collecting elevenlabs==0.2.24 (from -r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for elevenlabs==0.2.24 from https://files.pythonhosted.org/packages/69/7e/6929391760fd37cc620bcd10850724844255fe551fb9554083ebcf0790fd/elevenlabs-0.2.24-py3-none-any.whl.metadata
  Using cached elevenlabs-0.2.24-py3-none-any.whl.metadata (811 bytes)
Collecting pydantic<2.0,>=1.10 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for pydantic<2.0,>=1.10 from https://files.pythonhosted.org/packages/e3/39/c866689ef73ca39c4efc314fa751397ae15ee085632086383fefec8600c0/pydantic-1.10.13-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached pydantic-1.10.13-cp310-cp310-macosx_10_9_x86_64.whl.metadata (149 kB)
Collecting ipython>=7.0 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for ipython>=7.0 from https://files.pythonhosted.org/packages/ef/02/fc039fca3ec40a00f962eb6e9da45c507334b0650a3cb9facd38d234fb7a/ipython-8.16.1-py3-none-any.whl.metadata
  Using cached ipython-8.16.1-py3-none-any.whl.metadata (5.9 kB)
Requirement already satisfied: requests>=2.20 in ./installer_files/env/lib/python3.10/site-packages (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.31.0)
Collecting websockets>=11.0 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached websockets-11.0.3-cp310-cp310-macosx_10_9_x86_64.whl (120 kB)
Collecting backcall (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting decorator (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting jedi>=0.16 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for jedi>=0.16 from https://files.pythonhosted.org/packages/20/9f/bc63f0f0737ad7a60800bfd472a4836661adae21f9c2535f3957b1e54ceb/jedi-0.19.1-py2.py3-none-any.whl.metadata
  Using cached jedi-0.19.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting matplotlib-inline (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB)
Collecting pickleshare (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 from https://files.pythonhosted.org/packages/a9/b4/ba77c84edf499877317225d7b7bc047a81f7c2eed9628eeb6bab0ac2e6c9/prompt_toolkit-3.0.39-py3-none-any.whl.metadata
  Using cached prompt_toolkit-3.0.39-py3-none-any.whl.metadata (6.4 kB)
Collecting pygments>=2.4.0 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for pygments>=2.4.0 from https://files.pythonhosted.org/packages/43/88/29adf0b44ba6ac85045e63734ae0997d3c58d8b1a91c914d240828d0d73d/Pygments-2.16.1-py3-none-any.whl.metadata
  Using cached Pygments-2.16.1-py3-none-any.whl.metadata (2.5 kB)
Collecting stack-data (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for stack-data from https://files.pythonhosted.org/packages/f1/7b/ce1eafaf1a76852e2ec9b22edecf1daa58175c090266e9f6c64afcd81d91/stack_data-0.6.3-py3-none-any.whl.metadata
  Using cached stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)
Collecting traitlets>=5 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for traitlets>=5 from https://files.pythonhosted.org/packages/85/e9/d82415708306eb348fb16988c4697076119dfbfa266f17f74e514a23a723/traitlets-5.11.2-py3-none-any.whl.metadata
  Using cached traitlets-5.11.2-py3-none-any.whl.metadata (10 kB)
Collecting exceptiongroup (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for exceptiongroup from https://files.pythonhosted.org/packages/ad/83/b71e58666f156a39fb29417e4c8ca4bc7400c0dd4ed9e8842ab54dc8c344/exceptiongroup-1.1.3-py3-none-any.whl.metadata
  Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB)
Collecting pexpect>4.3 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
Collecting appnope (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached appnope-0.1.3-py2.py3-none-any.whl (4.4 kB)
Requirement already satisfied: typing-extensions>=4.2.0 in ./installer_files/env/lib/python3.10/site-packages (from pydantic<2.0,>=1.10->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (4.8.0)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2023.7.22)
Collecting parso<0.9.0,>=0.8.3 (from jedi>=0.16->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)
Collecting ptyprocess>=0.5 (from pexpect>4.3->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting wcwidth (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for wcwidth from https://files.pythonhosted.org/packages/58/19/a9ce39f89cf58cf1e7ce01c8bb76ab7e2c7aadbc5a2136c3e192097344f5/wcwidth-0.2.8-py2.py3-none-any.whl.metadata
  Using cached wcwidth-0.2.8-py2.py3-none-any.whl.metadata (13 kB)
Collecting executing>=1.2.0 (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for executing>=1.2.0 from https://files.pythonhosted.org/packages/bb/3f/748594706233e45fd0e6fb57a2fbfe572485009c52b19919d161a0ae5d52/executing-2.0.0-py2.py3-none-any.whl.metadata
  Using cached executing-2.0.0-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting asttokens>=2.1.0 (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for asttokens>=2.1.0 from https://files.pythonhosted.org/packages/4f/25/adda9979586d9606300415c89ad0e4c5b53d72b92d2747a3c634701a6a02/asttokens-2.4.0-py2.py3-none-any.whl.metadata
  Using cached asttokens-2.4.0-py2.py3-none-any.whl.metadata (4.9 kB)
Collecting pure-eval (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting six>=1.12.0 (from asttokens>=2.1.0->stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Using cached elevenlabs-0.2.24-py3-none-any.whl (16 kB)
Using cached ipython-8.16.1-py3-none-any.whl (806 kB)
Using cached pydantic-1.10.13-cp310-cp310-macosx_10_9_x86_64.whl (2.9 MB)
Using cached jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)
Using cached prompt_toolkit-3.0.39-py3-none-any.whl (385 kB)
Using cached Pygments-2.16.1-py3-none-any.whl (1.2 MB)
Using cached traitlets-5.11.2-py3-none-any.whl (83 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached stack_data-0.6.3-py3-none-any.whl (24 kB)
Using cached asttokens-2.4.0-py2.py3-none-any.whl (27 kB)
Using cached executing-2.0.0-py2.py3-none-any.whl (24 kB)
Using cached wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
Installing collected packages: wcwidth, pure-eval, ptyprocess, pickleshare, executing, backcall, appnope, websockets, traitlets, six, pygments, pydantic, prompt-toolkit, pexpect, parso, exceptiongroup, decorator, matplotlib-inline, jedi, asttokens, stack-data, ipython, elevenlabs
Successfully installed appnope-0.1.3 asttokens-2.4.0 backcall-0.2.0 decorator-5.1.1 elevenlabs-0.2.24 exceptiongroup-1.1.3 executing-2.0.0 ipython-8.16.1 jedi-0.19.1 matplotlib-inline-0.1.6 parso-0.8.3 pexpect-4.8.0 pickleshare-0.7.5 prompt-toolkit-3.0.39 ptyprocess-0.7.0 pure-eval-0.2.2 pydantic-1.10.13 pygments-2.16.1 six-1.16.0 stack-data-0.6.3 traitlets-5.11.2 wcwidth-0.2.8 websockets-11.0.3
Requirement already satisfied: ipython in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 1)) (8.16.1)
Collecting num2words (from -r extensions/silero_tts/requirements.txt (line 2))
  Using cached num2words-0.5.12-py3-none-any.whl (125 kB)
Collecting omegaconf (from -r extensions/silero_tts/requirements.txt (line 3))
  Using cached omegaconf-2.3.0-py3-none-any.whl (79 kB)
Collecting pydub (from -r extensions/silero_tts/requirements.txt (line 4))
  Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Collecting PyYAML (from -r extensions/silero_tts/requirements.txt (line 5))
  Obtaining dependency information for PyYAML from https://files.pythonhosted.org/packages/96/06/4beb652c0fe16834032e54f0956443d4cc797fe645527acee59e7deaa0a2/PyYAML-6.0.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached PyYAML-6.0.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (2.1 kB)
Requirement already satisfied: backcall in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: jedi>=0.16 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.19.1)
Requirement already satisfied: matplotlib-inline in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: pickleshare in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (3.0.39)
Requirement already satisfied: pygments>=2.4.0 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.16.1)
Requirement already satisfied: stack-data in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.6.3)
Requirement already satisfied: traitlets>=5 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.11.2)
Requirement already satisfied: exceptiongroup in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.1.3)
Requirement already satisfied: pexpect>4.3 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (4.8.0)
Requirement already satisfied: appnope in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.1.3)
Collecting docopt>=0.6.2 (from num2words->-r extensions/silero_tts/requirements.txt (line 2))
  Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting antlr4-python3-runtime==4.9.* (from omegaconf->-r extensions/silero_tts/requirements.txt (line 3))
  Using cached antlr4_python3_runtime-4.9.3-py3-none-any.whl
Requirement already satisfied: parso<0.9.0,>=0.8.3 in ./installer_files/env/lib/python3.10/site-packages (from jedi>=0.16->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: ptyprocess>=0.5 in ./installer_files/env/lib/python3.10/site-packages (from pexpect>4.3->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.0)
Requirement already satisfied: wcwidth in ./installer_files/env/lib/python3.10/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.8)
Requirement already satisfied: executing>=1.2.0 in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: asttokens>=2.1.0 in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.4.0)
Requirement already satisfied: pure-eval in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six>=1.12.0 in ./installer_files/env/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.16.0)
Using cached PyYAML-6.0.1-cp310-cp310-macosx_10_9_x86_64.whl (189 kB)
Installing collected packages: pydub, docopt, antlr4-python3-runtime, PyYAML, num2words, omegaconf
Successfully installed PyYAML-6.0.1 antlr4-python3-runtime-4.9.3 docopt-0.6.2 num2words-0.5.12 omegaconf-2.3.0 pydub-0.25.1
Collecting flask_cloudflared==0.0.14 (from -r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for flask_cloudflared==0.0.14 from https://files.pythonhosted.org/packages/f9/e0/d90aa747ae35adfcd6fa116936b1eb42a6e5d8c69419694862476cefd34b/flask_cloudflared-0.0.14-py3-none-any.whl.metadata
  Using cached flask_cloudflared-0.0.14-py3-none-any.whl.metadata (4.6 kB)
Collecting websockets==11.0.2 (from -r extensions/api/requirements.txt (line 2))
  Using cached websockets-11.0.2-cp310-cp310-macosx_10_9_x86_64.whl (120 kB)
Collecting Flask>=0.8 (from flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for Flask>=0.8 from https://files.pythonhosted.org/packages/36/42/015c23096649b908c809c69388a805a571a3bea44362fe87e33fc3afa01f/flask-3.0.0-py3-none-any.whl.metadata
  Using cached flask-3.0.0-py3-none-any.whl.metadata (3.6 kB)
Requirement already satisfied: requests in ./installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.31.0)
Collecting Werkzeug>=3.0.0 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for Werkzeug>=3.0.0 from https://files.pythonhosted.org/packages/b6/a5/54b01f663d60d5334f6c9c87c26274e94617a4fd463d812463626423b10d/werkzeug-3.0.0-py3-none-any.whl.metadata
  Using cached werkzeug-3.0.0-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: Jinja2>=3.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.1.2)
Collecting itsdangerous>=2.1.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.1.3 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for click>=8.1.3 from https://files.pythonhosted.org/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl.metadata
  Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting blinker>=1.6.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for blinker>=1.6.2 from https://files.pythonhosted.org/packages/bf/2b/11bcedb7dee4923253a4a21bae3be854bcc4f06295bd827756352016d97c/blinker-1.6.3-py3-none-any.whl.metadata
  Using cached blinker-1.6.3-py3-none-any.whl.metadata (1.9 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2023.7.22)
Requirement already satisfied: MarkupSafe>=2.0 in ./installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.1.3)
Using cached flask_cloudflared-0.0.14-py3-none-any.whl (6.4 kB)
Using cached flask-3.0.0-py3-none-any.whl (99 kB)
Using cached blinker-1.6.3-py3-none-any.whl (13 kB)
Using cached click-8.1.7-py3-none-any.whl (97 kB)
Using cached werkzeug-3.0.0-py3-none-any.whl (226 kB)
Installing collected packages: Werkzeug, websockets, itsdangerous, click, blinker, Flask, flask_cloudflared
  Attempting uninstall: websockets
    Found existing installation: websockets 11.0.3
    Uninstalling websockets-11.0.3:
      Successfully uninstalled websockets-11.0.3
Successfully installed Flask-3.0.0 Werkzeug-3.0.0 blinker-1.6.3 click-8.1.7 flask_cloudflared-0.0.14 itsdangerous-2.1.2 websockets-11.0.2
Collecting git+https://github.com/oobabooga/whisper.git (from -r extensions/whisper_stt/requirements.txt (line 2))
  Cloning https://github.com/oobabooga/whisper.git to /private/var/folders/tf/ktqczdyn5qx0810pd7z2y6s80000gn/T/pip-req-build-1x__kd3c
  Running command git clone --filter=blob:none --quiet https://github.com/oobabooga/whisper.git /private/var/folders/tf/ktqczdyn5qx0810pd7z2y6s80000gn/T/pip-req-build-1x__kd3c
  Resolved https://github.com/oobabooga/whisper.git to commit 958ee4f6e1e65425ba02c440fc083089d58f5c71
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting SpeechRecognition==3.10.0 (from -r extensions/whisper_stt/requirements.txt (line 1))
  Using cached SpeechRecognition-3.10.0-py2.py3-none-any.whl (32.8 MB)
Collecting soundfile (from -r extensions/whisper_stt/requirements.txt (line 3))
  Using cached soundfile-0.12.1-py2.py3-none-macosx_10_9_x86_64.whl (1.2 MB)
Collecting ffmpeg (from -r extensions/whisper_stt/requirements.txt (line 4))
  Using cached ffmpeg-1.4-py3-none-any.whl
Requirement already satisfied: requests>=2.26.0 in ./installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.31.0)
Collecting numba (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for numba from https://files.pythonhosted.org/packages/4a/1d/ecc1948837253fd3f7a99b720838602396fcee765d614d1a38e9de15aea7/numba-0.58.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numba-0.58.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (2.7 kB)
Requirement already satisfied: numpy in ./installer_files/env/lib/python3.10/site-packages (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2)) (1.26.0)
Collecting tqdm (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for tqdm from https://files.pythonhosted.org/packages/00/e5/f12a80907d0884e6dff9c16d0c0114d81b8cd07dc3ae54c5e962cc83037e/tqdm-4.66.1-py3-none-any.whl.metadata
  Using cached tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
Collecting more-itertools (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for more-itertools from https://files.pythonhosted.org/packages/5a/cb/6dce742ea14e47d6f565589e859ad225f2a5de576d7696e0623b784e226b/more_itertools-10.1.0-py3-none-any.whl.metadata
  Using cached more_itertools-10.1.0-py3-none-any.whl.metadata (33 kB)
Collecting tiktoken==0.3.3 (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Using cached tiktoken-0.3.3-cp310-cp310-macosx_10_9_x86_64.whl (735 kB)
Collecting regex>=2022.1.18 (from tiktoken==0.3.3->openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for regex>=2022.1.18 from https://files.pythonhosted.org/packages/2c/6b/4828fdbbabcb51986ddc1e7c618cf9dc8606f75c2f0cc381d3729cf31348/regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (40 kB)
Collecting cffi>=1.0 (from soundfile->-r extensions/whisper_stt/requirements.txt (line 3))
  Obtaining dependency information for cffi>=1.0 from https://files.pythonhosted.org/packages/aa/aa/1c43e48a6f361d1529f9e4602d6992659a0107b5f21cae567e2eddcf8d66/cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (1.5 kB)
Collecting pycparser (from cffi>=1.0->soundfile->-r extensions/whisper_stt/requirements.txt (line 3))
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2023.7.22)
Collecting llvmlite<0.42,>=0.41.0dev0 (from numba->openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for llvmlite<0.42,>=0.41.0dev0 from https://files.pythonhosted.org/packages/f8/86/6ccfede8416d5a32faef1b778767b0d49d8e8e8c63508b02d8ef87a81643/llvmlite-0.41.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached llvmlite-0.41.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (4.8 kB)
Collecting numpy (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for numpy from https://files.pythonhosted.org/packages/d5/50/8aedb5ff1460e7c8527af15c6326115009e7c270ec705487155b779ebabb/numpy-1.25.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numpy-1.25.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata (5.6 kB)
Using cached cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl (182 kB)
Using cached more_itertools-10.1.0-py3-none-any.whl (55 kB)
Using cached numba-0.58.0-cp310-cp310-macosx_10_9_x86_64.whl (2.6 MB)
Using cached numpy-1.25.2-cp310-cp310-macosx_10_9_x86_64.whl (20.8 MB)
Using cached tqdm-4.66.1-py3-none-any.whl (78 kB)
Using cached llvmlite-0.41.0-cp310-cp310-macosx_10_9_x86_64.whl (31.0 MB)
Using cached regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl (296 kB)
Building wheels for collected packages: openai-whisper
  Building wheel for openai-whisper (pyproject.toml) ... done
  Created wheel for openai-whisper: filename=openai_whisper-20230918-py3-none-any.whl size=798448 sha256=49bf175d9d6dd9a5e3c3f8b1148920c51480579e7b1fb37b83df53b0c5e7ab94
  Stored in directory: /private/var/folders/tf/ktqczdyn5qx0810pd7z2y6s80000gn/T/pip-ephem-wheel-cache-kmtzjxat/wheels/09/f2/aa/bea939dd47f3b5d0d3f25f04665123b26a510e6f5faaae2b64
Successfully built openai-whisper
Installing collected packages: ffmpeg, tqdm, regex, pycparser, numpy, more-itertools, llvmlite, tiktoken, SpeechRecognition, numba, cffi, soundfile, openai-whisper
  Attempting uninstall: numpy
    Found existing installation: numpy 1.26.0
    Uninstalling numpy-1.26.0:
      Successfully uninstalled numpy-1.26.0
Successfully installed SpeechRecognition-3.10.0 cffi-1.16.0 ffmpeg-1.4 llvmlite-0.41.0 more-itertools-10.1.0 numba-0.58.0 numpy-1.25.2 openai-whisper-20230918 pycparser-2.21 regex-2023.10.3 soundfile-0.12.1 tiktoken-0.3.3 tqdm-4.66.1
Requirement already satisfied: SpeechRecognition==3.10.0 in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/openai/requirements.txt (line 1)) (3.10.0)
Collecting flask_cloudflared==0.0.12 (from -r extensions/openai/requirements.txt (line 2))
  Using cached flask_cloudflared-0.0.12-py3-none-any.whl (6.3 kB)
Collecting sentence-transformers (from -r extensions/openai/requirements.txt (line 3))
  Using cached sentence_transformers-2.2.2-py3-none-any.whl
Requirement already satisfied: tiktoken in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/openai/requirements.txt (line 4)) (0.3.3)
Collecting tiktoken (from -r extensions/openai/requirements.txt (line 4))
  Obtaining dependency information for tiktoken from https://files.pythonhosted.org/packages/0b/c9/cd8a2e95078f94a40bf1408c0ac353570114976fda90fc8da62d3c85fff6/tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (6.6 kB)
Requirement already satisfied: requests>=2.26.0 in ./installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: Flask>=0.8 in ./installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.0.0)
Collecting transformers<5.0.0,>=4.6.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for transformers<5.0.0,>=4.6.0 from https://files.pythonhosted.org/packages/1a/d1/3bba59606141ae808017f6fde91453882f931957f125009417b87a281067/transformers-4.34.0-py3-none-any.whl.metadata
  Using cached transformers-4.34.0-py3-none-any.whl.metadata (121 kB)
Requirement already satisfied: tqdm in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (4.66.1)
Requirement already satisfied: torch>=1.6.0 in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2.1.0)
Requirement already satisfied: torchvision in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (0.16.0)
Requirement already satisfied: numpy in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.25.2)
Collecting scikit-learn (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for scikit-learn from https://files.pythonhosted.org/packages/74/17/01347a4e2298edd6d152b79d4d042f902a618ccaf4c070f0a61999a26156/scikit_learn-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached scikit_learn-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (11 kB)
Collecting scipy (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for scipy from https://files.pythonhosted.org/packages/6d/bc/6f79da3a8edf5f432ccdc49fd35e8b4fe2ce1d4ad3b5360c742101a57838/scipy-1.11.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached scipy-1.11.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (60 kB)
Collecting nltk (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Using cached nltk-3.8.1-py3-none-any.whl (1.5 MB)
Collecting sentencepiece (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Using cached sentencepiece-0.1.99-cp310-cp310-macosx_10_9_x86_64.whl (1.2 MB)
Collecting huggingface-hub>=0.4.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for huggingface-hub>=0.4.0 from https://files.pythonhosted.org/packages/aa/f3/3fc97336a0e90516901befd4f500f08d691034d387406fdbde85bea827cc/huggingface_hub-0.17.3-py3-none-any.whl.metadata
  Using cached huggingface_hub-0.17.3-py3-none-any.whl.metadata (13 kB)
Requirement already satisfied: regex>=2022.1.18 in ./installer_files/env/lib/python3.10/site-packages (from tiktoken->-r extensions/openai/requirements.txt (line 4)) (2023.10.3)
Requirement already satisfied: Werkzeug>=3.0.0 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.0.0)
Requirement already satisfied: Jinja2>=3.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (8.1.7)
Requirement already satisfied: blinker>=1.6.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (1.6.3)
Requirement already satisfied: filelock in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (3.12.4)
Requirement already satisfied: fsspec in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2023.9.2)
Requirement already satisfied: pyyaml>=5.1 in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (6.0.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (4.8.0)
Collecting packaging>=20.9 (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for packaging>=20.9 from https://files.pythonhosted.org/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl.metadata
  Using cached packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2023.7.22)
Requirement already satisfied: sympy in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.12)
Requirement already satisfied: networkx in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (3.1)
Collecting tokenizers<0.15,>=0.14 (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for tokenizers<0.15,>=0.14 from https://files.pythonhosted.org/packages/f4/3e/3e8800424cee3d3097f84ca1a70311a4fdf14646f6cff934512c619c9ebe/tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl.metadata
  Using cached tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl.metadata (6.7 kB)
Collecting safetensors>=0.3.1 (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for safetensors>=0.3.1 from https://files.pythonhosted.org/packages/79/dc/a72eb060f4f598314c5a96676d3790b51fff78e448253c7319a9441228a7/safetensors-0.4.0-cp310-cp310-macosx_10_7_x86_64.whl.metadata
  Using cached safetensors-0.4.0-cp310-cp310-macosx_10_7_x86_64.whl.metadata (3.8 kB)
Collecting joblib (from nltk->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for joblib from https://files.pythonhosted.org/packages/10/40/d551139c85db202f1f384ba8bcf96aca2f329440a844f924c8a0040b6d02/joblib-1.3.2-py3-none-any.whl.metadata
  Using cached joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for threadpoolctl>=2.0.0 from https://files.pythonhosted.org/packages/81/12/fd4dea011af9d69e1cad05c75f3f7202cdcbeac9b712eea58ca779a72865/threadpoolctl-3.2.0-py3-none-any.whl.metadata
  Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./installer_files/env/lib/python3.10/site-packages (from torchvision->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (10.0.1)
Requirement already satisfied: MarkupSafe>=2.0 in ./installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in ./installer_files/env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.3.0)
Using cached tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl (953 kB)
Using cached huggingface_hub-0.17.3-py3-none-any.whl (295 kB)
Using cached transformers-4.34.0-py3-none-any.whl (7.7 MB)
Using cached scikit_learn-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl (10.2 MB)
Using cached scipy-1.11.3-cp310-cp310-macosx_10_9_x86_64.whl (37.3 MB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached packaging-23.2-py3-none-any.whl (53 kB)
Using cached safetensors-0.4.0-cp310-cp310-macosx_10_7_x86_64.whl (439 kB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl (2.5 MB)
Installing collected packages: sentencepiece, threadpoolctl, scipy, safetensors, packaging, joblib, tiktoken, scikit-learn, nltk, huggingface-hub, tokenizers, flask_cloudflared, transformers, sentence-transformers
  Attempting uninstall: tiktoken
    Found existing installation: tiktoken 0.3.3
    Uninstalling tiktoken-0.3.3:
      Successfully uninstalled tiktoken-0.3.3
  Attempting uninstall: flask_cloudflared
    Found existing installation: flask-cloudflared 0.0.14
    Uninstalling flask-cloudflared-0.0.14:
      Successfully uninstalled flask-cloudflared-0.0.14
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
openai-whisper 20230918 requires tiktoken==0.3.3, but you have tiktoken 0.5.1 which is incompatible.
Successfully installed flask_cloudflared-0.0.12 huggingface-hub-0.17.3 joblib-1.3.2 nltk-3.8.1 packaging-23.2 safetensors-0.4.0 scikit-learn-1.3.1 scipy-1.11.3 sentence-transformers-2.2.2 sentencepiece-0.1.99 threadpoolctl-3.2.0 tiktoken-0.5.1 tokenizers-0.14.1 transformers-4.34.0
Collecting deep-translator==1.9.2 (from -r extensions/google_translate/requirements.txt (line 1))
  Using cached deep_translator-1.9.2-py3-none-any.whl (30 kB)
Collecting beautifulsoup4<5.0.0,>=4.9.1 (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1))
  Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in ./installer_files/env/lib/python3.10/site-packages (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.31.0)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1))
  Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2023.7.22)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: soupsieve, beautifulsoup4, deep-translator
Successfully installed beautifulsoup4-4.12.2 deep-translator-1.9.2 soupsieve-2.5

*******************************************************************
* Installing webui requirements from file: requirements_apple_intel.txt
*******************************************************************

WARNING: Skipping torch-grammar as it is not installed.
Uninstalled torch-grammar
Collecting git+https://github.com/oobabooga/torch-grammar.git (from -r temp_requirements.txt (line 28))
  Cloning https://github.com/oobabooga/torch-grammar.git to /private/var/folders/tf/ktqczdyn5qx0810pd7z2y6s80000gn/T/pip-req-build-12qoac86
  Running command git clone --filter=blob:none --quiet https://github.com/oobabooga/torch-grammar.git /private/var/folders/tf/ktqczdyn5qx0810pd7z2y6s80000gn/T/pip-req-build-12qoac86
  Resolved https://github.com/oobabooga/torch-grammar.git to commit 82850b5383a629f3b0fa1fba7d8f2aba3185ddb2
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system == "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0"' don't match your environment
ERROR: llama_cpp_python-0.2.11-cp310-cp310-macosx_12_0_x86_64.whl is not a supported wheel on this platform.
Command '. "/Users/esteban/localDocs/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/esteban/localDocs/text-generation-webui/installer_files/env" && python -m pip install -r temp_requirements.txt --upgrade' failed with exit status code '1'.

Exiting now.
Try running the start/update script again.

System Info

MacOS 12.7 Monterey INTEL with AMD RX580
Mox4572 commented 1 year ago

I too have this issue on macOS 14.0, on Intel with AMD Radeon Pro 5300M, I have spent over three hours trying to debug this, I can't do it, at this point I've probably screwed my macOS install pretty hard trying to get this thing to work(like adding all of the stupid subdirectories for python to my path because it refuses to accept that I have permission to write to the root folder, even though I literally can, and have done so.)

Mox4572 commented 1 year ago 
dante@Dantes-MacBook-Pro ~ % cd Downloads/text-generation-webui-main
dante@Dantes-MacBook-Pro text-generation-webui-main % ./start_macos.sh 
Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.3.1-0-MacOSX-x86_64.sh to /Users/dante/Downloads/text-generation-webui-main/installer_files/miniconda_installer.sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 44.0M  100 44.0M    0     0  16.9M      0  0:00:02  0:00:02 --:--:-- 17.0M
PREFIX=/Users/dante/Downloads/text-generation-webui-main/installer_files/conda
Unpacking payload ...

Installing base environment...

Downloading and Extracting Packages

Downloading and Extracting Packages

Preparing transaction: done
Executing transaction: / 
done
installation finished.
Miniconda version:
conda 23.3.1
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 23.9.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.9.0

## Package Plan ##

  environment location: /Users/dante/Downloads/text-generation-webui-main/installer_files/env

  added / updated specs:
    - python=3.10

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ca-certificates-2023.08.22 |       hecd8cb5_0         124 KB
    libffi-3.4.4               |       hecd8cb5_0         132 KB
    openssl-3.0.11             |       hca72f7f_2         4.5 MB
    pip-23.2.1                 |  py310hecd8cb5_0         2.7 MB
    python-3.10.13             |       h5ee71fb_0        13.1 MB
    setuptools-68.0.0          |  py310hecd8cb5_0         955 KB
    sqlite-3.41.2              |       h6c40b1e_0         1.2 MB
    wheel-0.41.2               |  py310hecd8cb5_0         110 KB
    xz-5.4.2                   |       h6c40b1e_0         372 KB
    ------------------------------------------------------------
                                           Total:        23.1 MB

The following NEW packages will be INSTALLED:

  bzip2              pkgs/main/osx-64::bzip2-1.0.8-h1de35cc_0 
  ca-certificates    pkgs/main/osx-64::ca-certificates-2023.08.22-hecd8cb5_0 
  libffi             pkgs/main/osx-64::libffi-3.4.4-hecd8cb5_0 
  ncurses            pkgs/main/osx-64::ncurses-6.4-hcec6c5f_0 
  openssl            pkgs/main/osx-64::openssl-3.0.11-hca72f7f_2 
  pip                pkgs/main/osx-64::pip-23.2.1-py310hecd8cb5_0 
  python             pkgs/main/osx-64::python-3.10.13-h5ee71fb_0 
  readline           pkgs/main/osx-64::readline-8.2-hca72f7f_0 
  setuptools         pkgs/main/osx-64::setuptools-68.0.0-py310hecd8cb5_0 
  sqlite             pkgs/main/osx-64::sqlite-3.41.2-h6c40b1e_0 
  tk                 pkgs/main/osx-64::tk-8.6.12-h5d9f67b_0 
  tzdata             pkgs/main/noarch::tzdata-2023c-h04d1e81_0 
  wheel              pkgs/main/osx-64::wheel-0.41.2-py310hecd8cb5_0 
  xz                 pkgs/main/osx-64::xz-5.4.2-h6c40b1e_0 
  zlib               pkgs/main/osx-64::zlib-1.2.13-h4dc903c_0 

Downloading and Extracting Packages

Preparing transaction: done                                                     
Verifying transaction: done                                                     
Executing transaction: done                                                     
#                                                                               
# To activate this environment, use                                             
#                                                                               
#     $ conda activate /Users/dante/Downloads/text-generation-webui-main/installer_files/env                                                                    
#
# To deactivate an active environment, use
#
#     $ conda deactivate

What is your GPU?

A) NVIDIA
B) AMD (Linux/MacOS only. Requires ROCm SDK 5.6 on Linux)
C) Apple M Series
D) Intel Arc (IPEX)
N) None (I want to run models in CPU mode)

Input> b
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 23.9.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.9.0

## Package Plan ##

  environment location: /Users/dante/Downloads/text-generation-webui-main/installer_files/env

  added / updated specs:
    - git
    - ninja

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    c-ares-1.19.1              |       h6c40b1e_0         107 KB
    curl-8.2.1                 |       h04015c4_0          78 KB
    expat-2.5.0                |       hcec6c5f_0         140 KB
    gdbm-1.18                  |       hdccc71a_4         142 KB
    gettext-0.21.0             |       he85b6c0_1         3.0 MB
    git-2.40.1                 | pl5340hb824c65_1         8.7 MB
    icu-73.1                   |       hcec6c5f_0        25.1 MB
    krb5-1.20.1                |       h428f121_1         1.2 MB
    libcurl-8.2.1              |       hf20ceda_0         361 KB
    libcxx-14.0.6              |       h9765a3e_0         968 KB
    libedit-3.1.20221030       |       h6c40b1e_0         155 KB
    libev-4.33                 |       h9ed2024_1         106 KB
    libiconv-1.16              |       hca72f7f_2         695 KB
    libnghttp2-1.52.0          |       h9beae6a_1         662 KB
    libssh2-1.10.0             |       h04015c4_2         274 KB
    libxml2-2.10.4             |       h1bd7e62_1         665 KB
    llvm-openmp-14.0.6         |       h0dcd299_0         288 KB
    ninja-1.10.2               |       hecd8cb5_5           9 KB
    ninja-base-1.10.2          |       haf03e11_5         118 KB
    pcre2-10.42                |       h9b97e30_0         1.3 MB
    perl-5.34.0                |       h435f0c2_2        15.0 MB
    ------------------------------------------------------------
                                           Total:        58.9 MB

The following NEW packages will be INSTALLED:

  c-ares             pkgs/main/osx-64::c-ares-1.19.1-h6c40b1e_0 
  curl               pkgs/main/osx-64::curl-8.2.1-h04015c4_0 
  expat              pkgs/main/osx-64::expat-2.5.0-hcec6c5f_0 
  gdbm               pkgs/main/osx-64::gdbm-1.18-hdccc71a_4 
  gettext            pkgs/main/osx-64::gettext-0.21.0-he85b6c0_1 
  git                pkgs/main/osx-64::git-2.40.1-pl5340hb824c65_1 
  icu                pkgs/main/osx-64::icu-73.1-hcec6c5f_0 
  krb5               pkgs/main/osx-64::krb5-1.20.1-h428f121_1 
  libcurl            pkgs/main/osx-64::libcurl-8.2.1-hf20ceda_0 
  libcxx             pkgs/main/osx-64::libcxx-14.0.6-h9765a3e_0 
  libedit            pkgs/main/osx-64::libedit-3.1.20221030-h6c40b1e_0 
  libev              pkgs/main/osx-64::libev-4.33-h9ed2024_1 
  libiconv           pkgs/main/osx-64::libiconv-1.16-hca72f7f_2 
  libnghttp2         pkgs/main/osx-64::libnghttp2-1.52.0-h9beae6a_1 
  libssh2            pkgs/main/osx-64::libssh2-1.10.0-h04015c4_2 
  libxml2            pkgs/main/osx-64::libxml2-2.10.4-h1bd7e62_1 
  llvm-openmp        pkgs/main/osx-64::llvm-openmp-14.0.6-h0dcd299_0 
  ninja              pkgs/main/osx-64::ninja-1.10.2-hecd8cb5_5 
  ninja-base         pkgs/main/osx-64::ninja-base-1.10.2-haf03e11_5 
  pcre2              pkgs/main/osx-64::pcre2-10.42-h9b97e30_0 
  perl               pkgs/main/osx-64::perl-5.34.0-h435f0c2_2 

Downloading and Extracting Packages

Preparing transaction: done                                                     
Verifying transaction: done                                                     
Executing transaction: done                                                     
Collecting torch                                                                
  Obtaining dependency information for torch from https://files.pythonhosted.org/packages/67/d8/98b2836bd83707ecf27d66587fab9dedcfe746efab775042b93cd146d027/torch-2.1.0-cp310-none-macosx_10_9_x86_64.whl.metadata                             
  Using cached torch-2.1.0-cp310-none-macosx_10_9_x86_64.whl.metadata (24 kB)   
Collecting torchvision                                                          
  Obtaining dependency information for torchvision from https://files.pythonhosted.org/packages/76/89/0cdc6f497cbbb83dd51804cd4f788b7f5bd529f07b5417b50fe9c5655b76/torchvision-0.16.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata              
  Using cached torchvision-0.16.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata (6.6 kB)                                                                         
Collecting torchaudio                                                           
  Obtaining dependency information for torchaudio from https://files.pythonhosted.org/packages/03/ae/535192c2b9c53290d44d89d1267083c79663b5cf2fbfe13ccc28709d80d4/torchaudio-2.1.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata                 
  Using cached torchaudio-2.1.0-cp310-cp310-macosx_10_13_x86_64.whl.metadata (5.7 kB)                                                                           
Collecting filelock (from torch)
  Obtaining dependency information for filelock from https://files.pythonhosted.org/packages/5e/5d/97afbafd9d584ff1b45fcb354a479a3609bd97f912f8f1f6c563cb1fae21/filelock-3.12.4-py3-none-any.whl.metadata
  Using cached filelock-3.12.4-py3-none-any.whl.metadata (2.8 kB)
Collecting typing-extensions (from torch)
  Obtaining dependency information for typing-extensions from https://files.pythonhosted.org/packages/24/21/7d397a4b7934ff4028987914ac1044d3b7d52712f30e2ac7a2ae5bc86dd0/typing_extensions-4.8.0-py3-none-any.whl.metadata
  Using cached typing_extensions-4.8.0-py3-none-any.whl.metadata (3.0 kB)
Collecting sympy (from torch)
  Using cached sympy-1.12-py3-none-any.whl (5.7 MB)
Collecting networkx (from torch)
  Using cached networkx-3.1-py3-none-any.whl (2.1 MB)
Collecting jinja2 (from torch)
  Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting fsspec (from torch)
  Obtaining dependency information for fsspec from https://files.pythonhosted.org/packages/fe/d3/e1aa96437d944fbb9cc95d0316e25583886e9cd9e6adc07baad943524eda/fsspec-2023.9.2-py3-none-any.whl.metadata
  Using cached fsspec-2023.9.2-py3-none-any.whl.metadata (6.7 kB)
Collecting numpy (from torchvision)
  Obtaining dependency information for numpy from https://files.pythonhosted.org/packages/be/f8/034752c5131c46e10364e4db241974f2eb6bb31bbfc4335344c19e17d909/numpy-1.26.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numpy-1.26.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (53 kB)
Collecting requests (from torchvision)
  Obtaining dependency information for requests from https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl.metadata
  Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision)
  Obtaining dependency information for pillow!=8.3.*,>=5.3.0 from https://files.pythonhosted.org/packages/8c/34/4e02804420b1cd9371ce5f7c0da7024a8450e6b092c336d3233d6c6448d9/Pillow-10.0.1-cp310-cp310-macosx_10_10_x86_64.whl.metadata
  Using cached Pillow-10.0.1-cp310-cp310-macosx_10_10_x86_64.whl.metadata (9.5 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch)
  Obtaining dependency information for MarkupSafe>=2.0 from https://files.pythonhosted.org/packages/f7/9c/86cbd8e0e1d81f0ba420f20539dd459c50537c7751e28102dbfee2b6f28c/MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests->torchvision)
  Obtaining dependency information for charset-normalizer<4,>=2 from https://files.pythonhosted.org/packages/5f/b3/7f69cf4d4f18b6c058c928da0853a44e4804359a617e57402709e82f1fdd/charset_normalizer-3.3.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached charset_normalizer-3.3.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (32 kB)
Collecting idna<4,>=2.5 (from requests->torchvision)
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->torchvision)
  Obtaining dependency information for urllib3<3,>=1.21.1 from https://files.pythonhosted.org/packages/26/40/9957270221b6d3e9a3b92fdfba80dd5c9661ff45a664b47edd5d00f707f5/urllib3-2.0.6-py3-none-any.whl.metadata
  Using cached urllib3-2.0.6-py3-none-any.whl.metadata (6.6 kB)
Collecting certifi>=2017.4.17 (from requests->torchvision)
  Obtaining dependency information for certifi>=2017.4.17 from https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl.metadata
  Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting mpmath>=0.19 (from sympy->torch)
  Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Using cached torch-2.1.0-cp310-none-macosx_10_9_x86_64.whl (147.0 MB)
Using cached torchvision-0.16.0-cp310-cp310-macosx_10_13_x86_64.whl (1.7 MB)
Using cached torchaudio-2.1.0-cp310-cp310-macosx_10_13_x86_64.whl (3.4 MB)
Using cached Pillow-10.0.1-cp310-cp310-macosx_10_10_x86_64.whl (3.7 MB)
Using cached filelock-3.12.4-py3-none-any.whl (11 kB)
Using cached fsspec-2023.9.2-py3-none-any.whl (173 kB)
Using cached numpy-1.26.0-cp310-cp310-macosx_10_9_x86_64.whl (20.6 MB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached charset_normalizer-3.3.0-cp310-cp310-macosx_10_9_x86_64.whl (119 kB)
Using cached MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl (13 kB)
Using cached urllib3-2.0.6-py3-none-any.whl (123 kB)
Installing collected packages: mpmath, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, fsspec, filelock, charset-normalizer, certifi, requests, jinja2, torch, torchvision, torchaudio
Successfully installed MarkupSafe-2.1.3 certifi-2023.7.22 charset-normalizer-3.3.0 filelock-3.12.4 fsspec-2023.9.2 idna-3.4 jinja2-3.1.2 mpmath-1.3.0 networkx-3.1 numpy-1.26.0 pillow-10.0.1 requests-2.31.0 sympy-1.12 torch-2.1.0 torchaudio-2.1.0 torchvision-0.16.0 typing-extensions-4.8.0 urllib3-2.0.6
Collecting py-cpuinfo==9.0.0
  Using cached py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Installing collected packages: py-cpuinfo
Successfully installed py-cpuinfo-9.0.0
Initialized empty Git repository in /Users/dante/Downloads/text-generation-webui-main/.git/
remote: Enumerating objects: 13089, done.
remote: Counting objects: 100% (2187/2187), done.
remote: Compressing objects: 100% (179/179), done.
remote: Total 13089 (delta 2065), reused 2052 (delta 2008), pack-reused 10902
Receiving objects: 100% (13089/13089), 24.00 MiB | 11.80 MiB/s, done.
Resolving deltas: 100% (8970/8970), done.
From https://github.com/oobabooga/text-generation-webui
 * [new branch]      bump-pytorch     -> origin/bump-pytorch
 * [new branch]      documentation    -> origin/documentation
 * [new branch]      gpu-requirements -> origin/gpu-requirements
 * [new branch]      gradio-update    -> origin/gradio-update
 * [new branch]      grammar-editor   -> origin/grammar-editor
 * [new branch]      grammar-hf       -> origin/grammar-hf
 * [new branch]      jinja            -> origin/jinja
 * [new branch]      main             -> origin/main
 * [new tag]         1.6.1            -> 1.6.1
 * [new tag]         installers       -> installers
 * [new tag]         v1.0             -> v1.0
 * [new tag]         v1.1             -> v1.1
 * [new tag]         v1.1.1           -> v1.1.1
 * [new tag]         v1.2             -> v1.2
 * [new tag]         v1.3             -> v1.3
 * [new tag]         v1.3.1           -> v1.3.1
 * [new tag]         v1.4             -> v1.4
 * [new tag]         v1.5             -> v1.5
 * [new tag]         v1.6             -> v1.6
 * [new tag]         v1.7             -> v1.7
origin/HEAD set to main
Unstaged changes after reset:
M   css/html_readable_style.css
M   css/main.css
M   download-model.py
M   extensions/multimodal/pipelines/llava/llava.py
M   extensions/multimodal/pipelines/llava/pipelines.py
M   js/main.js
M   modules/block_requests.py
M   modules/html_generator.py
M   modules/models.py
M   modules/models_settings.py
M   modules/training.py
M   modules/ui.py
M   modules/ui_chat.py
M   modules/ui_file_saving.py
M   modules/ui_model_menu.py
M   modules/utils.py
M   requirements.txt
M   requirements_amd.txt
M   requirements_amd_noavx2.txt
M   requirements_apple_intel.txt
M   requirements_apple_silicon.txt
M   requirements_cpu_only.txt
M   requirements_cpu_only_noavx2.txt
M   requirements_noavx2.txt
M   requirements_nowheels.txt
M   server.py
branch 'main' set up to track 'origin/main'.
Already up to date.

*******************************************************************
* Installing extensions requirements.
*******************************************************************

Collecting ngrok==0.* (from -r extensions/ngrok/requirements.txt (line 1))
  Obtaining dependency information for ngrok==0.* from https://files.pythonhosted.org/packages/36/36/67609b956c839446c7787c359f6cb29cc07db3ab55092406f51e87faded1/ngrok-0.11.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.metadata
  Using cached ngrok-0.11.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl.metadata (16 kB)
Using cached ngrok-0.11.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (5.0 MB)
Installing collected packages: ngrok
Successfully installed ngrok-0.11.0
Collecting elevenlabs==0.2.24 (from -r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for elevenlabs==0.2.24 from https://files.pythonhosted.org/packages/69/7e/6929391760fd37cc620bcd10850724844255fe551fb9554083ebcf0790fd/elevenlabs-0.2.24-py3-none-any.whl.metadata
  Using cached elevenlabs-0.2.24-py3-none-any.whl.metadata (811 bytes)
Collecting pydantic<2.0,>=1.10 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for pydantic<2.0,>=1.10 from https://files.pythonhosted.org/packages/e3/39/c866689ef73ca39c4efc314fa751397ae15ee085632086383fefec8600c0/pydantic-1.10.13-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached pydantic-1.10.13-cp310-cp310-macosx_10_9_x86_64.whl.metadata (149 kB)
Collecting ipython>=7.0 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for ipython>=7.0 from https://files.pythonhosted.org/packages/ef/02/fc039fca3ec40a00f962eb6e9da45c507334b0650a3cb9facd38d234fb7a/ipython-8.16.1-py3-none-any.whl.metadata
  Using cached ipython-8.16.1-py3-none-any.whl.metadata (5.9 kB)
Requirement already satisfied: requests>=2.20 in ./installer_files/env/lib/python3.10/site-packages (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.31.0)
Collecting websockets>=11.0 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached websockets-11.0.3-cp310-cp310-macosx_10_9_x86_64.whl (120 kB)
Collecting backcall (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting decorator (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting jedi>=0.16 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for jedi>=0.16 from https://files.pythonhosted.org/packages/20/9f/bc63f0f0737ad7a60800bfd472a4836661adae21f9c2535f3957b1e54ceb/jedi-0.19.1-py2.py3-none-any.whl.metadata
  Using cached jedi-0.19.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting matplotlib-inline (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB)
Collecting pickleshare (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 from https://files.pythonhosted.org/packages/a9/b4/ba77c84edf499877317225d7b7bc047a81f7c2eed9628eeb6bab0ac2e6c9/prompt_toolkit-3.0.39-py3-none-any.whl.metadata
  Using cached prompt_toolkit-3.0.39-py3-none-any.whl.metadata (6.4 kB)
Collecting pygments>=2.4.0 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for pygments>=2.4.0 from https://files.pythonhosted.org/packages/43/88/29adf0b44ba6ac85045e63734ae0997d3c58d8b1a91c914d240828d0d73d/Pygments-2.16.1-py3-none-any.whl.metadata
  Using cached Pygments-2.16.1-py3-none-any.whl.metadata (2.5 kB)
Collecting stack-data (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for stack-data from https://files.pythonhosted.org/packages/f1/7b/ce1eafaf1a76852e2ec9b22edecf1daa58175c090266e9f6c64afcd81d91/stack_data-0.6.3-py3-none-any.whl.metadata
  Using cached stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)
Collecting traitlets>=5 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for traitlets>=5 from https://files.pythonhosted.org/packages/85/e9/d82415708306eb348fb16988c4697076119dfbfa266f17f74e514a23a723/traitlets-5.11.2-py3-none-any.whl.metadata
  Using cached traitlets-5.11.2-py3-none-any.whl.metadata (10 kB)
Collecting exceptiongroup (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for exceptiongroup from https://files.pythonhosted.org/packages/ad/83/b71e58666f156a39fb29417e4c8ca4bc7400c0dd4ed9e8842ab54dc8c344/exceptiongroup-1.1.3-py3-none-any.whl.metadata
  Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB)
Collecting pexpect>4.3 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
Collecting appnope (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached appnope-0.1.3-py2.py3-none-any.whl (4.4 kB)
Requirement already satisfied: typing-extensions>=4.2.0 in ./installer_files/env/lib/python3.10/site-packages (from pydantic<2.0,>=1.10->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (4.8.0)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2023.7.22)
Collecting parso<0.9.0,>=0.8.3 (from jedi>=0.16->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)
Collecting ptyprocess>=0.5 (from pexpect>4.3->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting wcwidth (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for wcwidth from https://files.pythonhosted.org/packages/58/19/a9ce39f89cf58cf1e7ce01c8bb76ab7e2c7aadbc5a2136c3e192097344f5/wcwidth-0.2.8-py2.py3-none-any.whl.metadata
  Using cached wcwidth-0.2.8-py2.py3-none-any.whl.metadata (13 kB)
Collecting executing>=1.2.0 (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for executing>=1.2.0 from https://files.pythonhosted.org/packages/bb/3f/748594706233e45fd0e6fb57a2fbfe572485009c52b19919d161a0ae5d52/executing-2.0.0-py2.py3-none-any.whl.metadata
  Using cached executing-2.0.0-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting asttokens>=2.1.0 (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for asttokens>=2.1.0 from https://files.pythonhosted.org/packages/4f/25/adda9979586d9606300415c89ad0e4c5b53d72b92d2747a3c634701a6a02/asttokens-2.4.0-py2.py3-none-any.whl.metadata
  Using cached asttokens-2.4.0-py2.py3-none-any.whl.metadata (4.9 kB)
Collecting pure-eval (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting six>=1.12.0 (from asttokens>=2.1.0->stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Using cached elevenlabs-0.2.24-py3-none-any.whl (16 kB)
Using cached ipython-8.16.1-py3-none-any.whl (806 kB)
Using cached pydantic-1.10.13-cp310-cp310-macosx_10_9_x86_64.whl (2.9 MB)
Using cached jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)
Using cached prompt_toolkit-3.0.39-py3-none-any.whl (385 kB)
Using cached Pygments-2.16.1-py3-none-any.whl (1.2 MB)
Using cached traitlets-5.11.2-py3-none-any.whl (83 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached stack_data-0.6.3-py3-none-any.whl (24 kB)
Using cached asttokens-2.4.0-py2.py3-none-any.whl (27 kB)
Using cached executing-2.0.0-py2.py3-none-any.whl (24 kB)
Using cached wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
Installing collected packages: wcwidth, pure-eval, ptyprocess, pickleshare, executing, backcall, appnope, websockets, traitlets, six, pygments, pydantic, prompt-toolkit, pexpect, parso, exceptiongroup, decorator, matplotlib-inline, jedi, asttokens, stack-data, ipython, elevenlabs
Successfully installed appnope-0.1.3 asttokens-2.4.0 backcall-0.2.0 decorator-5.1.1 elevenlabs-0.2.24 exceptiongroup-1.1.3 executing-2.0.0 ipython-8.16.1 jedi-0.19.1 matplotlib-inline-0.1.6 parso-0.8.3 pexpect-4.8.0 pickleshare-0.7.5 prompt-toolkit-3.0.39 ptyprocess-0.7.0 pure-eval-0.2.2 pydantic-1.10.13 pygments-2.16.1 six-1.16.0 stack-data-0.6.3 traitlets-5.11.2 wcwidth-0.2.8 websockets-11.0.3
Requirement already satisfied: ipython in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 1)) (8.16.1)
Collecting num2words (from -r extensions/silero_tts/requirements.txt (line 2))
  Using cached num2words-0.5.12-py3-none-any.whl (125 kB)
Collecting omegaconf (from -r extensions/silero_tts/requirements.txt (line 3))
  Using cached omegaconf-2.3.0-py3-none-any.whl (79 kB)
Collecting pydub (from -r extensions/silero_tts/requirements.txt (line 4))
  Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Collecting PyYAML (from -r extensions/silero_tts/requirements.txt (line 5))
  Obtaining dependency information for PyYAML from https://files.pythonhosted.org/packages/96/06/4beb652c0fe16834032e54f0956443d4cc797fe645527acee59e7deaa0a2/PyYAML-6.0.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached PyYAML-6.0.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (2.1 kB)
Requirement already satisfied: backcall in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: jedi>=0.16 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.19.1)
Requirement already satisfied: matplotlib-inline in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: pickleshare in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (3.0.39)
Requirement already satisfied: pygments>=2.4.0 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.16.1)
Requirement already satisfied: stack-data in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.6.3)
Requirement already satisfied: traitlets>=5 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.11.2)
Requirement already satisfied: exceptiongroup in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.1.3)
Requirement already satisfied: pexpect>4.3 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (4.8.0)
Requirement already satisfied: appnope in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.1.3)
Collecting docopt>=0.6.2 (from num2words->-r extensions/silero_tts/requirements.txt (line 2))
  Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting antlr4-python3-runtime==4.9.* (from omegaconf->-r extensions/silero_tts/requirements.txt (line 3))
  Using cached antlr4_python3_runtime-4.9.3-py3-none-any.whl
Requirement already satisfied: parso<0.9.0,>=0.8.3 in ./installer_files/env/lib/python3.10/site-packages (from jedi>=0.16->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: ptyprocess>=0.5 in ./installer_files/env/lib/python3.10/site-packages (from pexpect>4.3->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.0)
Requirement already satisfied: wcwidth in ./installer_files/env/lib/python3.10/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.8)
Requirement already satisfied: executing>=1.2.0 in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: asttokens>=2.1.0 in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.4.0)
Requirement already satisfied: pure-eval in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six>=1.12.0 in ./installer_files/env/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.16.0)
Using cached PyYAML-6.0.1-cp310-cp310-macosx_10_9_x86_64.whl (189 kB)
Installing collected packages: pydub, docopt, antlr4-python3-runtime, PyYAML, num2words, omegaconf
Successfully installed PyYAML-6.0.1 antlr4-python3-runtime-4.9.3 docopt-0.6.2 num2words-0.5.12 omegaconf-2.3.0 pydub-0.25.1
Collecting flask_cloudflared==0.0.14 (from -r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for flask_cloudflared==0.0.14 from https://files.pythonhosted.org/packages/f9/e0/d90aa747ae35adfcd6fa116936b1eb42a6e5d8c69419694862476cefd34b/flask_cloudflared-0.0.14-py3-none-any.whl.metadata
  Using cached flask_cloudflared-0.0.14-py3-none-any.whl.metadata (4.6 kB)
Collecting websockets==11.0.2 (from -r extensions/api/requirements.txt (line 2))
  Using cached websockets-11.0.2-cp310-cp310-macosx_10_9_x86_64.whl (120 kB)
Collecting Flask>=0.8 (from flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for Flask>=0.8 from https://files.pythonhosted.org/packages/36/42/015c23096649b908c809c69388a805a571a3bea44362fe87e33fc3afa01f/flask-3.0.0-py3-none-any.whl.metadata
  Using cached flask-3.0.0-py3-none-any.whl.metadata (3.6 kB)
Requirement already satisfied: requests in ./installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.31.0)
Collecting Werkzeug>=3.0.0 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for Werkzeug>=3.0.0 from https://files.pythonhosted.org/packages/b6/a5/54b01f663d60d5334f6c9c87c26274e94617a4fd463d812463626423b10d/werkzeug-3.0.0-py3-none-any.whl.metadata
  Using cached werkzeug-3.0.0-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: Jinja2>=3.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.1.2)
Collecting itsdangerous>=2.1.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.1.3 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for click>=8.1.3 from https://files.pythonhosted.org/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl.metadata
  Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting blinker>=1.6.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for blinker>=1.6.2 from https://files.pythonhosted.org/packages/bf/2b/11bcedb7dee4923253a4a21bae3be854bcc4f06295bd827756352016d97c/blinker-1.6.3-py3-none-any.whl.metadata
  Using cached blinker-1.6.3-py3-none-any.whl.metadata (1.9 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2023.7.22)
Requirement already satisfied: MarkupSafe>=2.0 in ./installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.1.3)
Using cached flask_cloudflared-0.0.14-py3-none-any.whl (6.4 kB)
Using cached flask-3.0.0-py3-none-any.whl (99 kB)
Using cached blinker-1.6.3-py3-none-any.whl (13 kB)
Using cached click-8.1.7-py3-none-any.whl (97 kB)
Using cached werkzeug-3.0.0-py3-none-any.whl (226 kB)
Installing collected packages: Werkzeug, websockets, itsdangerous, click, blinker, Flask, flask_cloudflared
  Attempting uninstall: websockets
    Found existing installation: websockets 11.0.3
    Uninstalling websockets-11.0.3:
      Successfully uninstalled websockets-11.0.3
Successfully installed Flask-3.0.0 Werkzeug-3.0.0 blinker-1.6.3 click-8.1.7 flask_cloudflared-0.0.14 itsdangerous-2.1.2 websockets-11.0.2
Collecting git+https://github.com/oobabooga/whisper.git (from -r extensions/whisper_stt/requirements.txt (line 2))
  Cloning https://github.com/oobabooga/whisper.git to /private/var/folders/lc/ch9q1lls0mnfv9m_m51q2vzm0000gn/T/pip-req-build-z406m6pq
  Running command git clone --filter=blob:none --quiet https://github.com/oobabooga/whisper.git /private/var/folders/lc/ch9q1lls0mnfv9m_m51q2vzm0000gn/T/pip-req-build-z406m6pq
  Resolved https://github.com/oobabooga/whisper.git to commit 958ee4f6e1e65425ba02c440fc083089d58f5c71
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting SpeechRecognition==3.10.0 (from -r extensions/whisper_stt/requirements.txt (line 1))
  Using cached SpeechRecognition-3.10.0-py2.py3-none-any.whl (32.8 MB)
Collecting soundfile (from -r extensions/whisper_stt/requirements.txt (line 3))
  Using cached soundfile-0.12.1-py2.py3-none-macosx_10_9_x86_64.whl (1.2 MB)
Collecting ffmpeg (from -r extensions/whisper_stt/requirements.txt (line 4))
  Using cached ffmpeg-1.4-py3-none-any.whl
Requirement already satisfied: requests>=2.26.0 in ./installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.31.0)
Collecting numba (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for numba from https://files.pythonhosted.org/packages/4a/1d/ecc1948837253fd3f7a99b720838602396fcee765d614d1a38e9de15aea7/numba-0.58.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numba-0.58.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (2.7 kB)
Requirement already satisfied: numpy in ./installer_files/env/lib/python3.10/site-packages (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2)) (1.26.0)
Collecting tqdm (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for tqdm from https://files.pythonhosted.org/packages/00/e5/f12a80907d0884e6dff9c16d0c0114d81b8cd07dc3ae54c5e962cc83037e/tqdm-4.66.1-py3-none-any.whl.metadata
  Using cached tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
Collecting more-itertools (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for more-itertools from https://files.pythonhosted.org/packages/5a/cb/6dce742ea14e47d6f565589e859ad225f2a5de576d7696e0623b784e226b/more_itertools-10.1.0-py3-none-any.whl.metadata
  Using cached more_itertools-10.1.0-py3-none-any.whl.metadata (33 kB)
Collecting tiktoken==0.3.3 (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Using cached tiktoken-0.3.3-cp310-cp310-macosx_10_9_x86_64.whl (735 kB)
Collecting regex>=2022.1.18 (from tiktoken==0.3.3->openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for regex>=2022.1.18 from https://files.pythonhosted.org/packages/2c/6b/4828fdbbabcb51986ddc1e7c618cf9dc8606f75c2f0cc381d3729cf31348/regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (40 kB)
Collecting cffi>=1.0 (from soundfile->-r extensions/whisper_stt/requirements.txt (line 3))
  Obtaining dependency information for cffi>=1.0 from https://files.pythonhosted.org/packages/aa/aa/1c43e48a6f361d1529f9e4602d6992659a0107b5f21cae567e2eddcf8d66/cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (1.5 kB)
Collecting pycparser (from cffi>=1.0->soundfile->-r extensions/whisper_stt/requirements.txt (line 3))
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2023.7.22)
Collecting llvmlite<0.42,>=0.41.0dev0 (from numba->openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for llvmlite<0.42,>=0.41.0dev0 from https://files.pythonhosted.org/packages/f8/86/6ccfede8416d5a32faef1b778767b0d49d8e8e8c63508b02d8ef87a81643/llvmlite-0.41.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached llvmlite-0.41.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (4.8 kB)
Collecting numpy (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for numpy from https://files.pythonhosted.org/packages/d5/50/8aedb5ff1460e7c8527af15c6326115009e7c270ec705487155b779ebabb/numpy-1.25.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numpy-1.25.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata (5.6 kB)
Using cached cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl (182 kB)
Using cached more_itertools-10.1.0-py3-none-any.whl (55 kB)
Using cached numba-0.58.0-cp310-cp310-macosx_10_9_x86_64.whl (2.6 MB)
Using cached numpy-1.25.2-cp310-cp310-macosx_10_9_x86_64.whl (20.8 MB)
Using cached tqdm-4.66.1-py3-none-any.whl (78 kB)
Using cached llvmlite-0.41.0-cp310-cp310-macosx_10_9_x86_64.whl (31.0 MB)
Using cached regex-2023.10.3-cp310-cp310-macosx_10_9_x86_64.whl (296 kB)
Building wheels for collected packages: openai-whisper
  Building wheel for openai-whisper (pyproject.toml) ... done
  Created wheel for openai-whisper: filename=openai_whisper-20230918-py3-none-any.whl size=798448 sha256=bfb1ab5a2d5a8ac76ee5424b1c7f25ffcb1a8333c8e8bf38a8e812ad5e99100f
  Stored in directory: /private/var/folders/lc/ch9q1lls0mnfv9m_m51q2vzm0000gn/T/pip-ephem-wheel-cache-08r10c4p/wheels/09/f2/aa/bea939dd47f3b5d0d3f25f04665123b26a510e6f5faaae2b64
Successfully built openai-whisper
Installing collected packages: ffmpeg, tqdm, regex, pycparser, numpy, more-itertools, llvmlite, tiktoken, SpeechRecognition, numba, cffi, soundfile, openai-whisper
  Attempting uninstall: numpy
    Found existing installation: numpy 1.26.0
    Uninstalling numpy-1.26.0:
      Successfully uninstalled numpy-1.26.0
Successfully installed SpeechRecognition-3.10.0 cffi-1.16.0 ffmpeg-1.4 llvmlite-0.41.0 more-itertools-10.1.0 numba-0.58.0 numpy-1.25.2 openai-whisper-20230918 pycparser-2.21 regex-2023.10.3 soundfile-0.12.1 tiktoken-0.3.3 tqdm-4.66.1
Requirement already satisfied: SpeechRecognition==3.10.0 in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/openai/requirements.txt (line 1)) (3.10.0)
Collecting flask_cloudflared==0.0.12 (from -r extensions/openai/requirements.txt (line 2))
  Using cached flask_cloudflared-0.0.12-py3-none-any.whl (6.3 kB)
Collecting sentence-transformers (from -r extensions/openai/requirements.txt (line 3))
  Using cached sentence_transformers-2.2.2-py3-none-any.whl
Requirement already satisfied: tiktoken in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/openai/requirements.txt (line 4)) (0.3.3)
Collecting tiktoken (from -r extensions/openai/requirements.txt (line 4))
  Obtaining dependency information for tiktoken from https://files.pythonhosted.org/packages/0b/c9/cd8a2e95078f94a40bf1408c0ac353570114976fda90fc8da62d3c85fff6/tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (6.6 kB)
Requirement already satisfied: requests>=2.26.0 in ./installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: Flask>=0.8 in ./installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.0.0)
Collecting transformers<5.0.0,>=4.6.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for transformers<5.0.0,>=4.6.0 from https://files.pythonhosted.org/packages/1a/d1/3bba59606141ae808017f6fde91453882f931957f125009417b87a281067/transformers-4.34.0-py3-none-any.whl.metadata
  Using cached transformers-4.34.0-py3-none-any.whl.metadata (121 kB)
Requirement already satisfied: tqdm in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (4.66.1)
Requirement already satisfied: torch>=1.6.0 in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2.1.0)
Requirement already satisfied: torchvision in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (0.16.0)
Requirement already satisfied: numpy in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.25.2)
Collecting scikit-learn (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for scikit-learn from https://files.pythonhosted.org/packages/74/17/01347a4e2298edd6d152b79d4d042f902a618ccaf4c070f0a61999a26156/scikit_learn-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached scikit_learn-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl.metadata (11 kB)
Collecting scipy (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for scipy from https://files.pythonhosted.org/packages/6d/bc/6f79da3a8edf5f432ccdc49fd35e8b4fe2ce1d4ad3b5360c742101a57838/scipy-1.11.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached scipy-1.11.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (60 kB)
Collecting nltk (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Using cached nltk-3.8.1-py3-none-any.whl (1.5 MB)
Collecting sentencepiece (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Using cached sentencepiece-0.1.99-cp310-cp310-macosx_10_9_x86_64.whl (1.2 MB)
Collecting huggingface-hub>=0.4.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for huggingface-hub>=0.4.0 from https://files.pythonhosted.org/packages/ef/b5/b6107bd65fa4c96fdf00e4733e2fe5729bb9e5e09997f63074bb43d3ab28/huggingface_hub-0.18.0-py3-none-any.whl.metadata
  Using cached huggingface_hub-0.18.0-py3-none-any.whl.metadata (13 kB)
Requirement already satisfied: regex>=2022.1.18 in ./installer_files/env/lib/python3.10/site-packages (from tiktoken->-r extensions/openai/requirements.txt (line 4)) (2023.10.3)
Requirement already satisfied: Werkzeug>=3.0.0 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.0.0)
Requirement already satisfied: Jinja2>=3.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (8.1.7)
Requirement already satisfied: blinker>=1.6.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (1.6.3)
Requirement already satisfied: filelock in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (3.12.4)
Requirement already satisfied: fsspec>=2023.5.0 in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2023.9.2)
Requirement already satisfied: pyyaml>=5.1 in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (6.0.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (4.8.0)
Collecting packaging>=20.9 (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for packaging>=20.9 from https://files.pythonhosted.org/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl.metadata
  Using cached packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2023.7.22)
Requirement already satisfied: sympy in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.12)
Requirement already satisfied: networkx in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (3.1)
Collecting tokenizers<0.15,>=0.14 (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for tokenizers<0.15,>=0.14 from https://files.pythonhosted.org/packages/f4/3e/3e8800424cee3d3097f84ca1a70311a4fdf14646f6cff934512c619c9ebe/tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl.metadata
  Using cached tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl.metadata (6.7 kB)
Collecting safetensors>=0.3.1 (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for safetensors>=0.3.1 from https://files.pythonhosted.org/packages/79/dc/a72eb060f4f598314c5a96676d3790b51fff78e448253c7319a9441228a7/safetensors-0.4.0-cp310-cp310-macosx_10_7_x86_64.whl.metadata
  Using cached safetensors-0.4.0-cp310-cp310-macosx_10_7_x86_64.whl.metadata (3.8 kB)
Collecting joblib (from nltk->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for joblib from https://files.pythonhosted.org/packages/10/40/d551139c85db202f1f384ba8bcf96aca2f329440a844f924c8a0040b6d02/joblib-1.3.2-py3-none-any.whl.metadata
  Using cached joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for threadpoolctl>=2.0.0 from https://files.pythonhosted.org/packages/81/12/fd4dea011af9d69e1cad05c75f3f7202cdcbeac9b712eea58ca779a72865/threadpoolctl-3.2.0-py3-none-any.whl.metadata
  Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./installer_files/env/lib/python3.10/site-packages (from torchvision->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (10.0.1)
Requirement already satisfied: MarkupSafe>=2.0 in ./installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (2.1.3)
Collecting huggingface-hub>=0.4.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for huggingface-hub>=0.4.0 from https://files.pythonhosted.org/packages/aa/f3/3fc97336a0e90516901befd4f500f08d691034d387406fdbde85bea827cc/huggingface_hub-0.17.3-py3-none-any.whl.metadata
  Using cached huggingface_hub-0.17.3-py3-none-any.whl.metadata (13 kB)
Requirement already satisfied: mpmath>=0.19 in ./installer_files/env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.3.0)
Using cached tiktoken-0.5.1-cp310-cp310-macosx_10_9_x86_64.whl (953 kB)
Using cached transformers-4.34.0-py3-none-any.whl (7.7 MB)
Using cached scikit_learn-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl (10.2 MB)
Using cached scipy-1.11.3-cp310-cp310-macosx_10_9_x86_64.whl (37.3 MB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached packaging-23.2-py3-none-any.whl (53 kB)
Using cached safetensors-0.4.0-cp310-cp310-macosx_10_7_x86_64.whl (439 kB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whl (2.5 MB)
Using cached huggingface_hub-0.17.3-py3-none-any.whl (295 kB)
Installing collected packages: sentencepiece, threadpoolctl, scipy, safetensors, packaging, joblib, tiktoken, scikit-learn, nltk, huggingface-hub, tokenizers, flask_cloudflared, transformers, sentence-transformers
  Attempting uninstall: tiktoken
    Found existing installation: tiktoken 0.3.3
    Uninstalling tiktoken-0.3.3:
      Successfully uninstalled tiktoken-0.3.3
  Attempting uninstall: flask_cloudflared
    Found existing installation: flask-cloudflared 0.0.14
    Uninstalling flask-cloudflared-0.0.14:
      Successfully uninstalled flask-cloudflared-0.0.14
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
openai-whisper 20230918 requires tiktoken==0.3.3, but you have tiktoken 0.5.1 which is incompatible.
Successfully installed flask_cloudflared-0.0.12 huggingface-hub-0.17.3 joblib-1.3.2 nltk-3.8.1 packaging-23.2 safetensors-0.4.0 scikit-learn-1.3.1 scipy-1.11.3 sentence-transformers-2.2.2 sentencepiece-0.1.99 threadpoolctl-3.2.0 tiktoken-0.5.1 tokenizers-0.14.1 transformers-4.34.0
Collecting deep-translator==1.9.2 (from -r extensions/google_translate/requirements.txt (line 1))
  Using cached deep_translator-1.9.2-py3-none-any.whl (30 kB)
Collecting beautifulsoup4<5.0.0,>=4.9.1 (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1))
  Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in ./installer_files/env/lib/python3.10/site-packages (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.31.0)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1))
  Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
  Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.0.6)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2023.7.22)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: soupsieve, beautifulsoup4, deep-translator
Successfully installed beautifulsoup4-4.12.2 deep-translator-1.9.2 soupsieve-2.5

*******************************************************************
* Installing webui requirements from file: requirements_apple_intel.txt
*******************************************************************

WARNING: Skipping torch-grammar as it is not installed.
Uninstalled torch-grammar
Collecting git+https://github.com/oobabooga/torch-grammar.git (from -r temp_requirements.txt (line 28))
  Cloning https://github.com/oobabooga/torch-grammar.git to /private/var/folders/lc/ch9q1lls0mnfv9m_m51q2vzm0000gn/T/pip-req-build-ah42fh09
  Running command git clone --filter=blob:none --quiet https://github.com/oobabooga/torch-grammar.git /private/var/folders/lc/ch9q1lls0mnfv9m_m51q2vzm0000gn/T/pip-req-build-ah42fh09
  Resolved https://github.com/oobabooga/torch-grammar.git to commit 82850b5383a629f3b0fa1fba7d8f2aba3185ddb2
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system == "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "21.0.0" and platform_release < "22.0.0"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "22.0.0" and platform_release < "23.0.0"' don't match your environment
ERROR: llama_cpp_python-0.2.11-cp310-cp310-macosx_14_0_x86_64.whl is not a supported wheel on this platform.
Command '. "/Users/dante/Downloads/text-generation-webui-main/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/Users/dante/Downloads/text-generation-webui-main/installer_files/env" && python -m pip install -r temp_requirements.txt --upgrade' failed with exit status code '1'.

Exiting now.
Try running the start/update script again.
dante@Dantes-MacBook-Pro text-generation-webui-main %
qianzhangxa commented 1 year ago

I have the exactly same issue on my Macbook Pro 2019.

image

bmaier commented 1 year ago

Same error on Macbook Pro Sonoma.

Manual installation result in the same bug:

image
borkeszmate commented 1 year ago

Same error here. Macbook Pro Intel Sonoma.

Screenshot 2023-10-15 at 16 32 44
estebanavv commented 1 year ago

Someone mentioned to revert it to v1.6, I did it for 1.6.1 and didn't work but v1.6 did. This is the command I used to create a new install: git clone --depth 1 --branch v1.6 https://github.com/oobabooga/text-generation-webui.git oobabooga

stobbsc commented 1 year ago

I'm getting the same issue with Mac Intel, Radeon Pro

blacklizard commented 1 year ago

Same issue in intel mac with radeon, running macos 12.6.1

ThaMacroMan commented 1 year ago

Exact same issue for me as well

ThaMacroMan commented 1 year ago

I ran the updated install.json and got this still. It did get a lot further into the install though

Screenshot 2023-10-29 at 6 16 20 PM

mianaito commented 1 year ago

I think the problem is not in text-generation-webui but in pip, as shown in pip on macos-12 does not support wheels built on the same platform (problem appeared on Jul 21).

Certainly something is weird in what pip returns.

bash-5.2$ sw_vers
ProductName:    macOS
ProductVersion: 12.7.1
BuildVersion:   21G920

In this system, pip should support tags '-macosx12'. However, it returns '-macosx10' instead.

bash-5.2$ pip debug --verbose
(...)
Compatible tags: 1807
  cp310-cp310-macosx_10_16_x86_64
  cp310-cp310-macosx_10_16_intel
  cp310-cp310-macosx_10_16_fat64
  cp310-cp310-macosx_10_16_fat32
  cp310-cp310-macosx_10_16_universal2
  cp310-cp310-macosx_10_16_universal
(...)

A workaround to set the environment variable SYSTEM_VERSION_COMPAT to zero is suggested there. It certainly works on my system.

bash-5.2$ pip install -r ./requirements_apple_intel.txt
(...)
Ignoring bitsandbytes: markers 'platform_system == "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0" and python_version == "3.11"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0" and python_version == "3.10"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0" and python_version == "3.9"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "20.0.0" and platform_release < "21.0.0" and python_version == "3.8"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Darwin" and platform_release >= "21.0.0" and platform_release < "22.0.0" and python_version == "3.11"' don't match your environment
ERROR: llama_cpp_python-0.2.11-cp310-cp310-macosx_12_0_x86_64.whl is not a supported wheel on this platform.
bash-5.2$ SYSTEM_VERSION_COMPAT=0 pip install -r ./requirements_apple_intel.txt
(...)
Collecting llama-cpp-python==0.2.11 (from -r ./requirements_apple_intel.txt (line 35))
  Downloading https://github.com/jllllll/llama-cpp-python-cuBLAS-wheels/releases/download/metal/llama_cpp_python-0.2.11-cp310-cp310-macosx_12_0_x86_64.whl (1.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 5.8 MB/s eta 0:00:00
(...)
Successfully installed GitPython-3.1.40 absl-py-2.0.0 accelerate-0.24.1 appdirs-1.4.4 bitsandbytes-0.41.1 cachetools-5.3.2 colorama-0.4.6 coloredlogs-15.0.1 cramjam-2.7.0 docker-pycreds-0.4.0 einops-0.7.0 exllamav2-0.0.6 fastparquet-2023.10.1 gitdb-4.0.11 google-auth-2.23.4 google-auth-oauthlib-1.1.0 gradio-3.50.2 gradio-client-0.6.1 grpcio-1.59.2 humanfriendly-10.0 ninja-1.11.1.1 numpy-1.24.4 oauthlib-3.2.2 optimum-1.13.1 pathtools-0.1.2 protobuf-4.23.4 pyasn1-0.5.0 pyasn1-modules-0.3.0 requests-oauthlib-1.3.1 rsa-4.9 safetensors-0.4.0 sentry-sdk-1.34.0 setproctitle-1.3.3 smmap-5.0.1 tensorboard-2.15.1 tensorboard-data-server-0.7.2 wandb-0.15.12
estebanavv commented 12 months ago

thank you @mianaito this worked. In my case I haven't been able to set it to use the RX 580 GPU and your method ends with AVX = 0 | AVX2 = 0 which makes it very slow. So instead, I had to install it from the source using the following after completing execution of ./update_macos , this made it run 300% faster with CPU only 

text-generation-webui git:(main) ✗ ./cmd_macos.sh

The default interactive shell is now zsh.
To update your account to use zsh, please run `chsh -s /bin/zsh`.
For more details, please visit https://support.apple.com/kb/HT208050.
bash-3.2$ pip uninstall llama-cpp-python -y
...
bash-3.2$ SYSTEM_VERSION_COMPAT=0 CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python --verbose --force-reinstall --no-cache-dir

You can confirm it worked by checking this after loading the model: AVX = 1 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 |

github-actions[bot] commented 10 months ago

This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.