search

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.92k stars 5.34k forks source link

After update textgen not working #4208

Closed Free-Radical closed 11 months ago

Free-Radical commented 1 year ago

Describe the bug

$ ./update_linux.sh $ ./start_linux.sh 2023-10-06 18:04:19 INFO:Loading settings from settings.yaml... 2023-10-06 18:04:19 INFO:Loading the extension "gallery"... Starting streaming server at ws://127.0.0.1:5005/api/v1/stream Starting API at http://127.0.0.1:5000/api Traceback (most recent call last): File "/home/adminpersivia/apps/text-generation-webui-main/server.py", line 229, in create_interface() File "/home/adminpersivia/apps/text-generation-webui-main/server.py", line 128, in create_interface ui_model_menu.create_event_handlers() File "/home/adminpersivia/apps/text-generation-webui-main/modules/ui_model_menu.py", line 143, in create_event_handlers loaders.make_loader_params_visible, gradio('loader'), gradio(loaders.get_all_params())).then( File "/home/adminpersivia/apps/text-generation-webui-main/modules/utils.py", line 15, in gradio return [shared.gradio[k] for k in keys] File "/home/adminpersivia/apps/text-generation-webui-main/modules/utils.py", line 15, in return [shared.gradio[k] for k in keys] KeyError: 'use_fast'

Is there an existing issue for this?

Reproduction

$ ./update_linux.sh $ ./start_linux.sh

Screenshot

No response

Logs

2023-10-06 18:04:19 INFO:Loading settings from settings.yaml...
2023-10-06 18:04:19 INFO:Loading the extension "gallery"...
Starting streaming server at ws://127.0.0.1:5005/api/v1/stream
Starting API at http://127.0.0.1:5000/api
Traceback (most recent call last):
  File "/home/adminpersivia/apps/text-generation-webui-main/server.py", line 229, in <module>
    create_interface()
  File "/home/adminpersivia/apps/text-generation-webui-main/server.py", line 128, in create_interface
    ui_model_menu.create_event_handlers()
  File "/home/adminpersivia/apps/text-generation-webui-main/modules/ui_model_menu.py", line 143, in create_event_handlers
    loaders.make_loader_params_visible, gradio('loader'), gradio(loaders.get_all_params())).then(
  File "/home/adminpersivia/apps/text-generation-webui-main/modules/utils.py", line 15, in gradio
    return [shared.gradio[k] for k in keys]
  File "/home/adminpersivia/apps/text-generation-webui-main/modules/utils.py", line 15, in <listcomp>
    return [shared.gradio[k] for k in keys]
KeyError: 'use_fast'

System Info

Ubuntu 22.04.3 LTS
GNOME Shell 42.9
6.2.0-33-generic
NVIDIA GEFORCE RTX 3080 (x2)
SpiritusSancti5 commented 1 year ago

The old install for Linux was working great. I'm at the point where I might go look for that or get a different chat UI altogether.

Free-Radical commented 1 year ago

Switched to latest 1.7, new isolatted textgen install, STILL NOT WORKING!

this really sucks cause i'm doing work with textgen

New errors below-

RuntimeError: 
        CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

FULL CMD OUTPUT-

 $ ./start_linux.sh 
Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.3.1-0-Linux-x86_64.sh to /home/adminpersivia/apps/text-generation-webui/installer_files/miniconda_installer.sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 69.7M  100 69.7M    0     0  97.2M      0 --:--:-- --:--:-- --:--:-- 97.2M
PREFIX=/home/adminpersivia/apps/text-generation-webui/installer_files/conda
Unpacking payload ...

Installing base environment...

Downloading and Extracting Packages

Downloading and Extracting Packages

Preparing transaction: done
Executing transaction: done
installation finished.
Miniconda version:
conda 23.3.1
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 23.9.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.9.0

## Package Plan ##

  environment location: /home/adminpersivia/apps/text-generation-webui/installer_files/env

  added / updated specs:
    - python=3.10

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ca-certificates-2023.08.22 |       h06a4308_0         123 KB
    libffi-3.4.4               |       h6a678d5_0         142 KB
    openssl-3.0.11             |       h7f8727e_2         5.2 MB
    pip-23.2.1                 |  py310h06a4308_0         2.6 MB
    python-3.10.13             |       h955ad1f_0        26.8 MB
    setuptools-68.0.0          |  py310h06a4308_0         936 KB
    sqlite-3.41.2              |       h5eee18b_0         1.2 MB
    wheel-0.41.2               |  py310h06a4308_0         109 KB
    xz-5.4.2                   |       h5eee18b_0         642 KB
    ------------------------------------------------------------
                                           Total:        37.7 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/linux-64::_libgcc_mutex-0.1-main 
  _openmp_mutex      pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu 
  bzip2              pkgs/main/linux-64::bzip2-1.0.8-h7b6447c_0 
  ca-certificates    pkgs/main/linux-64::ca-certificates-2023.08.22-h06a4308_0 
  ld_impl_linux-64   pkgs/main/linux-64::ld_impl_linux-64-2.38-h1181459_1 
  libffi             pkgs/main/linux-64::libffi-3.4.4-h6a678d5_0 
  libgcc-ng          pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1 
  libgomp            pkgs/main/linux-64::libgomp-11.2.0-h1234567_1 
  libstdcxx-ng       pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1 
  libuuid            pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0 
  ncurses            pkgs/main/linux-64::ncurses-6.4-h6a678d5_0 
  openssl            pkgs/main/linux-64::openssl-3.0.11-h7f8727e_2 
  pip                pkgs/main/linux-64::pip-23.2.1-py310h06a4308_0 
  python             pkgs/main/linux-64::python-3.10.13-h955ad1f_0 
  readline           pkgs/main/linux-64::readline-8.2-h5eee18b_0 
  setuptools         pkgs/main/linux-64::setuptools-68.0.0-py310h06a4308_0 
  sqlite             pkgs/main/linux-64::sqlite-3.41.2-h5eee18b_0 
  tk                 pkgs/main/linux-64::tk-8.6.12-h1ccaba5_0 
  tzdata             pkgs/main/noarch::tzdata-2023c-h04d1e81_0 
  wheel              pkgs/main/linux-64::wheel-0.41.2-py310h06a4308_0 
  xz                 pkgs/main/linux-64::xz-5.4.2-h5eee18b_0 
  zlib               pkgs/main/linux-64::zlib-1.2.13-h5eee18b_0 

Downloading and Extracting Packages

Preparing transaction: done                                                                                       
Verifying transaction: done                                                                                       
Executing transaction: done                                                                                       
#                                                                                                                 
# To activate this environment, use                                                                               
#                                                                                                                 
#     $ conda activate /home/adminpersivia/apps/text-generation-webui/installer_files/env                         
#                                                                                                                 
# To deactivate an active environment, use
#
#     $ conda deactivate

What is your GPU?

A) NVIDIA
B) AMD (Linux/MacOS only. Requires ROCm SDK 5.6 on Linux)
C) Apple M Series
D) Intel Arc (IPEX)
N) None (I want to run models in CPU mode)

Input> a
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.3.1
  latest version: 23.9.0

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.9.0

## Package Plan ##

  environment location: /home/adminpersivia/apps/text-generation-webui/installer_files/env

  added / updated specs:
    - git
    - ninja

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    c-ares-1.19.1              |       h5eee18b_0         118 KB
    curl-8.2.1                 |       hdbd6064_0          83 KB
    expat-2.5.0                |       h6a678d5_0         172 KB
    gdbm-1.18                  |       hd4cb3f1_4         194 KB
    gettext-0.21.0             |       h39681ba_1         3.0 MB
    git-2.40.1                 | pl5340h36fbf9e_1         9.9 MB
    icu-73.1                   |       h6a678d5_0        25.9 MB
    krb5-1.20.1                |       h143b758_1         1.3 MB
    libcurl-8.2.1              |       h251f7ec_0         399 KB
    libedit-3.1.20221030       |       h5eee18b_0         181 KB
    libev-4.33                 |       h7f8727e_1         111 KB
    libnghttp2-1.52.0          |       h2d74bed_1         672 KB
    libssh2-1.10.0             |       hdbd6064_2         292 KB
    libxml2-2.10.4             |       hf1b16e4_1         753 KB
    ninja-1.10.2               |       h06a4308_5           8 KB
    ninja-base-1.10.2          |       hd09550d_5         109 KB
    pcre2-10.42                |       hebb0a14_0         1.5 MB
    perl-5.34.0                |       h5eee18b_2        12.4 MB
    ------------------------------------------------------------
                                           Total:        57.2 MB

The following NEW packages will be INSTALLED:

  c-ares             pkgs/main/linux-64::c-ares-1.19.1-h5eee18b_0 
  curl               pkgs/main/linux-64::curl-8.2.1-hdbd6064_0 
  expat              pkgs/main/linux-64::expat-2.5.0-h6a678d5_0 
  gdbm               pkgs/main/linux-64::gdbm-1.18-hd4cb3f1_4 
  gettext            pkgs/main/linux-64::gettext-0.21.0-h39681ba_1 
  git                pkgs/main/linux-64::git-2.40.1-pl5340h36fbf9e_1 
  icu                pkgs/main/linux-64::icu-73.1-h6a678d5_0 
  krb5               pkgs/main/linux-64::krb5-1.20.1-h143b758_1 
  libcurl            pkgs/main/linux-64::libcurl-8.2.1-h251f7ec_0 
  libedit            pkgs/main/linux-64::libedit-3.1.20221030-h5eee18b_0 
  libev              pkgs/main/linux-64::libev-4.33-h7f8727e_1 
  libnghttp2         pkgs/main/linux-64::libnghttp2-1.52.0-h2d74bed_1 
  libssh2            pkgs/main/linux-64::libssh2-1.10.0-hdbd6064_2 
  libxml2            pkgs/main/linux-64::libxml2-2.10.4-hf1b16e4_1 
  ninja              pkgs/main/linux-64::ninja-1.10.2-h06a4308_5 
  ninja-base         pkgs/main/linux-64::ninja-base-1.10.2-hd09550d_5 
  pcre2              pkgs/main/linux-64::pcre2-10.42-hebb0a14_0 
  perl               pkgs/main/linux-64::perl-5.34.0-h5eee18b_2 

Downloading and Extracting Packages

Preparing transaction: done                                                                                       
Verifying transaction: done                                                                                       
Executing transaction: done                                                                                       
Looking in indexes: https://download.pytorch.org/whl/cu118                                                        
Collecting torch                                                                                                  
  Downloading https://download.pytorch.org/whl/cu118/torch-2.1.0%2Bcu118-cp310-cp310-linux_x86_64.whl (2325.9 MB) 
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.3/2.3 GB 2.7 MB/s eta 0:00:00
Collecting torchvision                                                                                            
  Downloading https://download.pytorch.org/whl/cu118/torchvision-0.16.0%2Bcu118-cp310-cp310-linux_x86_64.whl (6.2 MB)                                                                                                               
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 76.1 MB/s eta 0:00:00
Collecting torchaudio                                                                                             
  Downloading https://download.pytorch.org/whl/cu118/torchaudio-2.1.0%2Bcu118-cp310-cp310-linux_x86_64.whl (3.2 MB)                                                                                                                 
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 55.5 MB/s eta 0:00:00
Collecting filelock (from torch)                                                                                  
  Downloading https://download.pytorch.org/whl/filelock-3.9.0-py3-none-any.whl (9.7 kB)                           
Collecting typing-extensions (from torch)
  Downloading https://download.pytorch.org/whl/typing_extensions-4.4.0-py3-none-any.whl (26 kB)
Collecting sympy (from torch)
  Downloading https://download.pytorch.org/whl/sympy-1.12-py3-none-any.whl (5.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 72.2 MB/s eta 0:00:00
Collecting networkx (from torch)
  Downloading https://download.pytorch.org/whl/networkx-3.0-py3-none-any.whl (2.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 82.5 MB/s eta 0:00:00
Collecting jinja2 (from torch)
  Downloading https://download.pytorch.org/whl/Jinja2-3.1.2-py3-none-any.whl (133 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 kB 6.5 MB/s eta 0:00:00
Collecting fsspec (from torch)
  Downloading https://download.pytorch.org/whl/fsspec-2023.4.0-py3-none-any.whl (153 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.0/154.0 kB 6.8 MB/s eta 0:00:00
Collecting triton==2.1.0 (from torch)
  Downloading https://download.pytorch.org/whl/triton-2.1.0-0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.2/89.2 MB 33.5 MB/s eta 0:00:00
Collecting numpy (from torchvision)
  Downloading https://download.pytorch.org/whl/numpy-1.24.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 29.4 MB/s eta 0:00:00
Collecting requests (from torchvision)
  Downloading https://download.pytorch.org/whl/requests-2.28.1-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 2.7 MB/s eta 0:00:00
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision)
  Downloading https://download.pytorch.org/whl/Pillow-9.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 60.6 MB/s eta 0:00:00
Collecting MarkupSafe>=2.0 (from jinja2->torch)
  Downloading https://download.pytorch.org/whl/MarkupSafe-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting charset-normalizer<3,>=2 (from requests->torchvision)
  Downloading https://download.pytorch.org/whl/charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5 (from requests->torchvision)
  Downloading https://download.pytorch.org/whl/idna-3.4-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 9.4 MB/s eta 0:00:00
Collecting urllib3<1.27,>=1.21.1 (from requests->torchvision)
  Downloading https://download.pytorch.org/whl/urllib3-1.26.13-py2.py3-none-any.whl (140 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.6/140.6 kB 51.7 MB/s eta 0:00:00
Collecting certifi>=2017.4.17 (from requests->torchvision)
  Downloading https://download.pytorch.org/whl/certifi-2022.12.7-py3-none-any.whl (155 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 21.9 MB/s eta 0:00:00
Collecting mpmath>=0.19 (from sympy->torch)
  Downloading https://download.pytorch.org/whl/mpmath-1.3.0-py3-none-any.whl (536 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 54.1 MB/s eta 0:00:00
Installing collected packages: mpmath, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, fsspec, filelock, charset-normalizer, certifi, triton, requests, jinja2, torch, torchvision, torchaudio
Successfully installed MarkupSafe-2.1.2 certifi-2022.12.7 charset-normalizer-2.1.1 filelock-3.9.0 fsspec-2023.4.0 idna-3.4 jinja2-3.1.2 mpmath-1.3.0 networkx-3.0 numpy-1.24.1 pillow-9.3.0 requests-2.28.1 sympy-1.12 torch-2.1.0+cu118 torchaudio-2.1.0+cu118 torchvision-0.16.0+cu118 triton-2.1.0 typing-extensions-4.4.0 urllib3-1.26.13
Collecting py-cpuinfo==9.0.0
  Downloading py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Installing collected packages: py-cpuinfo
Successfully installed py-cpuinfo-9.0.0
Already up to date.

*******************************************************************
* Installing extensions requirements.
*******************************************************************

Collecting SpeechRecognition==3.10.0 (from -r extensions/openai/requirements.txt (line 1))
  Downloading SpeechRecognition-3.10.0-py2.py3-none-any.whl (32.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 32.8/32.8 MB 37.0 MB/s eta 0:00:00
Collecting flask_cloudflared==0.0.12 (from -r extensions/openai/requirements.txt (line 2))
  Downloading flask_cloudflared-0.0.12-py3-none-any.whl (6.3 kB)
Collecting sentence-transformers (from -r extensions/openai/requirements.txt (line 3))
  Downloading sentence-transformers-2.2.2.tar.gz (85 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.0/86.0 kB 44.2 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Collecting tiktoken (from -r extensions/openai/requirements.txt (line 4))
  Obtaining dependency information for tiktoken from https://files.pythonhosted.org/packages/f4/2e/0adf6e264b996e263b1c57cad6560ffd5492a69beb9fd779ed0463d486bc/tiktoken-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading tiktoken-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Requirement already satisfied: requests>=2.26.0 in ./installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2.28.1)
Collecting Flask>=0.8 (from flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2))
  Obtaining dependency information for Flask>=0.8 from https://files.pythonhosted.org/packages/36/42/015c23096649b908c809c69388a805a571a3bea44362fe87e33fc3afa01f/flask-3.0.0-py3-none-any.whl.metadata
  Downloading flask-3.0.0-py3-none-any.whl.metadata (3.6 kB)
Collecting transformers<5.0.0,>=4.6.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for transformers<5.0.0,>=4.6.0 from https://files.pythonhosted.org/packages/1a/d1/3bba59606141ae808017f6fde91453882f931957f125009417b87a281067/transformers-4.34.0-py3-none-any.whl.metadata
  Downloading transformers-4.34.0-py3-none-any.whl.metadata (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.5/121.5 kB 59.0 MB/s eta 0:00:00
Collecting tqdm (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for tqdm from https://files.pythonhosted.org/packages/00/e5/f12a80907d0884e6dff9c16d0c0114d81b8cd07dc3ae54c5e962cc83037e/tqdm-4.66.1-py3-none-any.whl.metadata
  Downloading tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.6/57.6 kB 29.6 MB/s eta 0:00:00
Requirement already satisfied: torch>=1.6.0 in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2.1.0+cu118)
Requirement already satisfied: torchvision in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (0.16.0+cu118)
Requirement already satisfied: numpy in ./installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.24.1)
Collecting scikit-learn (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for scikit-learn from https://files.pythonhosted.org/packages/7d/af/03d3a7d5719d00486c296ddd876e6f07a681bc4e079cb45348d2f261a748/scikit_learn-1.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading scikit_learn-1.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Collecting scipy (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for scipy from https://files.pythonhosted.org/packages/18/44/7e8d208eb59a8224fcc474415104f13be9b378be8da63f76dfde12ec2b44/scipy-1.11.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading scipy-1.11.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.4/60.4 kB 29.3 MB/s eta 0:00:00
Collecting nltk (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Downloading nltk-3.8.1-py3-none-any.whl (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 56.0 MB/s eta 0:00:00
Collecting sentencepiece (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Downloading sentencepiece-0.1.99-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 54.7 MB/s eta 0:00:00
Collecting huggingface-hub>=0.4.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for huggingface-hub>=0.4.0 from https://files.pythonhosted.org/packages/ef/b5/b6107bd65fa4c96fdf00e4733e2fe5729bb9e5e09997f63074bb43d3ab28/huggingface_hub-0.18.0-py3-none-any.whl.metadata
  Downloading huggingface_hub-0.18.0-py3-none-any.whl.metadata (13 kB)
Collecting regex>=2022.1.18 (from tiktoken->-r extensions/openai/requirements.txt (line 4))
  Obtaining dependency information for regex>=2022.1.18 from https://files.pythonhosted.org/packages/8f/3e/4b8b40eb3c80aeaf360f0361d956d129bb3d23b2a3ecbe3a04a8f3bdd6d3/regex-2023.10.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading regex-2023.10.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.9/40.9 kB 5.4 MB/s eta 0:00:00
Collecting Werkzeug>=3.0.0 (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2))
  Obtaining dependency information for Werkzeug>=3.0.0 from https://files.pythonhosted.org/packages/b6/a5/54b01f663d60d5334f6c9c87c26274e94617a4fd463d812463626423b10d/werkzeug-3.0.0-py3-none-any.whl.metadata
  Downloading werkzeug-3.0.0-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: Jinja2>=3.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (3.1.2)
Collecting itsdangerous>=2.1.2 (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2))
  Downloading itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.1.3 (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2))
  Obtaining dependency information for click>=8.1.3 from https://files.pythonhosted.org/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl.metadata
  Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting blinker>=1.6.2 (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2))
  Obtaining dependency information for blinker>=1.6.2 from https://files.pythonhosted.org/packages/bf/2b/11bcedb7dee4923253a4a21bae3be854bcc4f06295bd827756352016d97c/blinker-1.6.3-py3-none-any.whl.metadata
  Downloading blinker-1.6.3-py3-none-any.whl.metadata (1.9 kB)
Requirement already satisfied: filelock in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (3.9.0)
Collecting fsspec>=2023.5.0 (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for fsspec>=2023.5.0 from https://files.pythonhosted.org/packages/fe/d3/e1aa96437d944fbb9cc95d0316e25583886e9cd9e6adc07baad943524eda/fsspec-2023.9.2-py3-none-any.whl.metadata
  Downloading fsspec-2023.9.2-py3-none-any.whl.metadata (6.7 kB)
Collecting pyyaml>=5.1 (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for pyyaml>=5.1 from https://files.pythonhosted.org/packages/29/61/bf33c6c85c55bc45a29eee3195848ff2d518d84735eb0e2d8cb42e0d285e/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (4.4.0)
Collecting packaging>=20.9 (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for packaging>=20.9 from https://files.pythonhosted.org/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl.metadata
  Downloading packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Requirement already satisfied: charset-normalizer<3,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/openai/requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: sympy in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.12)
Requirement already satisfied: networkx in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (3.0)
Requirement already satisfied: triton==2.1.0 in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2.1.0)
Collecting tokenizers<0.15,>=0.14 (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for tokenizers<0.15,>=0.14 from https://files.pythonhosted.org/packages/a7/7b/c1f643eb086b6c5c33eef0c3752e37624bd23e4cbc9f1332748f1c6252d1/tokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading tokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting safetensors>=0.3.1 (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for safetensors>=0.3.1 from https://files.pythonhosted.org/packages/20/4e/878b080dbda92666233ec6f316a53969edcb58eab1aa399a64d0521cf953/safetensors-0.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading safetensors-0.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB)
Collecting joblib (from nltk->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for joblib from https://files.pythonhosted.org/packages/10/40/d551139c85db202f1f384ba8bcf96aca2f329440a844f924c8a0040b6d02/joblib-1.3.2-py3-none-any.whl.metadata
  Downloading joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for threadpoolctl>=2.0.0 from https://files.pythonhosted.org/packages/81/12/fd4dea011af9d69e1cad05c75f3f7202cdcbeac9b712eea58ca779a72865/threadpoolctl-3.2.0-py3-none-any.whl.metadata
  Downloading threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./installer_files/env/lib/python3.10/site-packages (from torchvision->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (9.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 2)) (2.1.2)
Collecting huggingface-hub>=0.4.0 (from sentence-transformers->-r extensions/openai/requirements.txt (line 3))
  Obtaining dependency information for huggingface-hub>=0.4.0 from https://files.pythonhosted.org/packages/aa/f3/3fc97336a0e90516901befd4f500f08d691034d387406fdbde85bea827cc/huggingface_hub-0.17.3-py3-none-any.whl.metadata
  Downloading huggingface_hub-0.17.3-py3-none-any.whl.metadata (13 kB)
Requirement already satisfied: fsspec in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (2023.4.0)
Requirement already satisfied: mpmath>=0.19 in ./installer_files/env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 3)) (1.3.0)
Downloading tiktoken-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 69.4 MB/s eta 0:00:00
Downloading flask-3.0.0-py3-none-any.whl (99 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 99.7/99.7 kB 52.0 MB/s eta 0:00:00
Downloading regex-2023.10.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 773.9/773.9 kB 67.5 MB/s eta 0:00:00
Downloading tqdm-4.66.1-py3-none-any.whl (78 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.3/78.3 kB 43.1 MB/s eta 0:00:00
Downloading transformers-4.34.0-py3-none-any.whl (7.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.7/7.7 MB 49.9 MB/s eta 0:00:00
Downloading scikit_learn-1.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (10.8 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.8/10.8 MB 48.9 MB/s eta 0:00:00
Downloading scipy-1.11.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36.4/36.4 MB 50.9 MB/s eta 0:00:00
Downloading blinker-1.6.3-py3-none-any.whl (13 kB)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 49.0 MB/s eta 0:00:00
Downloading fsspec-2023.9.2-py3-none-any.whl (173 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 173.4/173.4 kB 72.7 MB/s eta 0:00:00
Downloading joblib-1.3.2-py3-none-any.whl (302 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.2/302.2 kB 57.0 MB/s eta 0:00:00
Downloading packaging-23.2-py3-none-any.whl (53 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.0/53.0 kB 25.9 MB/s eta 0:00:00
Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 kB 78.5 MB/s eta 0:00:00
Downloading safetensors-0.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 73.5 MB/s eta 0:00:00
Downloading threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Downloading tokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 59.4 MB/s eta 0:00:00
Downloading huggingface_hub-0.17.3-py3-none-any.whl (295 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 295.0/295.0 kB 62.0 MB/s eta 0:00:00
Downloading werkzeug-3.0.0-py3-none-any.whl (226 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 226.6/226.6 kB 57.4 MB/s eta 0:00:00
Building wheels for collected packages: sentence-transformers
  Building wheel for sentence-transformers (setup.py) ... done
  Created wheel for sentence-transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125923 sha256=957861f9ff75b1853bdf5035407a187a64536ea4c159dceb99a83ebd914876f2
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/62/f2/10/1e606fd5f02395388f74e7462910fe851042f97238cbbd902f
Successfully built sentence-transformers
Installing collected packages: sentencepiece, Werkzeug, tqdm, threadpoolctl, scipy, safetensors, regex, pyyaml, packaging, joblib, itsdangerous, fsspec, click, blinker, tiktoken, SpeechRecognition, scikit-learn, nltk, huggingface-hub, Flask, tokenizers, flask_cloudflared, transformers, sentence-transformers
  Attempting uninstall: fsspec
    Found existing installation: fsspec 2023.4.0
    Uninstalling fsspec-2023.4.0:
      Successfully uninstalled fsspec-2023.4.0
Successfully installed Flask-3.0.0 SpeechRecognition-3.10.0 Werkzeug-3.0.0 blinker-1.6.3 click-8.1.7 flask_cloudflared-0.0.12 fsspec-2023.9.2 huggingface-hub-0.17.3 itsdangerous-2.1.2 joblib-1.3.2 nltk-3.8.1 packaging-23.2 pyyaml-6.0.1 regex-2023.10.3 safetensors-0.4.0 scikit-learn-1.3.1 scipy-1.11.3 sentence-transformers-2.2.2 sentencepiece-0.1.99 threadpoolctl-3.2.0 tiktoken-0.5.1 tokenizers-0.14.1 tqdm-4.66.1 transformers-4.34.0
Collecting elevenlabs==0.2.24 (from -r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for elevenlabs==0.2.24 from https://files.pythonhosted.org/packages/69/7e/6929391760fd37cc620bcd10850724844255fe551fb9554083ebcf0790fd/elevenlabs-0.2.24-py3-none-any.whl.metadata
  Downloading elevenlabs-0.2.24-py3-none-any.whl.metadata (811 bytes)
Collecting pydantic<2.0,>=1.10 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for pydantic<2.0,>=1.10 from https://files.pythonhosted.org/packages/e0/2f/d6f17f8385d718233bcae893d27525443d41201c938b68a4af3d591a33e4/pydantic-1.10.13-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading pydantic-1.10.13-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (149 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 149.6/149.6 kB 7.5 MB/s eta 0:00:00
Collecting ipython>=7.0 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for ipython>=7.0 from https://files.pythonhosted.org/packages/ef/02/fc039fca3ec40a00f962eb6e9da45c507334b0650a3cb9facd38d234fb7a/ipython-8.16.1-py3-none-any.whl.metadata
  Downloading ipython-8.16.1-py3-none-any.whl.metadata (5.9 kB)
Requirement already satisfied: requests>=2.20 in ./installer_files/env/lib/python3.10/site-packages (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.28.1)
Collecting websockets>=11.0 (from elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading websockets-11.0.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 129.9/129.9 kB 7.5 MB/s eta 0:00:00
Collecting backcall (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting decorator (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting jedi>=0.16 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for jedi>=0.16 from https://files.pythonhosted.org/packages/20/9f/bc63f0f0737ad7a60800bfd472a4836661adae21f9c2535f3957b1e54ceb/jedi-0.19.1-py2.py3-none-any.whl.metadata
  Downloading jedi-0.19.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting matplotlib-inline (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB)
Collecting pickleshare (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 from https://files.pythonhosted.org/packages/a9/b4/ba77c84edf499877317225d7b7bc047a81f7c2eed9628eeb6bab0ac2e6c9/prompt_toolkit-3.0.39-py3-none-any.whl.metadata
  Downloading prompt_toolkit-3.0.39-py3-none-any.whl.metadata (6.4 kB)
Collecting pygments>=2.4.0 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for pygments>=2.4.0 from https://files.pythonhosted.org/packages/43/88/29adf0b44ba6ac85045e63734ae0997d3c58d8b1a91c914d240828d0d73d/Pygments-2.16.1-py3-none-any.whl.metadata
  Downloading Pygments-2.16.1-py3-none-any.whl.metadata (2.5 kB)
Collecting stack-data (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for stack-data from https://files.pythonhosted.org/packages/f1/7b/ce1eafaf1a76852e2ec9b22edecf1daa58175c090266e9f6c64afcd81d91/stack_data-0.6.3-py3-none-any.whl.metadata
  Downloading stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)
Collecting traitlets>=5 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for traitlets>=5 from https://files.pythonhosted.org/packages/85/e9/d82415708306eb348fb16988c4697076119dfbfa266f17f74e514a23a723/traitlets-5.11.2-py3-none-any.whl.metadata
  Downloading traitlets-5.11.2-py3-none-any.whl.metadata (10 kB)
Collecting exceptiongroup (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for exceptiongroup from https://files.pythonhosted.org/packages/ad/83/b71e58666f156a39fb29417e4c8ca4bc7400c0dd4ed9e8842ab54dc8c344/exceptiongroup-1.1.3-py3-none-any.whl.metadata
  Downloading exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB)
Collecting pexpect>4.3 (from ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.0/59.0 kB 30.4 MB/s eta 0:00:00
Requirement already satisfied: typing-extensions>=4.2.0 in ./installer_files/env/lib/python3.10/site-packages (from pydantic<2.0,>=1.10->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (4.4.0)
Requirement already satisfied: charset-normalizer<3,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2022.12.7)
Collecting parso<0.9.0,>=0.8.3 (from jedi>=0.16->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading parso-0.8.3-py2.py3-none-any.whl (100 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100.8/100.8 kB 48.8 MB/s eta 0:00:00
Collecting ptyprocess>=0.5 (from pexpect>4.3->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting wcwidth (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for wcwidth from https://files.pythonhosted.org/packages/58/19/a9ce39f89cf58cf1e7ce01c8bb76ab7e2c7aadbc5a2136c3e192097344f5/wcwidth-0.2.8-py2.py3-none-any.whl.metadata
  Downloading wcwidth-0.2.8-py2.py3-none-any.whl.metadata (13 kB)
Collecting executing>=1.2.0 (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for executing>=1.2.0 from https://files.pythonhosted.org/packages/bb/3f/748594706233e45fd0e6fb57a2fbfe572485009c52b19919d161a0ae5d52/executing-2.0.0-py2.py3-none-any.whl.metadata
  Downloading executing-2.0.0-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting asttokens>=2.1.0 (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Obtaining dependency information for asttokens>=2.1.0 from https://files.pythonhosted.org/packages/4f/25/adda9979586d9606300415c89ad0e4c5b53d72b92d2747a3c634701a6a02/asttokens-2.4.0-py2.py3-none-any.whl.metadata
  Downloading asttokens-2.4.0-py2.py3-none-any.whl.metadata (4.9 kB)
Collecting pure-eval (from stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting six>=1.12.0 (from asttokens>=2.1.0->stack-data->ipython>=7.0->elevenlabs==0.2.24->-r extensions/elevenlabs_tts/requirements.txt (line 1))
  Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Downloading elevenlabs-0.2.24-py3-none-any.whl (16 kB)
Downloading ipython-8.16.1-py3-none-any.whl (806 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.0/807.0 kB 41.4 MB/s eta 0:00:00
Downloading pydantic-1.10.13-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 34.0 MB/s eta 0:00:00
Downloading jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 36.9 MB/s eta 0:00:00
Downloading prompt_toolkit-3.0.39-py3-none-any.whl (385 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 385.2/385.2 kB 40.2 MB/s eta 0:00:00
Downloading Pygments-2.16.1-py3-none-any.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 40.6 MB/s eta 0:00:00
Downloading traitlets-5.11.2-py3-none-any.whl (83 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.7/83.7 kB 5.1 MB/s eta 0:00:00
Downloading exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Downloading stack_data-0.6.3-py3-none-any.whl (24 kB)
Downloading asttokens-2.4.0-py2.py3-none-any.whl (27 kB)
Downloading executing-2.0.0-py2.py3-none-any.whl (24 kB)
Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
Installing collected packages: wcwidth, pure-eval, ptyprocess, pickleshare, executing, backcall, websockets, traitlets, six, pygments, pydantic, prompt-toolkit, pexpect, parso, exceptiongroup, decorator, matplotlib-inline, jedi, asttokens, stack-data, ipython, elevenlabs
Successfully installed asttokens-2.4.0 backcall-0.2.0 decorator-5.1.1 elevenlabs-0.2.24 exceptiongroup-1.1.3 executing-2.0.0 ipython-8.16.1 jedi-0.19.1 matplotlib-inline-0.1.6 parso-0.8.3 pexpect-4.8.0 pickleshare-0.7.5 prompt-toolkit-3.0.39 ptyprocess-0.7.0 pure-eval-0.2.2 pydantic-1.10.13 pygments-2.16.1 six-1.16.0 stack-data-0.6.3 traitlets-5.11.2 wcwidth-0.2.8 websockets-11.0.3
Collecting ngrok==0.* (from -r extensions/ngrok/requirements.txt (line 1))
  Obtaining dependency information for ngrok==0.* from https://files.pythonhosted.org/packages/b3/82/3aa2fcb2b5612636c70310f64906af04be6c60360a2c40340ee2d36bb32c/ngrok-0.11.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading ngrok-0.11.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (16 kB)
Downloading ngrok-0.11.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.7/2.7 MB 49.1 MB/s eta 0:00:00
Installing collected packages: ngrok
Successfully installed ngrok-0.11.0
Requirement already satisfied: ipython in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 1)) (8.16.1)
Collecting num2words (from -r extensions/silero_tts/requirements.txt (line 2))
  Downloading num2words-0.5.12-py3-none-any.whl (125 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 125.2/125.2 kB 11.9 MB/s eta 0:00:00
Collecting omegaconf (from -r extensions/silero_tts/requirements.txt (line 3))
  Downloading omegaconf-2.3.0-py3-none-any.whl (79 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.5/79.5 kB 37.7 MB/s eta 0:00:00
Collecting pydub (from -r extensions/silero_tts/requirements.txt (line 4))
  Downloading pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Requirement already satisfied: PyYAML in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 5)) (6.0.1)
Requirement already satisfied: backcall in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: jedi>=0.16 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.19.1)
Requirement already satisfied: matplotlib-inline in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: pickleshare in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (3.0.39)
Requirement already satisfied: pygments>=2.4.0 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.16.1)
Requirement already satisfied: stack-data in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.6.3)
Requirement already satisfied: traitlets>=5 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.11.2)
Requirement already satisfied: exceptiongroup in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.1.3)
Requirement already satisfied: pexpect>4.3 in ./installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (4.8.0)
Collecting docopt>=0.6.2 (from num2words->-r extensions/silero_tts/requirements.txt (line 2))
  Downloading docopt-0.6.2.tar.gz (25 kB)
  Preparing metadata (setup.py) ... done
Collecting antlr4-python3-runtime==4.9.* (from omegaconf->-r extensions/silero_tts/requirements.txt (line 3))
  Downloading antlr4-python3-runtime-4.9.3.tar.gz (117 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.0/117.0 kB 38.8 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Requirement already satisfied: parso<0.9.0,>=0.8.3 in ./installer_files/env/lib/python3.10/site-packages (from jedi>=0.16->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: ptyprocess>=0.5 in ./installer_files/env/lib/python3.10/site-packages (from pexpect>4.3->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.0)
Requirement already satisfied: wcwidth in ./installer_files/env/lib/python3.10/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.8)
Requirement already satisfied: executing>=1.2.0 in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: asttokens>=2.1.0 in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.4.0)
Requirement already satisfied: pure-eval in ./installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six>=1.12.0 in ./installer_files/env/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.16.0)
Building wheels for collected packages: antlr4-python3-runtime, docopt
  Building wheel for antlr4-python3-runtime (setup.py) ... done
  Created wheel for antlr4-python3-runtime: filename=antlr4_python3_runtime-4.9.3-py3-none-any.whl size=144554 sha256=34c819d99b9d3dec383d028a9d88a9c84966aab7f6429269b78ca350eaafdcee
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/12/93/dd/1f6a127edc45659556564c5730f6d4e300888f4bca2d4c5a88
  Building wheel for docopt (setup.py) ... done
  Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13705 sha256=1ac10e22a79e2c69d0870448aa3d06d6cc6a1128f40647074550d8f86c7a60eb
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/fc/ab/d4/5da2067ac95b36618c629a5f93f809425700506f72c9732fac
Successfully built antlr4-python3-runtime docopt
Installing collected packages: pydub, docopt, antlr4-python3-runtime, omegaconf, num2words
Successfully installed antlr4-python3-runtime-4.9.3 docopt-0.6.2 num2words-0.5.12 omegaconf-2.3.0 pydub-0.25.1
Collecting deep-translator==1.9.2 (from -r extensions/google_translate/requirements.txt (line 1))
  Downloading deep_translator-1.9.2-py3-none-any.whl (30 kB)
Collecting beautifulsoup4<5.0.0,>=4.9.1 (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1))
  Downloading beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.0/143.0 kB 29.4 MB/s eta 0:00:00
Requirement already satisfied: requests<3.0.0,>=2.23.0 in ./installer_files/env/lib/python3.10/site-packages (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.28.1)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1))
  Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
  Downloading soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Requirement already satisfied: charset-normalizer<3,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2022.12.7)
Downloading soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: soupsieve, beautifulsoup4, deep-translator
Successfully installed beautifulsoup4-4.12.2 deep-translator-1.9.2 soupsieve-2.5
Collecting flask_cloudflared==0.0.14 (from -r extensions/api/requirements.txt (line 1))
  Obtaining dependency information for flask_cloudflared==0.0.14 from https://files.pythonhosted.org/packages/f9/e0/d90aa747ae35adfcd6fa116936b1eb42a6e5d8c69419694862476cefd34b/flask_cloudflared-0.0.14-py3-none-any.whl.metadata
  Downloading flask_cloudflared-0.0.14-py3-none-any.whl.metadata (4.6 kB)
Collecting websockets==11.0.2 (from -r extensions/api/requirements.txt (line 2))
  Downloading websockets-11.0.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 129.9/129.9 kB 12.6 MB/s eta 0:00:00
Requirement already satisfied: Flask>=0.8 in ./installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.0.0)
Requirement already satisfied: requests in ./installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.28.1)
Requirement already satisfied: Werkzeug>=3.0.0 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.0.0)
Requirement already satisfied: Jinja2>=3.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (8.1.7)
Requirement already satisfied: blinker>=1.6.2 in ./installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (1.6.3)
Requirement already satisfied: charset-normalizer<3,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: MarkupSafe>=2.0 in ./installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.14->-r extensions/api/requirements.txt (line 1)) (2.1.2)
Downloading flask_cloudflared-0.0.14-py3-none-any.whl (6.4 kB)
Installing collected packages: websockets, flask_cloudflared
  Attempting uninstall: websockets
    Found existing installation: websockets 11.0.3
    Uninstalling websockets-11.0.3:
      Successfully uninstalled websockets-11.0.3
  Attempting uninstall: flask_cloudflared
    Found existing installation: flask-cloudflared 0.0.12
    Uninstalling flask-cloudflared-0.0.12:
      Successfully uninstalled flask-cloudflared-0.0.12
Successfully installed flask_cloudflared-0.0.14 websockets-11.0.2
Collecting git+https://github.com/oobabooga/whisper.git (from -r extensions/whisper_stt/requirements.txt (line 2))
  Cloning https://github.com/oobabooga/whisper.git to /tmp/pip-req-build-m4p0hfgx
  Running command git clone --filter=blob:none --quiet https://github.com/oobabooga/whisper.git /tmp/pip-req-build-m4p0hfgx
  Resolved https://github.com/oobabooga/whisper.git to commit 958ee4f6e1e65425ba02c440fc083089d58f5c71
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: SpeechRecognition==3.10.0 in ./installer_files/env/lib/python3.10/site-packages (from -r extensions/whisper_stt/requirements.txt (line 1)) (3.10.0)
Collecting soundfile (from -r extensions/whisper_stt/requirements.txt (line 3))
  Downloading soundfile-0.12.1-py2.py3-none-manylinux_2_31_x86_64.whl (1.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 20.7 MB/s eta 0:00:00
Collecting ffmpeg (from -r extensions/whisper_stt/requirements.txt (line 4))
  Downloading ffmpeg-1.4.tar.gz (5.1 kB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: requests>=2.26.0 in ./installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.28.1)
Collecting numba (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for numba from https://files.pythonhosted.org/packages/e7/69/d228b38ffb70858d74538bdfe5aa18c7640b7f07840239690985b3a94009/numba-0.58.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata
  Downloading numba-0.58.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.7 kB)
Requirement already satisfied: numpy in ./installer_files/env/lib/python3.10/site-packages (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2)) (1.24.1)
Requirement already satisfied: tqdm in ./installer_files/env/lib/python3.10/site-packages (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2)) (4.66.1)
Collecting more-itertools (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for more-itertools from https://files.pythonhosted.org/packages/5a/cb/6dce742ea14e47d6f565589e859ad225f2a5de576d7696e0623b784e226b/more_itertools-10.1.0-py3-none-any.whl.metadata
  Downloading more_itertools-10.1.0-py3-none-any.whl.metadata (33 kB)
Collecting tiktoken==0.3.3 (from openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Downloading tiktoken-0.3.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 31.1 MB/s eta 0:00:00
Requirement already satisfied: regex>=2022.1.18 in ./installer_files/env/lib/python3.10/site-packages (from tiktoken==0.3.3->openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2)) (2023.10.3)
Collecting cffi>=1.0 (from soundfile->-r extensions/whisper_stt/requirements.txt (line 3))
  Obtaining dependency information for cffi>=1.0 from https://files.pythonhosted.org/packages/c9/7c/43d81bdd5a915923c3bad5bb4bff401ea00ccc8e28433fb6083d2e3bf58e/cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting pycparser (from cffi>=1.0->soundfile->-r extensions/whisper_stt/requirements.txt (line 3))
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 29.4 MB/s eta 0:00:00
Requirement already satisfied: charset-normalizer<3,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2022.12.7)
Collecting llvmlite<0.42,>=0.41.0dev0 (from numba->openai-whisper==20230918->-r extensions/whisper_stt/requirements.txt (line 2))
  Obtaining dependency information for llvmlite<0.42,>=0.41.0dev0 from https://files.pythonhosted.org/packages/50/df/38c9fb5cc64f4fcc0577a14a0665c2a5de74f45a621ac7708320b1ac80c6/llvmlite-0.41.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading llvmlite-0.41.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.8 kB)
Downloading cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 443.9/443.9 kB 39.4 MB/s eta 0:00:00
Downloading more_itertools-10.1.0-py3-none-any.whl (55 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.8/55.8 kB 31.0 MB/s eta 0:00:00
Downloading numba-0.58.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 35.8 MB/s eta 0:00:00
Downloading llvmlite-0.41.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (43.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.6/43.6 MB 22.2 MB/s eta 0:00:00
Building wheels for collected packages: openai-whisper, ffmpeg
  Building wheel for openai-whisper (pyproject.toml) ... done
  Created wheel for openai-whisper: filename=openai_whisper-20230918-py3-none-any.whl size=798448 sha256=dfaf3b123f73039ebe54c1ec43dd094bf916abdfdc41756b1ae436b28c246b33
  Stored in directory: /tmp/pip-ephem-wheel-cache-toxsmkvt/wheels/09/f2/aa/bea939dd47f3b5d0d3f25f04665123b26a510e6f5faaae2b64
  Building wheel for ffmpeg (setup.py) ... done
  Created wheel for ffmpeg: filename=ffmpeg-1.4-py3-none-any.whl size=6082 sha256=23364e2d3eda63f382fbc72fdf35a3bff369a20d89ecf59bc49936d9dfa715b2
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/8e/7a/69/cd6aeb83b126a7f04cbe7c9d929028dc52a6e7d525ff56003a
Successfully built openai-whisper ffmpeg
Installing collected packages: ffmpeg, pycparser, more-itertools, llvmlite, tiktoken, numba, cffi, soundfile, openai-whisper
  Attempting uninstall: tiktoken
    Found existing installation: tiktoken 0.5.1
    Uninstalling tiktoken-0.5.1:
      Successfully uninstalled tiktoken-0.5.1
Successfully installed cffi-1.16.0 ffmpeg-1.4 llvmlite-0.41.0 more-itertools-10.1.0 numba-0.58.0 openai-whisper-20230918 pycparser-2.21 soundfile-0.12.1 tiktoken-0.3.3

*******************************************************************
* Installing webui requirements from file: requirements.txt
*******************************************************************

WARNING: Skipping torch-grammar as it is not installed.
Uninstalled torch-grammar
Ignoring exllamav2: markers 'platform_system != "Darwin" and platform_machine != "x86_64"' don't match your environment
Collecting git+https://github.com/oobabooga/torch-grammar.git (from -r temp_requirements.txt (line 23))
  Cloning https://github.com/oobabooga/torch-grammar.git to /tmp/pip-req-build-ytn7vcqv
  Running command git clone --filter=blob:none --quiet https://github.com/oobabooga/torch-grammar.git /tmp/pip-req-build-ytn7vcqv
  Resolved https://github.com/oobabooga/torch-grammar.git to commit 82850b5383a629f3b0fa1fba7d8f2aba3185ddb2
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system == "Windows"' don't match your environment
Collecting llama-cpp-python==0.2.11 (from -r temp_requirements.txt (line 30))
  Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.2.11/llama_cpp_python-0.2.11-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 21.1 MB/s eta 0:00:00
Ignoring llama-cpp-python: markers 'platform_system == "Windows"' don't match your environment
Ignoring auto-gptq: markers 'platform_system == "Windows"' don't match your environment
Collecting auto-gptq==0.4.2+cu118 (from -r temp_requirements.txt (line 35))
  Downloading https://github.com/jllllll/AutoGPTQ/releases/download/v0.4.2/auto_gptq-0.4.2+cu118-cp310-cp310-linux_x86_64.whl (1.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.9/1.9 MB 44.3 MB/s eta 0:00:00
Ignoring exllama: markers 'platform_system == "Windows"' don't match your environment
Collecting exllama==0.0.17+cu118 (from -r temp_requirements.txt (line 37))
  Downloading https://github.com/jllllll/exllama/releases/download/0.0.17/exllama-0.0.17+cu118-cp310-cp310-linux_x86_64.whl (437 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 437.1/437.1 kB 66.8 MB/s eta 0:00:00
Ignoring exllamav2: markers 'platform_system == "Windows"' don't match your environment
Collecting exllamav2==0.0.5+cu118 (from -r temp_requirements.txt (line 39))
  Downloading https://github.com/turboderp/exllamav2/releases/download/v0.0.5/exllamav2-0.0.5+cu118-cp310-cp310-linux_x86_64.whl (12.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.1/12.1 MB 34.4 MB/s eta 0:00:00
Collecting flash-attn==2.3.1.post1+cu118torch2.1cxx11abiFALSE (from -r temp_requirements.txt (line 40))
  Downloading https://github.com/Dao-AILab/flash-attention/releases/download/v2.3.1.post1/flash_attn-2.3.1.post1+cu118torch2.1cxx11abiFALSE-cp310-cp310-linux_x86_64.whl (57.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.1/57.1 MB 22.7 MB/s eta 0:00:00
Ignoring llama-cpp-python-cuda: markers 'platform_system == "Windows"' don't match your environment
Collecting llama-cpp-python-cuda==0.2.11+cu118 (from -r temp_requirements.txt (line 42))
  Downloading https://github.com/jllllll/llama-cpp-python-cuBLAS-wheels/releases/download/textgen-webui/llama_cpp_python_cuda-0.2.11+cu118-cp310-cp310-manylinux_2_31_x86_64.whl (15.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.5/15.5 MB 31.6 MB/s eta 0:00:00
Ignoring gptq-for-llama: markers 'platform_system == "Windows"' don't match your environment
Collecting gptq-for-llama==0.1.1+cu118 (from -r temp_requirements.txt (line 44))
  Downloading https://github.com/jllllll/GPTQ-for-LLaMa-CUDA/releases/download/0.1.1/gptq_for_llama-0.1.1+cu118-cp310-cp310-linux_x86_64.whl (853 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 853.0/853.0 kB 35.3 MB/s eta 0:00:00
Collecting ctransformers==0.2.27+cu118 (from -r temp_requirements.txt (line 45))
  Downloading https://github.com/jllllll/ctransformers-cuBLAS-wheels/releases/download/AVX2/ctransformers-0.2.27+cu118-py3-none-any.whl (15.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.7/15.7 MB 34.8 MB/s eta 0:00:00
Collecting accelerate==0.23.* (from -r temp_requirements.txt (line 1))
  Obtaining dependency information for accelerate==0.23.* from https://files.pythonhosted.org/packages/d9/92/2d3aecf9f4a192968035880be3e2fc8b48d541c7128f7c936f430d6f96da/accelerate-0.23.0-py3-none-any.whl.metadata
  Downloading accelerate-0.23.0-py3-none-any.whl.metadata (18 kB)
Collecting colorama (from -r temp_requirements.txt (line 2))
  Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting datasets (from -r temp_requirements.txt (line 3))
  Obtaining dependency information for datasets from https://files.pythonhosted.org/packages/09/7e/fd4d6441a541dba61d0acb3c1fd5df53214c2e9033854e837a99dd9e0793/datasets-2.14.5-py3-none-any.whl.metadata
  Downloading datasets-2.14.5-py3-none-any.whl.metadata (19 kB)
Collecting einops (from -r temp_requirements.txt (line 4))
  Obtaining dependency information for einops from https://files.pythonhosted.org/packages/29/0b/2d1c0ebfd092e25935b86509a9a817159212d82aa43d7fb07eca4eeff2c2/einops-0.7.0-py3-none-any.whl.metadata
  Downloading einops-0.7.0-py3-none-any.whl.metadata (13 kB)
Collecting gradio==3.47.* (from -r temp_requirements.txt (line 6))
  Obtaining dependency information for gradio==3.47.* from https://files.pythonhosted.org/packages/05/f2/360ca9546cffa45fee1df56864fdc2b6955de622e98435539490cd882a96/gradio-3.47.1-py3-none-any.whl.metadata
  Downloading gradio-3.47.1-py3-none-any.whl.metadata (17 kB)
Collecting markdown (from -r temp_requirements.txt (line 7))
  Obtaining dependency information for markdown from https://files.pythonhosted.org/packages/bb/c1/50caaec6cadc1c6adc8fe351e03bd646d6e4dd17f55fca0f4c8d7ea8d3e9/Markdown-3.5-py3-none-any.whl.metadata
  Downloading Markdown-3.5-py3-none-any.whl.metadata (7.1 kB)
Collecting numpy==1.24 (from -r temp_requirements.txt (line 8))
  Downloading numpy-1.24.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 34.6 MB/s eta 0:00:00
Collecting optimum==1.13.1 (from -r temp_requirements.txt (line 9))
  Obtaining dependency information for optimum==1.13.1 from https://files.pythonhosted.org/packages/39/25/329bace199ca13a65fc82149b3e528053f357577d46d4b937d6548e8b07d/optimum-1.13.1-py3-none-any.whl.metadata
  Downloading optimum-1.13.1-py3-none-any.whl.metadata (17 kB)
Collecting pandas (from -r temp_requirements.txt (line 10))
  Obtaining dependency information for pandas from https://files.pythonhosted.org/packages/2f/0e/3b74e8f7c908082793adafb02753477f653ccd7e189f3ba070757d2d0e65/pandas-2.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading pandas-2.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (18 kB)
Collecting peft==0.5.* (from -r temp_requirements.txt (line 11))
  Obtaining dependency information for peft==0.5.* from https://files.pythonhosted.org/packages/37/1a/8d20e8704da9fa070eb909265584b960da57be1d833d550c59f50906dc5c/peft-0.5.0-py3-none-any.whl.metadata
  Downloading peft-0.5.0-py3-none-any.whl.metadata (22 kB)
Collecting Pillow>=9.5.0 (from -r temp_requirements.txt (line 12))
  Obtaining dependency information for Pillow>=9.5.0 from https://files.pythonhosted.org/packages/7a/07/e896b096a77375e78e02ce222ae4fd6014928cd76c691d312060a1645dfa/Pillow-10.0.1-cp310-cp310-manylinux_2_28_x86_64.whl.metadata
  Downloading Pillow-10.0.1-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (9.5 kB)
Requirement already satisfied: pyyaml in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 13)) (6.0.1)
Requirement already satisfied: requests in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 14)) (2.28.1)
Collecting requests (from -r temp_requirements.txt (line 14))
  Obtaining dependency information for requests from https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl.metadata
  Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Requirement already satisfied: safetensors==0.4.0 in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 15)) (0.4.0)
Requirement already satisfied: scipy in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 16)) (1.11.3)
Requirement already satisfied: sentencepiece in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 17)) (0.1.99)
Collecting tensorboard (from -r temp_requirements.txt (line 18))
  Obtaining dependency information for tensorboard from https://files.pythonhosted.org/packages/73/a2/66ed644f6ed1562e0285fcd959af17670ea313c8f331c46f79ee77187eb9/tensorboard-2.14.1-py3-none-any.whl.metadata
  Downloading tensorboard-2.14.1-py3-none-any.whl.metadata (1.7 kB)
Requirement already satisfied: transformers==4.34.* in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 19)) (4.34.0)
Requirement already satisfied: tqdm in ./installer_files/env/lib/python3.10/site-packages (from -r temp_requirements.txt (line 20)) (4.66.1)
Collecting wandb (from -r temp_requirements.txt (line 21))
  Obtaining dependency information for wandb from https://files.pythonhosted.org/packages/1c/5e/0362fa88679852c7fd3ac85ee5bd949426c4a51a61379010d4089be6d7ac/wandb-0.15.12-py3-none-any.whl.metadata
  Downloading wandb-0.15.12-py3-none-any.whl.metadata (9.8 kB)
Collecting bitsandbytes==0.41.1 (from -r temp_requirements.txt (line 26))
  Obtaining dependency information for bitsandbytes==0.41.1 from https://files.pythonhosted.org/packages/1e/2c/af22cd797fc368a9f098ed03015730e6568b884fe67f9940793d944a4b7b/bitsandbytes-0.41.1-py3-none-any.whl.metadata
  Downloading bitsandbytes-0.41.1-py3-none-any.whl.metadata (9.8 kB)
Collecting autoawq==0.1.4 (from -r temp_requirements.txt (line 46))
  Obtaining dependency information for autoawq==0.1.4 from https://files.pythonhosted.org/packages/07/dc/3e44612beb2747b524873959aded2d648d6d6bda9fb15ce25a6ee99edcdf/autoawq-0.1.4-cp310-cp310-manylinux2014_x86_64.whl.metadata
  Downloading autoawq-0.1.4-cp310-cp310-manylinux2014_x86_64.whl.metadata (13 kB)
Requirement already satisfied: packaging>=20.0 in ./installer_files/env/lib/python3.10/site-packages (from accelerate==0.23.*->-r temp_requirements.txt (line 1)) (23.2)
Collecting psutil (from accelerate==0.23.*->-r temp_requirements.txt (line 1))
  Downloading psutil-5.9.5-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 282.1/282.1 kB 22.2 MB/s eta 0:00:00
Requirement already satisfied: torch>=1.10.0 in ./installer_files/env/lib/python3.10/site-packages (from accelerate==0.23.*->-r temp_requirements.txt (line 1)) (2.1.0+cu118)
Requirement already satisfied: huggingface-hub in ./installer_files/env/lib/python3.10/site-packages (from accelerate==0.23.*->-r temp_requirements.txt (line 1)) (0.17.3)
Collecting aiofiles<24.0,>=22.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for aiofiles<24.0,>=22.0 from https://files.pythonhosted.org/packages/c5/19/5af6804c4cc0fed83f47bff6e413a98a36618e7d40185cd36e69737f3b0e/aiofiles-23.2.1-py3-none-any.whl.metadata
  Downloading aiofiles-23.2.1-py3-none-any.whl.metadata (9.7 kB)
Collecting altair<6.0,>=4.2.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for altair<6.0,>=4.2.0 from https://files.pythonhosted.org/packages/17/16/b12fca347ff9d062e3c44ad9641d2ec50364570a059f3078ada3a5119d7a/altair-5.1.2-py3-none-any.whl.metadata
  Downloading altair-5.1.2-py3-none-any.whl.metadata (8.6 kB)
Collecting fastapi (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for fastapi from https://files.pythonhosted.org/packages/4d/d2/3ad038a2365fefbac19d9a046cab7ce45f4c7bfa81d877cbece9707de9ce/fastapi-0.103.2-py3-none-any.whl.metadata
  Downloading fastapi-0.103.2-py3-none-any.whl.metadata (24 kB)
Collecting ffmpy (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Downloading ffmpy-0.3.1.tar.gz (5.5 kB)
  Preparing metadata (setup.py) ... done
Collecting gradio-client==0.6.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for gradio-client==0.6.0 from https://files.pythonhosted.org/packages/9f/dd/db8dcc8521aa475a18a562929de0806819f8fa73ee8654d2cc22c836c3bd/gradio_client-0.6.0-py3-none-any.whl.metadata
  Downloading gradio_client-0.6.0-py3-none-any.whl.metadata (7.1 kB)
Collecting httpx (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for httpx from https://files.pythonhosted.org/packages/33/0d/d9ce469af019741c8999711d36b270ff992ceb1a0293f73f9f34fdf131e9/httpx-0.25.0-py3-none-any.whl.metadata
  Downloading httpx-0.25.0-py3-none-any.whl.metadata (7.6 kB)
Collecting importlib-resources<7.0,>=1.3 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for importlib-resources<7.0,>=1.3 from https://files.pythonhosted.org/packages/65/6e/09d8816b5cb7a4006ef8ad1717a2703ad9f331dae9717d9f22488a2d6469/importlib_resources-6.1.0-py3-none-any.whl.metadata
  Downloading importlib_resources-6.1.0-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: jinja2<4.0 in ./installer_files/env/lib/python3.10/site-packages (from gradio==3.47.*->-r temp_requirements.txt (line 6)) (3.1.2)
Requirement already satisfied: markupsafe~=2.0 in ./installer_files/env/lib/python3.10/site-packages (from gradio==3.47.*->-r temp_requirements.txt (line 6)) (2.1.2)
Collecting matplotlib~=3.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for matplotlib~=3.0 from https://files.pythonhosted.org/packages/b5/24/aaccf324ce862bb82277e8814d2aebbb2a2c160d04e95aa2b8c9dc3137a9/matplotlib-3.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading matplotlib-3.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB)
Collecting orjson~=3.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for orjson~=3.0 from https://files.pythonhosted.org/packages/3b/d1/2dfc16b183a816decafa09e06375eb99d9c9ee7ef51293ea8a3cf3cd6907/orjson-3.9.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading orjson-3.9.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.2/49.2 kB 6.8 MB/s eta 0:00:00
Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4 in ./installer_files/env/lib/python3.10/site-packages (from gradio==3.47.*->-r temp_requirements.txt (line 6)) (1.10.13)
Requirement already satisfied: pydub in ./installer_files/env/lib/python3.10/site-packages (from gradio==3.47.*->-r temp_requirements.txt (line 6)) (0.25.1)
Collecting python-multipart (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Downloading python_multipart-0.0.6-py3-none-any.whl (45 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.7/45.7 kB 22.8 MB/s eta 0:00:00
Collecting semantic-version~=2.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Downloading semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: typing-extensions~=4.0 in ./installer_files/env/lib/python3.10/site-packages (from gradio==3.47.*->-r temp_requirements.txt (line 6)) (4.4.0)
Collecting uvicorn>=0.14.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for uvicorn>=0.14.0 from https://files.pythonhosted.org/packages/79/96/b0882a1c3f7ef3dd86879e041212ae5b62b4bd352320889231cc735a8e8f/uvicorn-0.23.2-py3-none-any.whl.metadata
  Downloading uvicorn-0.23.2-py3-none-any.whl.metadata (6.2 kB)
Requirement already satisfied: websockets<12.0,>=10.0 in ./installer_files/env/lib/python3.10/site-packages (from gradio==3.47.*->-r temp_requirements.txt (line 6)) (11.0.2)
Collecting coloredlogs (from optimum==1.13.1->-r temp_requirements.txt (line 9))
  Downloading coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 22.1 MB/s eta 0:00:00
Requirement already satisfied: sympy in ./installer_files/env/lib/python3.10/site-packages (from optimum==1.13.1->-r temp_requirements.txt (line 9)) (1.12)
Requirement already satisfied: filelock in ./installer_files/env/lib/python3.10/site-packages (from transformers==4.34.*->-r temp_requirements.txt (line 19)) (3.9.0)
Requirement already satisfied: regex!=2019.12.17 in ./installer_files/env/lib/python3.10/site-packages (from transformers==4.34.*->-r temp_requirements.txt (line 19)) (2023.10.3)
Requirement already satisfied: tokenizers<0.15,>=0.14 in ./installer_files/env/lib/python3.10/site-packages (from transformers==4.34.*->-r temp_requirements.txt (line 19)) (0.14.1)
Collecting lm-eval (from autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading lm_eval-0.3.0-py3-none-any.whl (178 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 178.7/178.7 kB 32.5 MB/s eta 0:00:00
Collecting texttable (from autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for texttable from https://files.pythonhosted.org/packages/24/99/4772b8e00a136f3e01236de33b0efda31ee7077203ba5967fcc76da94d65/texttable-1.7.0-py2.py3-none-any.whl.metadata
  Downloading texttable-1.7.0-py2.py3-none-any.whl.metadata (9.8 kB)
Collecting toml (from autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting attributedict (from autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading attributedict-0.3.0-py3-none-any.whl (14 kB)
Collecting protobuf (from autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for protobuf from https://files.pythonhosted.org/packages/c8/2c/03046cac73f46bfe98fc846ef629cf4f84c2f59258216aa2cc0d22bfca8f/protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl.metadata
  Downloading protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl.metadata (540 bytes)
Requirement already satisfied: torchvision in ./installer_files/env/lib/python3.10/site-packages (from autoawq==0.1.4->-r temp_requirements.txt (line 46)) (0.16.0+cu118)
Collecting tabulate (from autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading tabulate-0.9.0-py3-none-any.whl (35 kB)
Requirement already satisfied: fsspec in ./installer_files/env/lib/python3.10/site-packages (from gradio-client==0.6.0->gradio==3.47.*->-r temp_requirements.txt (line 6)) (2023.9.2)
Collecting pyarrow>=8.0.0 (from datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for pyarrow>=8.0.0 from https://files.pythonhosted.org/packages/a1/14/4ffed5e85b96f0c0ae9e026f940bf71ac7dfbfbffff9f3fe339e32bfce2c/pyarrow-13.0.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata
  Downloading pyarrow-13.0.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (3.0 kB)
Collecting dill<0.3.8,>=0.3.0 (from datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for dill<0.3.8,>=0.3.0 from https://files.pythonhosted.org/packages/f5/3a/74a29b11cf2cdfcd6ba89c0cecd70b37cd1ba7b77978ce611eb7a146a832/dill-0.3.7-py3-none-any.whl.metadata
  Downloading dill-0.3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting xxhash (from datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for xxhash from https://files.pythonhosted.org/packages/80/8a/1dd41557883b6196f8f092011a5c1f72d4d44cf36d7b67d4a5efe3127949/xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB)
Collecting multiprocess (from datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for multiprocess from https://files.pythonhosted.org/packages/35/a8/36d8d7b3e46b377800d8dec47891cdf05842d1a2366909ae4a0c89fbc5e6/multiprocess-0.70.15-py310-none-any.whl.metadata
  Downloading multiprocess-0.70.15-py310-none-any.whl.metadata (7.2 kB)
Collecting fsspec[http]<2023.9.0,>=2023.1.0 (from datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for fsspec[http]<2023.9.0,>=2023.1.0 from https://files.pythonhosted.org/packages/e3/bd/4c0a4619494188a9db5d77e2100ab7d544a42e76b2447869d8e124e981d8/fsspec-2023.6.0-py3-none-any.whl.metadata
  Downloading fsspec-2023.6.0-py3-none-any.whl.metadata (6.7 kB)
Collecting aiohttp (from datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for aiohttp from https://files.pythonhosted.org/packages/41/8e/4c48881316bbced3d13089c4d0df4be321ce79a0c695d82dee9996aaf56b/aiohttp-3.8.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading aiohttp-3.8.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB)
Collecting python-dateutil>=2.8.2 (from pandas->-r temp_requirements.txt (line 10))
  Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 36.0 MB/s eta 0:00:00
Collecting pytz>=2020.1 (from pandas->-r temp_requirements.txt (line 10))
  Obtaining dependency information for pytz>=2020.1 from https://files.pythonhosted.org/packages/32/4d/aaf7eff5deb402fd9a24a1449a8119f00d74ae9c2efa79f8ef9994261fc2/pytz-2023.3.post1-py2.py3-none-any.whl.metadata
  Downloading pytz-2023.3.post1-py2.py3-none-any.whl.metadata (22 kB)
Collecting tzdata>=2022.1 (from pandas->-r temp_requirements.txt (line 10))
  Downloading tzdata-2023.3-py2.py3-none-any.whl (341 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 341.8/341.8 kB 37.3 MB/s eta 0:00:00
Requirement already satisfied: charset-normalizer<4,>=2 in ./installer_files/env/lib/python3.10/site-packages (from requests->-r temp_requirements.txt (line 14)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in ./installer_files/env/lib/python3.10/site-packages (from requests->-r temp_requirements.txt (line 14)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./installer_files/env/lib/python3.10/site-packages (from requests->-r temp_requirements.txt (line 14)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in ./installer_files/env/lib/python3.10/site-packages (from requests->-r temp_requirements.txt (line 14)) (2022.12.7)
Collecting absl-py>=0.4 (from tensorboard->-r temp_requirements.txt (line 18))
  Obtaining dependency information for absl-py>=0.4 from https://files.pythonhosted.org/packages/01/e4/dc0a1dcc4e74e08d7abedab278c795eef54a224363bb18f5692f416d834f/absl_py-2.0.0-py3-none-any.whl.metadata
  Downloading absl_py-2.0.0-py3-none-any.whl.metadata (2.3 kB)
Collecting grpcio>=1.48.2 (from tensorboard->-r temp_requirements.txt (line 18))
  Obtaining dependency information for grpcio>=1.48.2 from https://files.pythonhosted.org/packages/20/7f/e76618521aa9d33c6c1c9c3473f866da521678aa6ea2f4df3a896757748c/grpcio-1.59.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading grpcio-1.59.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB)
Collecting google-auth<3,>=1.6.3 (from tensorboard->-r temp_requirements.txt (line 18))
  Obtaining dependency information for google-auth<3,>=1.6.3 from https://files.pythonhosted.org/packages/39/7c/2e4fa55a99f83ef9ef229ac5d59c44ceb90e2d0145711590c0fa39669f32/google_auth-2.23.3-py2.py3-none-any.whl.metadata
  Downloading google_auth-2.23.3-py2.py3-none-any.whl.metadata (4.2 kB)
Collecting google-auth-oauthlib<1.1,>=0.5 (from tensorboard->-r temp_requirements.txt (line 18))
  Downloading google_auth_oauthlib-1.0.0-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: setuptools>=41.0.0 in ./installer_files/env/lib/python3.10/site-packages (from tensorboard->-r temp_requirements.txt (line 18)) (68.0.0)
Requirement already satisfied: six>1.9 in ./installer_files/env/lib/python3.10/site-packages (from tensorboard->-r temp_requirements.txt (line 18)) (1.16.0)
Collecting tensorboard-data-server<0.8.0,>=0.7.0 (from tensorboard->-r temp_requirements.txt (line 18))
  Obtaining dependency information for tensorboard-data-server<0.8.0,>=0.7.0 from https://files.pythonhosted.org/packages/02/52/fb9e51fba47951aabd7a6b25e41d73eae94208ccf62d886168096941a781/tensorboard_data_server-0.7.1-py3-none-manylinux2014_x86_64.whl.metadata
  Downloading tensorboard_data_server-0.7.1-py3-none-manylinux2014_x86_64.whl.metadata (1.1 kB)
Requirement already satisfied: werkzeug>=1.0.1 in ./installer_files/env/lib/python3.10/site-packages (from tensorboard->-r temp_requirements.txt (line 18)) (3.0.0)
Requirement already satisfied: Click!=8.0.0,>=7.1 in ./installer_files/env/lib/python3.10/site-packages (from wandb->-r temp_requirements.txt (line 21)) (8.1.7)
Collecting GitPython!=3.1.29,>=1.0.0 (from wandb->-r temp_requirements.txt (line 21))
  Obtaining dependency information for GitPython!=3.1.29,>=1.0.0 from https://files.pythonhosted.org/packages/8a/7e/20f7e45878b5aed34320fbeeae8f78acc806e7bd708d00b1c6e64b016f5b/GitPython-3.1.37-py3-none-any.whl.metadata
  Downloading GitPython-3.1.37-py3-none-any.whl.metadata (12 kB)
Collecting sentry-sdk>=1.0.0 (from wandb->-r temp_requirements.txt (line 21))
  Obtaining dependency information for sentry-sdk>=1.0.0 from https://files.pythonhosted.org/packages/62/3a/765a7699a26884dcbf8b071dbe2a2486cc1cafcfb5f5d2e64ffe745dd0c6/sentry_sdk-1.31.0-py2.py3-none-any.whl.metadata
  Downloading sentry_sdk-1.31.0-py2.py3-none-any.whl.metadata (9.8 kB)
Collecting docker-pycreds>=0.4.0 (from wandb->-r temp_requirements.txt (line 21))
  Downloading docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting pathtools (from wandb->-r temp_requirements.txt (line 21))
  Downloading pathtools-0.1.2.tar.gz (11 kB)
  Preparing metadata (setup.py) ... done
Collecting setproctitle (from wandb->-r temp_requirements.txt (line 21))
  Obtaining dependency information for setproctitle from https://files.pythonhosted.org/packages/79/e7/54b36be02aee8ad573be68f6f46fd62838735c2f007b22df50eb5e13a20d/setproctitle-1.3.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading setproctitle-1.3.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.9 kB)
Collecting appdirs>=1.4.3 (from wandb->-r temp_requirements.txt (line 21))
  Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Collecting typing-extensions~=4.0 (from gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for typing-extensions~=4.0 from https://files.pythonhosted.org/packages/24/21/7d397a4b7934ff4028987914ac1044d3b7d52712f30e2ac7a2ae5bc86dd0/typing_extensions-4.8.0-py3-none-any.whl.metadata
  Downloading typing_extensions-4.8.0-py3-none-any.whl.metadata (3.0 kB)
Collecting diskcache>=5.6.1 (from llama-cpp-python==0.2.11->-r temp_requirements.txt (line 30))
  Obtaining dependency information for diskcache>=5.6.1 from https://files.pythonhosted.org/packages/3f/27/4570e78fc0bf5ea0ca45eb1de3818a23787af9b390c0b0a0033a1b8236f9/diskcache-5.6.3-py3-none-any.whl.metadata
  Downloading diskcache-5.6.3-py3-none-any.whl.metadata (20 kB)
Collecting rouge (from auto-gptq==0.4.2+cu118->-r temp_requirements.txt (line 35))
  Downloading rouge-1.0.1-py3-none-any.whl (13 kB)
Collecting ninja (from exllamav2==0.0.5+cu118->-r temp_requirements.txt (line 39))
  Obtaining dependency information for ninja from https://files.pythonhosted.org/packages/6d/92/8d7aebd4430ab5ff65df2bfee6d5745f95c004284db2d8ca76dcbfd9de47/ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl.metadata
  Downloading ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl.metadata (5.3 kB)
Collecting fastparquet (from exllamav2==0.0.5+cu118->-r temp_requirements.txt (line 39))
  Obtaining dependency information for fastparquet from https://files.pythonhosted.org/packages/f4/70/1756e78d37740ebb68c5705edf1339c2f674d2c9a36916f2caa107c07a8c/fastparquet-2023.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading fastparquet-2023.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Requirement already satisfied: pygments in ./installer_files/env/lib/python3.10/site-packages (from exllamav2==0.0.5+cu118->-r temp_requirements.txt (line 39)) (2.16.1)
Requirement already satisfied: py-cpuinfo<10.0.0,>=9.0.0 in ./installer_files/env/lib/python3.10/site-packages (from ctransformers==0.2.27+cu118->-r temp_requirements.txt (line 45)) (9.0.0)
Collecting jsonschema>=3.0 (from altair<6.0,>=4.2.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for jsonschema>=3.0 from https://files.pythonhosted.org/packages/0f/bf/a84bc75f069f4f156e1c0d9892fb7325945106c6ecaad9f29d24360872af/jsonschema-4.19.1-py3-none-any.whl.metadata
  Downloading jsonschema-4.19.1-py3-none-any.whl.metadata (7.9 kB)
Collecting toolz (from altair<6.0,>=4.2.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Downloading toolz-0.12.0-py3-none-any.whl (55 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.8/55.8 kB 28.3 MB/s eta 0:00:00
Collecting attrs>=17.3.0 (from aiohttp->datasets->-r temp_requirements.txt (line 3))
  Downloading attrs-23.1.0-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 kB 32.2 MB/s eta 0:00:00
Collecting multidict<7.0,>=4.5 (from aiohttp->datasets->-r temp_requirements.txt (line 3))
  Downloading multidict-6.0.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (114 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 114.5/114.5 kB 13.4 MB/s eta 0:00:00
Collecting async-timeout<5.0,>=4.0.0a3 (from aiohttp->datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for async-timeout<5.0,>=4.0.0a3 from https://files.pythonhosted.org/packages/a7/fa/e01228c2938de91d47b307831c62ab9e4001e747789d0b05baf779a6488c/async_timeout-4.0.3-py3-none-any.whl.metadata
  Downloading async_timeout-4.0.3-py3-none-any.whl.metadata (4.2 kB)
Collecting yarl<2.0,>=1.0 (from aiohttp->datasets->-r temp_requirements.txt (line 3))
  Downloading yarl-1.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (268 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 268.8/268.8 kB 25.6 MB/s eta 0:00:00
Collecting frozenlist>=1.1.1 (from aiohttp->datasets->-r temp_requirements.txt (line 3))
  Obtaining dependency information for frozenlist>=1.1.1 from https://files.pythonhosted.org/packages/1e/28/74b8b6451c89c070d34e753d8b65a1e4ce508a6808b18529f36e8c0e2184/frozenlist-1.4.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading frozenlist-1.4.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.2 kB)
Collecting aiosignal>=1.1.2 (from aiohttp->datasets->-r temp_requirements.txt (line 3))
  Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting gitdb<5,>=4.0.1 (from GitPython!=3.1.29,>=1.0.0->wandb->-r temp_requirements.txt (line 21))
  Downloading gitdb-4.0.10-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.7/62.7 kB 32.2 MB/s eta 0:00:00
Collecting cachetools<6.0,>=2.0.0 (from google-auth<3,>=1.6.3->tensorboard->-r temp_requirements.txt (line 18))
  Obtaining dependency information for cachetools<6.0,>=2.0.0 from https://files.pythonhosted.org/packages/a9/c9/c8a7710f2cedcb1db9224fdd4d8307c9e48cbddc46c18b515fefc0f1abbe/cachetools-5.3.1-py3-none-any.whl.metadata
  Downloading cachetools-5.3.1-py3-none-any.whl.metadata (5.2 kB)
Collecting pyasn1-modules>=0.2.1 (from google-auth<3,>=1.6.3->tensorboard->-r temp_requirements.txt (line 18))
  Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 7.0 MB/s eta 0:00:00
Collecting rsa<5,>=3.1.4 (from google-auth<3,>=1.6.3->tensorboard->-r temp_requirements.txt (line 18))
  Downloading rsa-4.9-py3-none-any.whl (34 kB)
Collecting requests-oauthlib>=0.7.0 (from google-auth-oauthlib<1.1,>=0.5->tensorboard->-r temp_requirements.txt (line 18))
  Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting contourpy>=1.0.1 (from matplotlib~=3.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for contourpy>=1.0.1 from https://files.pythonhosted.org/packages/f1/6b/e4b0f8708f22dd7c321f87eadbb98708975e115ac6582eb46d1f32197ce6/contourpy-1.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading contourpy-1.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.9 kB)
Collecting cycler>=0.10 (from matplotlib~=3.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for cycler>=0.10 from https://files.pythonhosted.org/packages/e7/05/c19819d5e3d95294a6f5947fb9b9629efb316b96de511b418c53d245aae6/cycler-0.12.1-py3-none-any.whl.metadata
  Downloading cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB)
Collecting fonttools>=4.22.0 (from matplotlib~=3.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for fonttools>=4.22.0 from https://files.pythonhosted.org/packages/ac/ed/9a33eca5e2cc35dc1fea0a968509c653db9a99a5979656ae57c6c019d66b/fonttools-4.43.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading fonttools-4.43.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (152 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 152.4/152.4 kB 25.3 MB/s eta 0:00:00
Collecting kiwisolver>=1.0.1 (from matplotlib~=3.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for kiwisolver>=1.0.1 from https://files.pythonhosted.org/packages/6f/40/4ab1fdb57fced80ce5903f04ae1aed7c1d5939dda4fd0c0aa526c12fe28a/kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata
  Downloading kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (6.4 kB)
Collecting pyparsing>=2.3.1 (from matplotlib~=3.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for pyparsing>=2.3.1 from https://files.pythonhosted.org/packages/39/92/8486ede85fcc088f1b3dba4ce92dd29d126fd96b0008ea213167940a2475/pyparsing-3.1.1-py3-none-any.whl.metadata
  Downloading pyparsing-3.1.1-py3-none-any.whl.metadata (5.1 kB)
Requirement already satisfied: networkx in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.23.*->-r temp_requirements.txt (line 1)) (3.0)
Requirement already satisfied: triton==2.1.0 in ./installer_files/env/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.23.*->-r temp_requirements.txt (line 1)) (2.1.0)
Collecting h11>=0.8 (from uvicorn>=0.14.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Downloading h11-0.14.0-py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 28.2 MB/s eta 0:00:00
Collecting rootpath>=0.1.0 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading rootpath-0.1.1-py3-none-any.whl (15 kB)
Collecting inspecta>=0.1.0 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading inspecta-0.1.3-py3-none-any.whl (9.2 kB)
Collecting colour-runner>=0.0.5 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading colour_runner-0.1.1-py2.py3-none-any.whl (3.7 kB)
Collecting deepdiff>=3.3.0 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for deepdiff>=3.3.0 from https://files.pythonhosted.org/packages/cd/ac/bc7c9b491b9f8ab95b4a0db362af5f149fa7cf575d422dbc62e0fb076d95/deepdiff-6.6.0-py3-none-any.whl.metadata
  Downloading deepdiff-6.6.0-py3-none-any.whl.metadata (6.0 kB)
Collecting tox>=3.0.0 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for tox>=3.0.0 from https://files.pythonhosted.org/packages/f5/f9/963052e8b825645c54262dce7b7c88691505e3b9ee10a3e3667711eaaf21/tox-4.11.3-py3-none-any.whl.metadata
  Downloading tox-4.11.3-py3-none-any.whl.metadata (5.0 kB)
Collecting coverage>=4.5.2 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for coverage>=4.5.2 from https://files.pythonhosted.org/packages/7d/c1/46a0a53b0dfa4c389c81290e3be9e5205d45003863565aa83d264cae4463/coverage-7.3.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading coverage-7.3.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.1 kB)
Collecting codecov>=2.0.15 (from attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading codecov-2.1.13-py2.py3-none-any.whl (16 kB)
Collecting humanfriendly>=9.1 (from coloredlogs->optimum==1.13.1->-r temp_requirements.txt (line 9))
  Downloading humanfriendly-10.0-py2.py3-none-any.whl (86 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 22.7 MB/s eta 0:00:00
Collecting anyio<4.0.0,>=3.7.1 (from fastapi->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for anyio<4.0.0,>=3.7.1 from https://files.pythonhosted.org/packages/19/24/44299477fe7dcc9cb58d0a57d5a7588d6af2ff403fdd2d47a246c91a3246/anyio-3.7.1-py3-none-any.whl.metadata
  Downloading anyio-3.7.1-py3-none-any.whl.metadata (4.7 kB)
Collecting starlette<0.28.0,>=0.27.0 (from fastapi->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for starlette<0.28.0,>=0.27.0 from https://files.pythonhosted.org/packages/58/f8/e2cca22387965584a409795913b774235752be4176d276714e15e1a58884/starlette-0.27.0-py3-none-any.whl.metadata
  Downloading starlette-0.27.0-py3-none-any.whl.metadata (5.8 kB)
Collecting cramjam>=2.3 (from fastparquet->exllamav2==0.0.5+cu118->-r temp_requirements.txt (line 39))
  Obtaining dependency information for cramjam>=2.3 from https://files.pythonhosted.org/packages/30/79/abc388ed246721b7d56ef4410f07c8f81b1df5660f23f9b743cc6958ecdc/cramjam-2.7.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading cramjam-2.7.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB)
Collecting httpcore<0.19.0,>=0.18.0 (from httpx->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for httpcore<0.19.0,>=0.18.0 from https://files.pythonhosted.org/packages/ac/97/724afbb7925339f6214bf1fdb5714d1a462690466832bf8fb3fd497649f1/httpcore-0.18.0-py3-none-any.whl.metadata
  Downloading httpcore-0.18.0-py3-none-any.whl.metadata (18 kB)
Collecting sniffio (from httpx->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Downloading sniffio-1.3.0-py3-none-any.whl (10 kB)
Collecting jsonlines (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for jsonlines from https://files.pythonhosted.org/packages/f8/62/d9ba6323b9202dd2fe166beab8a86d29465c41a0288cbe229fac60c1ab8d/jsonlines-4.0.0-py3-none-any.whl.metadata
  Downloading jsonlines-4.0.0-py3-none-any.whl.metadata (1.6 kB)
Collecting numexpr (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for numexpr from https://files.pythonhosted.org/packages/2d/03/de1341ec86bbdf1e4a7ad34d95af4762be8a3efab01d5f96922f1228da3e/numexpr-2.8.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading numexpr-2.8.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.7 kB)
Collecting openai>=0.6.4 (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for openai>=0.6.4 from https://files.pythonhosted.org/packages/1e/9f/385c25502f437686e4aa715969e5eaf5c2cb5e5ffa7c5cdd52f3c6ae967a/openai-0.28.1-py3-none-any.whl.metadata
  Downloading openai-0.28.1-py3-none-any.whl.metadata (11 kB)
Collecting pybind11>=2.6.2 (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for pybind11>=2.6.2 from https://files.pythonhosted.org/packages/06/55/9f73c32dda93fa4f539fafa268f9504e83c489f460c380371d94296126cd/pybind11-2.11.1-py3-none-any.whl.metadata
  Downloading pybind11-2.11.1-py3-none-any.whl.metadata (9.5 kB)
Collecting pycountry (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading pycountry-22.3.5.tar.gz (10.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.1/10.1 MB 34.7 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pytablewriter (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for pytablewriter from https://files.pythonhosted.org/packages/06/74/b39b823ee7dba155b117634e62733a0dfdfe5aa100a553b435062cee2062/pytablewriter-1.2.0-py3-none-any.whl.metadata
  Downloading pytablewriter-1.2.0-py3-none-any.whl.metadata (37 kB)
Collecting rouge-score>=0.0.4 (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading rouge_score-0.1.2.tar.gz (17 kB)
  Preparing metadata (setup.py) ... done
Collecting sacrebleu==1.5.0 (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading sacrebleu-1.5.0-py3-none-any.whl (65 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.6/65.6 kB 26.4 MB/s eta 0:00:00
Requirement already satisfied: scikit-learn>=0.24.1 in ./installer_files/env/lib/python3.10/site-packages (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46)) (1.3.1)
Collecting sqlitedict (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading sqlitedict-2.1.0.tar.gz (21 kB)
  Preparing metadata (setup.py) ... done
Collecting tqdm-multiprocess (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading tqdm_multiprocess-0.0.11-py3-none-any.whl (9.8 kB)
Collecting zstandard (from lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading zstandard-0.21.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.7/2.7 MB 42.3 MB/s eta 0:00:00
Collecting portalocker (from sacrebleu==1.5.0->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for portalocker from https://files.pythonhosted.org/packages/17/9e/87671efcca80ba6203811540ed1f9c0462c1609d2281d7b7f53cef05da3d/portalocker-2.8.2-py3-none-any.whl.metadata
  Downloading portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Requirement already satisfied: mpmath>=0.19 in ./installer_files/env/lib/python3.10/site-packages (from sympy->optimum==1.13.1->-r temp_requirements.txt (line 9)) (1.3.0)
Requirement already satisfied: exceptiongroup in ./installer_files/env/lib/python3.10/site-packages (from anyio<4.0.0,>=3.7.1->fastapi->gradio==3.47.*->-r temp_requirements.txt (line 6)) (1.1.3)
Collecting blessings (from colour-runner>=0.0.5->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading blessings-1.7-py3-none-any.whl (18 kB)
Collecting ordered-set<4.2.0,>=4.0.2 (from deepdiff>=3.3.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading ordered_set-4.1.0-py3-none-any.whl (7.6 kB)
Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->GitPython!=3.1.29,>=1.0.0->wandb->-r temp_requirements.txt (line 21))
  Obtaining dependency information for smmap<6,>=3.0.1 from https://files.pythonhosted.org/packages/a7/a5/10f97f73544edcdef54409f1d839f6049a0d79df68adbc1ceb24d1aaca42/smmap-5.0.1-py3-none-any.whl.metadata
  Downloading smmap-5.0.1-py3-none-any.whl.metadata (4.3 kB)
Collecting termcolor>=1.1.0 (from inspecta>=0.1.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading termcolor-2.3.0-py3-none-any.whl (6.9 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for jsonschema-specifications>=2023.03.6 from https://files.pythonhosted.org/packages/1c/24/83349ac2189cc2435e84da3f69ba3c97314d3c0622628e55171c6798ed80/jsonschema_specifications-2023.7.1-py3-none-any.whl.metadata
  Downloading jsonschema_specifications-2023.7.1-py3-none-any.whl.metadata (2.8 kB)
Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for referencing>=0.28.4 from https://files.pythonhosted.org/packages/be/8e/56d6f1e2d591f4d6cbcba446cac4a1b0dc4f584537e2071d9bcee8eeab6b/referencing-0.30.2-py3-none-any.whl.metadata
  Downloading referencing-0.30.2-py3-none-any.whl.metadata (2.6 kB)
Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.47.*->-r temp_requirements.txt (line 6))
  Obtaining dependency information for rpds-py>=0.7.1 from https://files.pythonhosted.org/packages/a6/66/e719b76b282f6779c73f728f96cd2698793828c21fa60c753b07e05df715/rpds_py-0.10.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading rpds_py-0.10.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.7 kB)
Collecting pyasn1<0.6.0,>=0.4.6 (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tensorboard->-r temp_requirements.txt (line 18))
  Downloading pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.9/83.9 kB 43.9 MB/s eta 0:00:00
Collecting oauthlib>=3.0.0 (from requests-oauthlib>=0.7.0->google-auth-oauthlib<1.1,>=0.5->tensorboard->-r temp_requirements.txt (line 18))
  Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 37.0 MB/s eta 0:00:00
Requirement already satisfied: nltk in ./installer_files/env/lib/python3.10/site-packages (from rouge-score>=0.0.4->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46)) (3.8.1)
Requirement already satisfied: joblib>=1.1.1 in ./installer_files/env/lib/python3.10/site-packages (from scikit-learn>=0.24.1->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46)) (1.3.2)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./installer_files/env/lib/python3.10/site-packages (from scikit-learn>=0.24.1->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46)) (3.2.0)
Collecting chardet>=5.2 (from tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for chardet>=5.2 from https://files.pythonhosted.org/packages/38/6f/f5fbc992a329ee4e0f288c1fe0e2ad9485ed064cac731ed2fe47dcc38cbf/chardet-5.2.0-py3-none-any.whl.metadata
  Downloading chardet-5.2.0-py3-none-any.whl.metadata (3.4 kB)
Collecting filelock (from transformers==4.34.*->-r temp_requirements.txt (line 19))
  Obtaining dependency information for filelock from https://files.pythonhosted.org/packages/5e/5d/97afbafd9d584ff1b45fcb354a479a3609bd97f912f8f1f6c563cb1fae21/filelock-3.12.4-py3-none-any.whl.metadata
  Downloading filelock-3.12.4-py3-none-any.whl.metadata (2.8 kB)
Collecting platformdirs>=3.10 (from tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for platformdirs>=3.10 from https://files.pythonhosted.org/packages/56/29/3ec311dc18804409ecf0d2b09caa976f3ae6215559306b5b530004e11156/platformdirs-3.11.0-py3-none-any.whl.metadata
  Downloading platformdirs-3.11.0-py3-none-any.whl.metadata (11 kB)
Collecting pluggy>=1.3 (from tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for pluggy>=1.3 from https://files.pythonhosted.org/packages/05/b8/42ed91898d4784546c5f06c60506400548db3f7a4b3fb441cba4e5c17952/pluggy-1.3.0-py3-none-any.whl.metadata
  Downloading pluggy-1.3.0-py3-none-any.whl.metadata (4.3 kB)
Collecting pyproject-api>=1.6.1 (from tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for pyproject-api>=1.6.1 from https://files.pythonhosted.org/packages/cf/b4/39eea50542e50e93876ebc09c4349a9c9eee9f6b9c9d30f88c7dc5433db8/pyproject_api-1.6.1-py3-none-any.whl.metadata
  Downloading pyproject_api-1.6.1-py3-none-any.whl.metadata (2.8 kB)
Collecting tomli>=2.0.1 (from tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Downloading tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting virtualenv>=20.24.3 (from tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for virtualenv>=20.24.3 from https://files.pythonhosted.org/packages/4e/8b/f0d3a468c0186c603217a6656ea4f49259630e8ed99558501d92f6ff7dc3/virtualenv-20.24.5-py3-none-any.whl.metadata
  Downloading virtualenv-20.24.5-py3-none-any.whl.metadata (4.5 kB)
Collecting DataProperty<2,>=1.0.1 (from pytablewriter->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for DataProperty<2,>=1.0.1 from https://files.pythonhosted.org/packages/b1/3b/90ebd66ad57c588d6087e86e327436343e9cc60776a9445b79c6e80a022d/DataProperty-1.0.1-py3-none-any.whl.metadata
  Downloading DataProperty-1.0.1-py3-none-any.whl.metadata (11 kB)
Collecting mbstrdecoder<2,>=1.0.0 (from pytablewriter->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for mbstrdecoder<2,>=1.0.0 from https://files.pythonhosted.org/packages/c2/0f/726229136022b154895138bb10ba35e8435c4143f614cb5ad4d4e3fc21ec/mbstrdecoder-1.1.3-py3-none-any.whl.metadata
  Downloading mbstrdecoder-1.1.3-py3-none-any.whl.metadata (4.0 kB)
Collecting pathvalidate<4,>=2.3.0 (from pytablewriter->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for pathvalidate<4,>=2.3.0 from https://files.pythonhosted.org/packages/0c/ab/673cce13ab635fd755d206b18c0a371ef6e28ddbe25fadba9ae6c59f22a5/pathvalidate-3.2.0-py3-none-any.whl.metadata
  Downloading pathvalidate-3.2.0-py3-none-any.whl.metadata (11 kB)
Collecting tabledata<2,>=1.3.1 (from pytablewriter->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for tabledata<2,>=1.3.1 from https://files.pythonhosted.org/packages/06/e2/96b10ebc00d20b55967200e3d95c2137d91f58af1af672627683431c9d5c/tabledata-1.3.3-py3-none-any.whl.metadata
  Downloading tabledata-1.3.3-py3-none-any.whl.metadata (3.7 kB)
Collecting tcolorpy<1,>=0.0.5 (from pytablewriter->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for tcolorpy<1,>=0.0.5 from https://files.pythonhosted.org/packages/34/d0/8a701df46bf546fd155da02934b0bb2ac6ad4186e29f4a3297e744ab259d/tcolorpy-0.1.4-py3-none-any.whl.metadata
  Downloading tcolorpy-0.1.4-py3-none-any.whl.metadata (5.7 kB)
Collecting typepy[datetime]<2,>=1.3.2 (from pytablewriter->lm-eval->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for typepy[datetime]<2,>=1.3.2 from https://files.pythonhosted.org/packages/f1/10/0d6dc654bb4e0eca017bbaf43a315b464c888576a68a2883cd4a74bd1b6b/typepy-1.3.2-py3-none-any.whl.metadata
  Downloading typepy-1.3.2-py3-none-any.whl.metadata (9.3 kB)
Collecting distlib<1,>=0.3.7 (from virtualenv>=20.24.3->tox>=3.0.0->attributedict->autoawq==0.1.4->-r temp_requirements.txt (line 46))
  Obtaining dependency information for distlib<1,>=0.3.7 from https://files.pythonhosted.org/packages/43/a0/9ba967fdbd55293bacfc1507f58e316f740a3b231fc00e3d86dc39bc185a/distlib-0.3.7-py2.py3-none-any.whl.metadata
  Downloading distlib-0.3.7-py2.py3-none-any.whl.metadata (5.1 kB)
Downloading accelerate-0.23.0-py3-none-any.whl (258 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 258.1/258.1 kB 24.3 MB/s eta 0:00:00
Downloading gradio-3.47.1-py3-none-any.whl (20.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.3/20.3 MB 30.2 MB/s eta 0:00:00
Downloading optimum-1.13.1-py3-none-any.whl (396 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 396.1/396.1 kB 25.8 MB/s eta 0:00:00
Downloading peft-0.5.0-py3-none-any.whl (85 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.6/85.6 kB 50.6 MB/s eta 0:00:00
Downloading bitsandbytes-0.41.1-py3-none-any.whl (92.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92.6/92.6 MB 24.6 MB/s eta 0:00:00
Downloading autoawq-0.1.4-cp310-cp310-manylinux2014_x86_64.whl (20.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.0/20.0 MB 32.2 MB/s eta 0:00:00
Downloading gradio_client-0.6.0-py3-none-any.whl (298 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 298.8/298.8 kB 44.7 MB/s eta 0:00:00
Downloading datasets-2.14.5-py3-none-any.whl (519 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 519.6/519.6 kB 43.9 MB/s eta 0:00:00
Downloading einops-0.7.0-py3-none-any.whl (44 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.6/44.6 kB 25.0 MB/s eta 0:00:00
Downloading Markdown-3.5-py3-none-any.whl (101 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 101.7/101.7 kB 53.5 MB/s eta 0:00:00
Downloading pandas-2.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.3/12.3 MB 33.8 MB/s eta 0:00:00
Downloading Pillow-10.0.1-cp310-cp310-manylinux_2_28_x86_64.whl (3.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.6/3.6 MB 36.4 MB/s eta 0:00:00
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 31.6 MB/s eta 0:00:00
Downloading tensorboard-2.14.1-py3-none-any.whl (5.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.5/5.5 MB 30.5 MB/s eta 0:00:00
Downloading wandb-0.15.12-py3-none-any.whl (2.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 43.2 MB/s eta 0:00:00
Downloading absl_py-2.0.0-py3-none-any.whl (130 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 130.2/130.2 kB 35.9 MB/s eta 0:00:00
Downloading aiofiles-23.2.1-py3-none-any.whl (15 kB)
Downloading altair-5.1.2-py3-none-any.whl (516 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 516.2/516.2 kB 44.5 MB/s eta 0:00:00
Downloading dill-0.3.7-py3-none-any.whl (115 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.3/115.3 kB 55.4 MB/s eta 0:00:00
Downloading diskcache-5.6.3-py3-none-any.whl (45 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.5/45.5 kB 20.5 MB/s eta 0:00:00
Downloading aiohttp-3.8.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 47.4 MB/s eta 0:00:00
Downloading GitPython-3.1.37-py3-none-any.whl (190 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 190.0/190.0 kB 42.2 MB/s eta 0:00:00
Downloading google_auth-2.23.3-py2.py3-none-any.whl (182 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 182.3/182.3 kB 41.4 MB/s eta 0:00:00
Downloading grpcio-1.59.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.3/5.3 MB 51.6 MB/s eta 0:00:00
Downloading importlib_resources-6.1.0-py3-none-any.whl (33 kB)
Downloading matplotlib-3.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 43.0 MB/s eta 0:00:00
Downloading orjson-3.9.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 138.7/138.7 kB 35.4 MB/s eta 0:00:00
Downloading protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl (311 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 311.6/311.6 kB 45.2 MB/s eta 0:00:00
Downloading pyarrow-13.0.0-cp310-cp310-manylinux_2_28_x86_64.whl (40.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.0/40.0 MB 46.8 MB/s eta 0:00:00
Downloading pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 502.5/502.5 kB 74.8 MB/s eta 0:00:00
Downloading sentry_sdk-1.31.0-py2.py3-none-any.whl (224 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 224.8/224.8 kB 90.2 MB/s eta 0:00:00
Downloading tensorboard_data_server-0.7.1-py3-none-manylinux2014_x86_64.whl (6.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.6/6.6 MB 63.1 MB/s eta 0:00:00
Downloading typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Downloading uvicorn-0.23.2-py3-none-any.whl (59 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.5/59.5 kB 29.5 MB/s eta 0:00:00
Downloading fastapi-0.103.2-py3-none-any.whl (66 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.3/66.3 kB 32.6 MB/s eta 0:00:00
Downloading fastparquet-2023.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 60.3 MB/s eta 0:00:00
Downloading httpx-0.25.0-py3-none-any.whl (75 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.7/75.7 kB 36.5 MB/s eta 0:00:00
Downloading multiprocess-0.70.15-py310-none-any.whl (134 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.8/134.8 kB 66.4 MB/s eta 0:00:00
Downloading ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl (307 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 307.2/307.2 kB 61.2 MB/s eta 0:00:00
Downloading setproctitle-1.3.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30 kB)
Downloading texttable-1.7.0-py2.py3-none-any.whl (10 kB)
Downloading xxhash-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 194.1/194.1 kB 52.1 MB/s eta 0:00:00
Downloading anyio-3.7.1-py3-none-any.whl (80 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.9/80.9 kB 48.4 MB/s eta 0:00:00
Downloading async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Downloading cachetools-5.3.1-py3-none-any.whl (9.3 kB)
Downloading contourpy-1.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (301 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 301.7/301.7 kB 61.9 MB/s eta 0:00:00
Downloading coverage-7.3.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (227 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 227.5/227.5 kB 59.7 MB/s eta 0:00:00
Downloading cramjam-2.7.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 62.4 MB/s eta 0:00:00
Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB)
Downloading deepdiff-6.6.0-py3-none-any.whl (73 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73.0/73.0 kB 38.6 MB/s eta 0:00:00
Downloading fonttools-4.43.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 69.6 MB/s eta 0:00:00
Downloading frozenlist-1.4.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (225 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.7/225.7 kB 58.0 MB/s eta 0:00:00
Downloading httpcore-0.18.0-py3-none-any.whl (76 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.0/76.0 kB 38.3 MB/s eta 0:00:00
Downloading jsonschema-4.19.1-py3-none-any.whl (83 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.3/83.3 kB 41.0 MB/s eta 0:00:00
Downloading kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 68.3 MB/s eta 0:00:00
Downloading openai-0.28.1-py3-none-any.whl (76 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.0/77.0 kB 35.2 MB/s eta 0:00:00
Downloading pybind11-2.11.1-py3-none-any.whl (227 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 227.7/227.7 kB 57.0 MB/s eta 0:00:00
Downloading pyparsing-3.1.1-py3-none-any.whl (103 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.1/103.1 kB 52.1 MB/s eta 0:00:00
Downloading starlette-0.27.0-py3-none-any.whl (66 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.0/67.0 kB 35.4 MB/s eta 0:00:00
Downloading tox-4.11.3-py3-none-any.whl (153 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.8/153.8 kB 67.1 MB/s eta 0:00:00
Downloading filelock-3.12.4-py3-none-any.whl (11 kB)
Downloading fsspec-2023.6.0-py3-none-any.whl (163 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 76.9 MB/s eta 0:00:00
Downloading jsonlines-4.0.0-py3-none-any.whl (8.7 kB)
Downloading numexpr-2.8.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (384 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 384.1/384.1 kB 67.6 MB/s eta 0:00:00
Downloading pytablewriter-1.2.0-py3-none-any.whl (111 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 111.1/111.1 kB 59.8 MB/s eta 0:00:00
Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 82.2 MB/s eta 0:00:00
Downloading DataProperty-1.0.1-py3-none-any.whl (27 kB)
Downloading jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB)
Downloading mbstrdecoder-1.1.3-py3-none-any.whl (7.8 kB)
Downloading pathvalidate-3.2.0-py3-none-any.whl (23 kB)
Downloading platformdirs-3.11.0-py3-none-any.whl (17 kB)
Downloading pluggy-1.3.0-py3-none-any.whl (18 kB)
Downloading pyproject_api-1.6.1-py3-none-any.whl (12 kB)
Downloading referencing-0.30.2-py3-none-any.whl (25 kB)
Downloading rpds_py-0.10.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 75.4 MB/s eta 0:00:00
Downloading smmap-5.0.1-py3-none-any.whl (24 kB)
Downloading tabledata-1.3.3-py3-none-any.whl (11 kB)
Downloading tcolorpy-0.1.4-py3-none-any.whl (7.9 kB)
Downloading virtualenv-20.24.5-py3-none-any.whl (3.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.7/3.7 MB 72.6 MB/s eta 0:00:00
Downloading portalocker-2.8.2-py3-none-any.whl (17 kB)
Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 468.9/468.9 kB 79.2 MB/s eta 0:00:00
Downloading typepy-1.3.2-py3-none-any.whl (31 kB)
Building wheels for collected packages: torch-grammar, ffmpy, pathtools, rouge-score, pycountry, sqlitedict
  Building wheel for torch-grammar (pyproject.toml) ... done
  Created wheel for torch-grammar: filename=torch_grammar-0.3.3-py3-none-any.whl size=8254 sha256=b0ef8f0dabf2db1c32a6e0da65836e0d5fc7d6afca596517a39f0d6ea75954d8
  Stored in directory: /tmp/pip-ephem-wheel-cache-k27xrmop/wheels/dd/00/c9/08292a4496a8b7e174aefc6e0a8194cbb53977b7cbdd3006b7
  Building wheel for ffmpy (setup.py) ... done
  Created wheel for ffmpy: filename=ffmpy-0.3.1-py3-none-any.whl size=5579 sha256=e4bf515b61f7f6dc2883eb63bbd6e8569c16a30f5b388141ab9268749ddb38d8
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/01/a6/d1/1c0828c304a4283b2c1639a09ad86f83d7c487ef34c6b4a1bf
  Building wheel for pathtools (setup.py) ... done
  Created wheel for pathtools: filename=pathtools-0.1.2-py3-none-any.whl size=8791 sha256=febb4408b13a79db3084f11dde63f0d44e96259ebc6d4635380415b9d033169d
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/e7/f3/22/152153d6eb222ee7a56ff8617d80ee5207207a8c00a7aab794
  Building wheel for rouge-score (setup.py) ... done
  Created wheel for rouge-score: filename=rouge_score-0.1.2-py3-none-any.whl size=24932 sha256=926743eae3cbfdca0f7cd4b20f81cecd6affbab4b120422f38815863a938f98d
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/5f/dd/89/461065a73be61a532ff8599a28e9beef17985c9e9c31e541b4
  Building wheel for pycountry (pyproject.toml) ... done
  Created wheel for pycountry: filename=pycountry-22.3.5-py2.py3-none-any.whl size=10681833 sha256=c37ca8711829bf088fc5bcf9fcdefbdfd9dacd1cf79b9926287849b53a1b8dcd
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/03/57/cc/290c5252ec97a6d78d36479a3c5e5ecc76318afcb241ad9dbe
  Building wheel for sqlitedict (setup.py) ... done
  Created wheel for sqlitedict: filename=sqlitedict-2.1.0-py3-none-any.whl size=16864 sha256=8cf43f566e8f5af272a1299f4e5266d1f889f4bd41d1b6de3bfeb7f146aacf68
  Stored in directory: /home/adminpersivia/.cache/pip/wheels/79/d6/e7/304e0e6cb2221022c26d8161f7c23cd4f259a9e41e8bbcfabd
Successfully built torch-grammar ffmpy pathtools rouge-score pycountry sqlitedict
Installing collected packages: texttable, sqlitedict, pytz, pathtools, ninja, gptq-for-llama, ffmpy, distlib, bitsandbytes, appdirs, zstandard, xxhash, tzdata, typing-extensions, toolz, tomli, toml, termcolor, tensorboard-data-server, tcolorpy, tabulate, sniffio, smmap, setproctitle, sentry-sdk, semantic-version, rpds-py, rouge, requests, python-multipart, python-dateutil, pyparsing, pycountry, pybind11, pyasn1, psutil, protobuf, portalocker, pluggy, platformdirs, Pillow, pathvalidate, orjson, ordered-set, oauthlib, numpy, multidict, markdown, kiwisolver, importlib-resources, humanfriendly, h11, grpcio, fsspec, frozenlist, fonttools, filelock, einops, docker-pycreds, diskcache, dill, cycler, cramjam, coverage, colorama, chardet, cachetools, blessings, attrs, async-timeout, aiofiles, absl-py, yarl, virtualenv, uvicorn, tqdm-multiprocess, sacrebleu, rsa, rouge-score, requests-oauthlib, referencing, pyproject-api, pyasn1-modules, pyarrow, pandas, numexpr, multiprocess, mbstrdecoder, llama-cpp-python-cuda, llama-cpp-python, jsonlines, gitdb, deepdiff, contourpy, colour-runner, coloredlogs, codecov, anyio, aiosignal, typepy, tox, starlette, matplotlib, jsonschema-specifications, httpcore, google-auth, GitPython, fastparquet, ctransformers, aiohttp, wandb, rootpath, openai, jsonschema, httpx, google-auth-oauthlib, flash-attn, fastapi, exllamav2, exllama, accelerate, torch-grammar, tensorboard, peft, inspecta, gradio-client, datasets, DataProperty, altair, tabledata, optimum, gradio, auto-gptq, attributedict, pytablewriter, lm-eval, autoawq
  Attempting uninstall: typing-extensions
    Found existing installation: typing_extensions 4.4.0
    Uninstalling typing_extensions-4.4.0:
      Successfully uninstalled typing_extensions-4.4.0
  Attempting uninstall: requests
    Found existing installation: requests 2.28.1
    Uninstalling requests-2.28.1:
      Successfully uninstalled requests-2.28.1
  Attempting uninstall: Pillow
    Found existing installation: Pillow 9.3.0
    Uninstalling Pillow-9.3.0:
      Successfully uninstalled Pillow-9.3.0
  Attempting uninstall: numpy
    Found existing installation: numpy 1.24.1
    Uninstalling numpy-1.24.1:
      Successfully uninstalled numpy-1.24.1
  Attempting uninstall: fsspec
    Found existing installation: fsspec 2023.9.2
    Uninstalling fsspec-2023.9.2:
      Successfully uninstalled fsspec-2023.9.2
  Attempting uninstall: filelock
    Found existing installation: filelock 3.9.0
    Uninstalling filelock-3.9.0:
      Successfully uninstalled filelock-3.9.0
Successfully installed DataProperty-1.0.1 GitPython-3.1.37 Pillow-10.0.1 absl-py-2.0.0 accelerate-0.23.0 aiofiles-23.2.1 aiohttp-3.8.6 aiosignal-1.3.1 altair-5.1.2 anyio-3.7.1 appdirs-1.4.4 async-timeout-4.0.3 attributedict-0.3.0 attrs-23.1.0 auto-gptq-0.4.2+cu118 autoawq-0.1.4 bitsandbytes-0.41.1 blessings-1.7 cachetools-5.3.1 chardet-5.2.0 codecov-2.1.13 colorama-0.4.6 coloredlogs-15.0.1 colour-runner-0.1.1 contourpy-1.1.1 coverage-7.3.2 cramjam-2.7.0 ctransformers-0.2.27+cu118 cycler-0.12.1 datasets-2.14.5 deepdiff-6.6.0 dill-0.3.7 diskcache-5.6.3 distlib-0.3.7 docker-pycreds-0.4.0 einops-0.7.0 exllama-0.0.17+cu118 exllamav2-0.0.5+cu118 fastapi-0.103.2 fastparquet-2023.8.0 ffmpy-0.3.1 filelock-3.12.4 flash-attn-2.3.1.post1 fonttools-4.43.1 frozenlist-1.4.0 fsspec-2023.6.0 gitdb-4.0.10 google-auth-2.23.3 google-auth-oauthlib-1.0.0 gptq-for-llama-0.1.1+cu118 gradio-3.47.1 gradio-client-0.6.0 grpcio-1.59.0 h11-0.14.0 httpcore-0.18.0 httpx-0.25.0 humanfriendly-10.0 importlib-resources-6.1.0 inspecta-0.1.3 jsonlines-4.0.0 jsonschema-4.19.1 jsonschema-specifications-2023.7.1 kiwisolver-1.4.5 llama-cpp-python-0.2.11 llama-cpp-python-cuda-0.2.11+cu118 lm-eval-0.3.0 markdown-3.5 matplotlib-3.8.0 mbstrdecoder-1.1.3 multidict-6.0.4 multiprocess-0.70.15 ninja-1.11.1.1 numexpr-2.8.7 numpy-1.24.0 oauthlib-3.2.2 openai-0.28.1 optimum-1.13.1 ordered-set-4.1.0 orjson-3.9.8 pandas-2.1.1 pathtools-0.1.2 pathvalidate-3.2.0 peft-0.5.0 platformdirs-3.11.0 pluggy-1.3.0 portalocker-2.8.2 protobuf-4.24.4 psutil-5.9.5 pyarrow-13.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pybind11-2.11.1 pycountry-22.3.5 pyparsing-3.1.1 pyproject-api-1.6.1 pytablewriter-1.2.0 python-dateutil-2.8.2 python-multipart-0.0.6 pytz-2023.3.post1 referencing-0.30.2 requests-2.31.0 requests-oauthlib-1.3.1 rootpath-0.1.1 rouge-1.0.1 rouge-score-0.1.2 rpds-py-0.10.4 rsa-4.9 sacrebleu-1.5.0 semantic-version-2.10.0 sentry-sdk-1.31.0 setproctitle-1.3.3 smmap-5.0.1 sniffio-1.3.0 sqlitedict-2.1.0 starlette-0.27.0 tabledata-1.3.3 tabulate-0.9.0 tcolorpy-0.1.4 tensorboard-2.14.1 tensorboard-data-server-0.7.1 termcolor-2.3.0 texttable-1.7.0 toml-0.10.2 tomli-2.0.1 toolz-0.12.0 torch-grammar-0.3.3 tox-4.11.3 tqdm-multiprocess-0.0.11 typepy-1.3.2 typing-extensions-4.8.0 tzdata-2023.3 uvicorn-0.23.2 virtualenv-20.24.5 wandb-0.15.12 xxhash-3.4.1 yarl-1.9.2 zstandard-0.21.0
Cloning into 'exllama'...
remote: Enumerating objects: 1523, done.
remote: Counting objects: 100% (853/853), done.
remote: Compressing objects: 100% (299/299), done.
remote: Total 1523 (delta 679), reused 589 (delta 553), pack-reused 670
Receiving objects: 100% (1523/1523), 950.59 KiB | 7.09 MiB/s, done.
Resolving deltas: 100% (1061/1061), done.
Will remove 76 (153.0 MB) tarball(s).
Will remove 1 index cache(s).
Will remove 4 (408 KB) package(s).
There are no tempfile(s) to remove.
There are no logfile(s) to remove.
Files removed: 550

*******************************************************************
* WARNING: You haven't downloaded any model yet.
* Once the web UI launches, head over to the "Model" tab and download one.
*******************************************************************

False
/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:166: UserWarning: /home/adminpersivia/apps/text-generation-webui/installer_files/env did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
The following directories listed in your path were found to be non-existent: {PosixPath('local/PS-OPS-DLP02'), PosixPath('@/tmp/.ICE-unix/2161,unix/PS-OPS-DLP02')}
The following directories listed in your path were found to be non-existent: {PosixPath('/org/gnome/Terminal/screen/a54b81d9_f7aa_4a8d_a63c_2ee2141a6e7e')}
The following directories listed in your path were found to be non-existent: {PosixPath('1'), PosixPath('0')}
The following directories listed in your path were found to be non-existent: {PosixPath('/etc/xdg/xdg-ubuntu')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
The following directories listed in your path were found to be non-existent: {PosixPath('/usr/local/cuda/lib64')}
DEBUG: Possible options found for libcudart.so: set()
CUDA SETUP: PyTorch settings found: CUDA_VERSION=118, Highest Compute Capability: 8.6.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Loading binary /home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda118.so...
libcusparse.so.11: cannot open shared object file: No such file or directory
CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected.
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable
CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null
CUDA SETUP: Solution 1b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_1a
CUDA SETUP: Solution 1c): For a permanent solution add the export from 1b into your .bashrc file, located at ~/.bashrc
CUDA SETUP: Solution 2: If no library was found in step 1a) you need to install CUDA.
CUDA SETUP: Solution 2a): Download CUDA install script: wget https://github.com/TimDettmers/bitsandbytes/blob/main/cuda_install.sh
CUDA SETUP: Solution 2b): Install desired CUDA version to desired location. The syntax is bash cuda_install.sh CUDA_VERSION PATH_TO_INSTALL_INTO.
CUDA SETUP: Solution 2b): For example, "bash cuda_install.sh 113 ~/local/" will download CUDA 11.3 and install into the folder ~/local
Traceback (most recent call last):
  File "/home/adminpersivia/apps/text-generation-webui/server.py", line 31, in <module>
    from modules import (
  File "/home/adminpersivia/apps/text-generation-webui/modules/training.py", line 21, in <module>
    from peft import (
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/peft/__init__.py", line 22, in <module>
    from .auto import (
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/peft/auto.py", line 31, in <module>
    from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/peft/mapping.py", line 23, in <module>
    from .peft_model import (
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/peft/peft_model.py", line 38, in <module>
    from .tuners import (
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/peft/tuners/__init__.py", line 21, in <module>
    from .lora import LoraConfig, LoraModel
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/peft/tuners/lora.py", line 45, in <module>
    import bitsandbytes as bnb
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/__init__.py", line 6, in <module>
    from . import cuda_setup, utils, research
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/research/__init__.py", line 1, in <module>
    from . import nn
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/research/nn/__init__.py", line 1, in <module>
    from .modules import LinearFP8Mixed, LinearFP8Global
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/research/nn/modules.py", line 8, in <module>
    from bitsandbytes.optim import GlobalOptimManager
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/optim/__init__.py", line 6, in <module>
    from bitsandbytes.cextension import COMPILED_WITH_CUDA
  File "/home/adminpersivia/apps/text-generation-webui/installer_files/env/lib/python3.10/site-packages/bitsandbytes/cextension.py", line 20, in <module>
    raise RuntimeError('''
RuntimeError: 
        CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
mikolodz commented 1 year ago

Same here.

CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
jikkuatwork commented 1 year ago

Same here! stopped working on RTX 3060 after the update!

Free-Radical commented 1 year ago

Feels like @oobabooga is treating Linux like a "red-headed step child". PS In case you missed it, it's common (unsaid) knowledge that the red-headed step child shall always be Windoze! 😉

Free-Radical commented 1 year ago

I've had to revert to 1.6

tuxthepenguin84 commented 1 year ago

I've been having a similar issue and I'm on a Tesla P40.

I've been having to rollback to bitsandbytes version 0.38.1 to get everything working. 

conda activate textgen
cd text-generation-webui
pip install bitsandbytes==0.38.1
Free-Radical commented 1 year ago

@tuxthepenguin84 Thanks, just to confirm so if I upgrade textgen to latest version and then downgrade bitsandbytes==0.38.1, it should work?

tuxthepenguin84 commented 1 year ago

@tuxthepenguin84 Thanks, just to confirm so if I upgrade textgen to latest version and then downgrade bitsandbytes==0.38.1, it should work?

Yes that's correct, worked for me.

tuxthepenguin84 commented 1 year ago

Ok, I did some more digging and found out my environment was incorrectly setup. I think it's the result of doing constant upgrades of packages and text-generation-webui. I also don't use conda or python virtual envs, and just install everything to the system but I also run text-generation-webui on a dedicated server. I had to do quite a bit getting everything fixed including getting a bunch of python packages uninstalled as well as getting the correct versions installed. I was also missing the correct version of the cuda toolkit. It's probably off topic to post a full write up of what fixed it for me but if you are running a similar setup I can share my steps if needed.

github-actions[bot] commented 11 months ago

This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.