search

oobabooga / one-click-installers

Simplified installers for oobabooga/text-generation-webui.
GNU Affero General Public License v3.0
550 stars 186 forks source link

Some errors during one-click-installer on windows #38

Closed pyGisServer closed 1 year ago

pyGisServer commented 1 year ago

I have repeatedly tried to relizar the installation following the instructions. The problem is that I always get the same errors and although I have individually looked for how to solve some of the errors, I still have not succeeded. During installation, I get the following errors: ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed. numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.3 which is incompatible. clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.28.2 which is incompatible.

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed. clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.28.2 which is incompatible.

Finally, despite the above errors the installation continues, appearing at the end the following message:

C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
running bdist_egg
running egg_info
creating quant_cuda.egg-info
writing quant_cuda.egg-info\PKG-INFO
writing dependency_links to quant_cuda.egg-info\dependency_links.txt
writing top-level names to quant_cuda.egg-info\top_level.txt
writing manifest file 'quant_cuda.egg-info\SOURCES.txt'
reading manifest file 'quant_cuda.egg-info\SOURCES.txt'
writing manifest file 'quant_cuda.egg-info\SOURCES.txt'
installing library code to build\bdist.win-amd64\egg
running install_lib
running build_ext
C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
  warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
  File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup_cuda.py", line 4, in <module>
    setup(
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
    return distutils.core.setup(**attrs)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
    return run_commands(dist)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
    dist.run_commands()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
    self.run_command(cmd)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
    super().run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 74, in run
    self.do_egg_install()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 123, in do_egg_install
    self.run_command('bdist_egg')
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
    self.distribution.run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
    super().run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\bdist_egg.py", line 165, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\bdist_egg.py", line 151, in call_command
    self.run_command(cmdname)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
    self.distribution.run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
    super().run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install_lib.py", line 11, in run
    self.build()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\install_lib.py", line 112, in build
    self.run_command('build_ext')
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
    self.distribution.run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
    super().run_command(command)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
    _build_ext.run(self)
  File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
    self.build_extensions()
  File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
    _check_cuda_version(compiler_name, compiler_version)
  File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 386, in _check_cuda_version
    raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.

CUDA kernel compilation failed.
Attempting installation with wheel.
Collecting quant-cuda==0.0.0
  Using cached https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl (398 kB)
Installing collected packages: quant-cuda
Successfully installed quant-cuda-0.0.0
xNul commented 1 year ago

The compilation of that library failed, but the wheel installation succeeded so you should be good to go. To fix the error anyway, we have some info in https://github.com/oobabooga/text-generation-webui/issues/1456.

The other couple dependency conflicts shouldn't be an issue, but if they turn out to be, you can try using my newest version of the one-click installers which may fix them.

pyGisServer commented 1 year ago

The compilation of that library failed, but the wheel installation succeeded so you should be good to go. To fix the error anyway, we have some info in oobabooga/text-generation-webui#1456.

The other couple dependency conflicts shouldn't be an issue, but if they turn out to be, you can try using my newest version of the one-click installers which may fix them.

I tried using your installer but I get exactly the same errors. The problem is that it does not allow me to use any quantized model and if I try to run python setup_cuda.py install I also receive cuda errors.

xNul commented 1 year ago

Gotcha, then try applying the fix in https://github.com/oobabooga/text-generation-webui/issues/1456. That has worked for other people.

pyGisServer commented 1 year ago

Gotcha, then try applying the fix in oobabooga/text-generation-webui#1456. That has worked for other people.

I have followed the advice, but I have not been able to solve it. I think it could be due to a conflict with another conda installation on the system.

xNul commented 1 year ago

If you tried to set the CUDA_PATH and it didn't work then, try installing using the latest version of the one-click installer that I have here https://github.com/xNul/one-click-installers It's been updated since you last tried it.

If that still doesn't work, please send your full install log so I can try to pinpoint the source of the problem.

pyGisServer commented 1 year ago

I tried again to install it with your latest version, the problems with PIP seem to have been resolved, but it still keeps giving error with CUDA. 

Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.1.0-1-Windows-x86_64.exe to C:\AI\oobabooga\installer_files\miniconda_installer.exe
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 53.1M  100 53.1M    0     0  58.6M      0 --:--:-- --:--:-- --:--:-- 58.6M
Installing Miniconda to C:\AI\oobabooga\installer_files\conda
Miniconda version:
conda 22.11.1
Packages to install:
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: C:\AI\oobabooga\installer_files\env

  added / updated specs:
    - python=3.10

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    openssl-1.1.1t             |       h2bbff1b_0         5.5 MB
    pip-23.0.1                 |  py310haa95532_0         2.8 MB
    python-3.10.11             |       h966fe2a_2        15.8 MB
    setuptools-66.0.0          |  py310haa95532_0         1.2 MB
    sqlite-3.41.2              |       h2bbff1b_0         894 KB
    tzdata-2023c               |       h04d1e81_0         116 KB
    wheel-0.38.4               |  py310haa95532_0          83 KB
    ------------------------------------------------------------
                                           Total:        26.3 MB

The following NEW packages will be INSTALLED:

  bzip2              pkgs/main/win-64::bzip2-1.0.8-he774522_0
  ca-certificates    pkgs/main/win-64::ca-certificates-2023.01.10-haa95532_0
  libffi             pkgs/main/win-64::libffi-3.4.2-hd77b12b_6
  openssl            pkgs/main/win-64::openssl-1.1.1t-h2bbff1b_0
  pip                pkgs/main/win-64::pip-23.0.1-py310haa95532_0
  python             pkgs/main/win-64::python-3.10.11-h966fe2a_2
  setuptools         pkgs/main/win-64::setuptools-66.0.0-py310haa95532_0
  sqlite             pkgs/main/win-64::sqlite-3.41.2-h2bbff1b_0
  tk                 pkgs/main/win-64::tk-8.6.12-h2bbff1b_0
  tzdata             pkgs/main/noarch::tzdata-2023c-h04d1e81_0
  vc                 pkgs/main/win-64::vc-14.2-h21ff451_1
  vs2015_runtime     pkgs/main/win-64::vs2015_runtime-14.27.29016-h5e58377_2
  wheel              pkgs/main/win-64::wheel-0.38.4-py310haa95532_0
  xz                 pkgs/main/win-64::xz-5.2.10-h8cc25b3_1
  zlib               pkgs/main/win-64::zlib-1.2.13-h8cc25b3_0

Downloading and Extracting Packages

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate C:\AI\oobabooga\installer_files\env
#
# To deactivate an active environment, use
#
#     $ conda deactivate

What is your GPU

A) NVIDIA
B) AMD
C) Apple M Series
D) None (I want to run in CPU mode)

Input> a
Collecting package metadata (current_repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.1.0
  latest version: 23.3.1

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=23.3.1

## Package Plan ##

  environment location: C:\AI\oobabooga\installer_files\env

  added / updated specs:
    - cuda-toolkit
    - git
    - ninja
    - pytorch-cuda=11.7
    - pytorch==2[build=py3.10_cuda11.7*]
    - torchaudio
    - torchvision

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    blas-1.0                   |              mkl           6 KB
    cryptography-39.0.1        |  py310h21b164f_0         1.0 MB
    cuda-cccl-12.1.109         |                0         1.2 MB  nvidia
    cuda-command-line-tools-11.7.0|                0           1 KB  nvidia/label/cuda-11.7.0
    cuda-compiler-12.1.1       |                0           2 KB  nvidia
    cuda-cudart-11.7.60        |                0         1.4 MB  nvidia/label/cuda-11.7.0
    cuda-cudart-dev-11.7.60    |                0         695 KB  nvidia/label/cuda-11.7.0
    cuda-cuobjdump-12.1.111    |                0         3.7 MB  nvidia
    cuda-cupti-11.7.50         |                0        10.2 MB  nvidia/label/cuda-11.7.0
    cuda-cuxxfilt-12.1.105     |                0         163 KB  nvidia
    cuda-documentation-12.1.105|                0          89 KB  nvidia
    cuda-libraries-11.7.0      |                0           1 KB  nvidia/label/cuda-11.7.0
    cuda-libraries-dev-11.7.0  |                0           1 KB  nvidia/label/cuda-11.7.0
    cuda-memcheck-11.8.86      |                0         183 KB  nvidia
    cuda-nsight-compute-12.1.1 |                0           2 KB  nvidia
    cuda-nvcc-12.1.105         |                0        55.3 MB  nvidia
    cuda-nvdisasm-12.1.105     |                0        48.0 MB  nvidia
    cuda-nvml-dev-12.1.105     |                0          88 KB  nvidia
    cuda-nvprof-12.1.105       |                0         1.6 MB  nvidia
    cuda-nvprune-12.1.105      |                0         150 KB  nvidia
    cuda-nvrtc-11.7.50         |                0        71.9 MB  nvidia/label/cuda-11.7.0
    cuda-nvrtc-dev-11.7.50     |                0        14.3 MB  nvidia/label/cuda-11.7.0
    cuda-nvtx-11.7.50          |                0          43 KB  nvidia/label/cuda-11.7.0
    cuda-nvvp-12.1.105         |                0       113.6 MB  nvidia
    cuda-runtime-11.7.0        |                0           1 KB  nvidia/label/cuda-11.7.0
    cuda-sanitizer-api-12.1.105|                0        12.9 MB  nvidia
    cuda-toolkit-11.7.0        |                0           1 KB  nvidia/label/cuda-11.7.0
    cuda-tools-11.7.0          |                0           1 KB  nvidia/label/cuda-11.7.0
    cuda-visual-tools-11.7.0   |                0           1 KB  nvidia/label/cuda-11.7.0
    filelock-3.9.0             |  py310haa95532_0          19 KB
    freetype-2.12.1            |       ha860e81_0         490 KB
    giflib-5.2.1               |       h8cc25b3_3          88 KB
    git-2.34.1                 |       haa95532_0        50.4 MB
    intel-openmp-2021.4.0      |    haa95532_3556         2.2 MB
    jinja2-3.1.2               |  py310haa95532_0         215 KB
    jpeg-9e                    |       h2bbff1b_1         320 KB
    lerc-3.0                   |       hd77b12b_0         120 KB
    libcublas-11.10.1.25       |                0          24 KB  nvidia/label/cuda-11.7.0
    libcublas-dev-11.10.1.25   |                0       286.3 MB  nvidia/label/cuda-11.7.0
    libcufft-10.7.2.50         |                0           6 KB  nvidia/label/cuda-11.7.0
    libcufft-dev-10.7.2.50     |                0       249.8 MB  nvidia/label/cuda-11.7.0
    libcurand-10.3.2.106       |                0           3 KB  nvidia
    libcurand-dev-10.3.2.106   |                0        50.0 MB  nvidia
    libcusolver-11.3.5.50      |                0          29 KB  nvidia/label/cuda-11.7.0
    libcusolver-dev-11.3.5.50  |                0        86.6 MB  nvidia/label/cuda-11.7.0
    libcusparse-11.7.3.50      |                0          13 KB  nvidia/label/cuda-11.7.0
    libcusparse-dev-11.7.3.50  |                0       147.6 MB  nvidia/label/cuda-11.7.0
    libdeflate-1.17            |       h2bbff1b_0         151 KB
    libnpp-11.7.3.21           |                0         286 KB  nvidia/label/cuda-11.7.0
    libnpp-dev-11.7.3.21       |                0       114.3 MB  nvidia/label/cuda-11.7.0
    libnvjpeg-11.7.2.34        |                0           4 KB  nvidia/label/cuda-11.7.0
    libnvjpeg-dev-11.7.2.34    |                0         1.8 MB  nvidia/label/cuda-11.7.0
    libpng-1.6.39              |       h8cc25b3_0         369 KB
    libtiff-4.5.0              |       h6c2663c_2         1.2 MB
    libuv-1.44.2               |       h2bbff1b_0         288 KB
    libwebp-1.2.4              |       hbc33d0d_1          73 KB
    libwebp-base-1.2.4         |       h2bbff1b_1         304 KB
    lz4-c-1.9.4                |       h2bbff1b_0         143 KB
    markupsafe-2.1.1           |  py310h2bbff1b_0          26 KB
    mkl-2021.4.0               |     haa95532_640       114.9 MB
    mkl-service-2.4.0          |  py310h2bbff1b_0          48 KB
    mkl_fft-1.3.1              |  py310ha0764ea_0         136 KB
    mkl_random-1.2.2           |  py310h4ed8f06_0         221 KB
    mpmath-1.2.1               |  py310haa95532_0         779 KB
    networkx-2.8.4             |  py310haa95532_1         2.6 MB
    ninja-1.10.2               |       haa95532_5          14 KB
    ninja-base-1.10.2          |       h6d14046_5         255 KB
    nsight-compute-2023.1.1.4  |                0       602.4 MB  nvidia
    numpy-1.24.3               |  py310hdc03b94_0          11 KB
    numpy-base-1.24.3          |  py310h3caf3d7_0         6.1 MB
    pillow-9.4.0               |  py310hd77b12b_0        1007 KB
    pyopenssl-23.0.0           |  py310haa95532_0          98 KB
    pytorch-2.0.0              |py3.10_cuda11.7_cudnn8_0        1.17 GB  pytorch
    pytorch-cuda-11.7          |       h16d0643_3           7 KB  pytorch
    pytorch-mutex-1.0          |             cuda           3 KB  pytorch
    requests-2.29.0            |  py310haa95532_0          98 KB
    sympy-1.11.1               |  py310haa95532_0        11.8 MB
    torchaudio-2.0.0           |      py310_cu117         5.7 MB  pytorch
    torchvision-0.15.0         |      py310_cu117         7.7 MB  pytorch
    typing_extensions-4.5.0    |  py310haa95532_0          49 KB
    urllib3-1.26.15            |  py310haa95532_0         195 KB
    zstd-1.5.5                 |       hd43e919_0         682 KB
    ------------------------------------------------------------
                                           Total:        3.20 GB

The following NEW packages will be INSTALLED:

  blas               pkgs/main/win-64::blas-1.0-mkl
  brotlipy           pkgs/main/win-64::brotlipy-0.7.0-py310h2bbff1b_1002
  certifi            pkgs/main/win-64::certifi-2022.12.7-py310haa95532_0
  cffi               pkgs/main/win-64::cffi-1.15.1-py310h2bbff1b_3
  charset-normalizer pkgs/main/noarch::charset-normalizer-2.0.4-pyhd3eb1b0_0
  cryptography       pkgs/main/win-64::cryptography-39.0.1-py310h21b164f_0
  cuda-cccl          nvidia/win-64::cuda-cccl-12.1.109-0
  cuda-command-line~ nvidia/label/cuda-11.7.0/win-64::cuda-command-line-tools-11.7.0-0
  cuda-compiler      nvidia/win-64::cuda-compiler-12.1.1-0
  cuda-cudart        nvidia/label/cuda-11.7.0/win-64::cuda-cudart-11.7.60-0
  cuda-cudart-dev    nvidia/label/cuda-11.7.0/win-64::cuda-cudart-dev-11.7.60-0
  cuda-cuobjdump     nvidia/win-64::cuda-cuobjdump-12.1.111-0
  cuda-cupti         nvidia/label/cuda-11.7.0/win-64::cuda-cupti-11.7.50-0
  cuda-cuxxfilt      nvidia/win-64::cuda-cuxxfilt-12.1.105-0
  cuda-documentation nvidia/win-64::cuda-documentation-12.1.105-0
  cuda-libraries     nvidia/label/cuda-11.7.0/win-64::cuda-libraries-11.7.0-0
  cuda-libraries-dev nvidia/label/cuda-11.7.0/win-64::cuda-libraries-dev-11.7.0-0
  cuda-memcheck      nvidia/win-64::cuda-memcheck-11.8.86-0
  cuda-nsight-compu~ nvidia/win-64::cuda-nsight-compute-12.1.1-0
  cuda-nvcc          nvidia/win-64::cuda-nvcc-12.1.105-0
  cuda-nvdisasm      nvidia/win-64::cuda-nvdisasm-12.1.105-0
  cuda-nvml-dev      nvidia/win-64::cuda-nvml-dev-12.1.105-0
  cuda-nvprof        nvidia/win-64::cuda-nvprof-12.1.105-0
  cuda-nvprune       nvidia/win-64::cuda-nvprune-12.1.105-0
  cuda-nvrtc         nvidia/label/cuda-11.7.0/win-64::cuda-nvrtc-11.7.50-0
  cuda-nvrtc-dev     nvidia/label/cuda-11.7.0/win-64::cuda-nvrtc-dev-11.7.50-0
  cuda-nvtx          nvidia/label/cuda-11.7.0/win-64::cuda-nvtx-11.7.50-0
  cuda-nvvp          nvidia/win-64::cuda-nvvp-12.1.105-0
  cuda-runtime       nvidia/label/cuda-11.7.0/win-64::cuda-runtime-11.7.0-0
  cuda-sanitizer-api nvidia/win-64::cuda-sanitizer-api-12.1.105-0
  cuda-toolkit       nvidia/label/cuda-11.7.0/win-64::cuda-toolkit-11.7.0-0
  cuda-tools         nvidia/label/cuda-11.7.0/win-64::cuda-tools-11.7.0-0
  cuda-visual-tools  nvidia/label/cuda-11.7.0/win-64::cuda-visual-tools-11.7.0-0
  filelock           pkgs/main/win-64::filelock-3.9.0-py310haa95532_0
  freetype           pkgs/main/win-64::freetype-2.12.1-ha860e81_0
  giflib             pkgs/main/win-64::giflib-5.2.1-h8cc25b3_3
  git                pkgs/main/win-64::git-2.34.1-haa95532_0
  idna               pkgs/main/win-64::idna-3.4-py310haa95532_0
  intel-openmp       pkgs/main/win-64::intel-openmp-2021.4.0-haa95532_3556
  jinja2             pkgs/main/win-64::jinja2-3.1.2-py310haa95532_0
  jpeg               pkgs/main/win-64::jpeg-9e-h2bbff1b_1
  lerc               pkgs/main/win-64::lerc-3.0-hd77b12b_0
  libcublas          nvidia/label/cuda-11.7.0/win-64::libcublas-11.10.1.25-0
  libcublas-dev      nvidia/label/cuda-11.7.0/win-64::libcublas-dev-11.10.1.25-0
  libcufft           nvidia/label/cuda-11.7.0/win-64::libcufft-10.7.2.50-0
  libcufft-dev       nvidia/label/cuda-11.7.0/win-64::libcufft-dev-10.7.2.50-0
  libcurand          nvidia/win-64::libcurand-10.3.2.106-0
  libcurand-dev      nvidia/win-64::libcurand-dev-10.3.2.106-0
  libcusolver        nvidia/label/cuda-11.7.0/win-64::libcusolver-11.3.5.50-0
  libcusolver-dev    nvidia/label/cuda-11.7.0/win-64::libcusolver-dev-11.3.5.50-0
  libcusparse        nvidia/label/cuda-11.7.0/win-64::libcusparse-11.7.3.50-0
  libcusparse-dev    nvidia/label/cuda-11.7.0/win-64::libcusparse-dev-11.7.3.50-0
  libdeflate         pkgs/main/win-64::libdeflate-1.17-h2bbff1b_0
  libnpp             nvidia/label/cuda-11.7.0/win-64::libnpp-11.7.3.21-0
  libnpp-dev         nvidia/label/cuda-11.7.0/win-64::libnpp-dev-11.7.3.21-0
  libnvjpeg          nvidia/label/cuda-11.7.0/win-64::libnvjpeg-11.7.2.34-0
  libnvjpeg-dev      nvidia/label/cuda-11.7.0/win-64::libnvjpeg-dev-11.7.2.34-0
  libpng             pkgs/main/win-64::libpng-1.6.39-h8cc25b3_0
  libtiff            pkgs/main/win-64::libtiff-4.5.0-h6c2663c_2
  libuv              pkgs/main/win-64::libuv-1.44.2-h2bbff1b_0
  libwebp            pkgs/main/win-64::libwebp-1.2.4-hbc33d0d_1
  libwebp-base       pkgs/main/win-64::libwebp-base-1.2.4-h2bbff1b_1
  lz4-c              pkgs/main/win-64::lz4-c-1.9.4-h2bbff1b_0
  markupsafe         pkgs/main/win-64::markupsafe-2.1.1-py310h2bbff1b_0
  mkl                pkgs/main/win-64::mkl-2021.4.0-haa95532_640
  mkl-service        pkgs/main/win-64::mkl-service-2.4.0-py310h2bbff1b_0
  mkl_fft            pkgs/main/win-64::mkl_fft-1.3.1-py310ha0764ea_0
  mkl_random         pkgs/main/win-64::mkl_random-1.2.2-py310h4ed8f06_0
  mpmath             pkgs/main/win-64::mpmath-1.2.1-py310haa95532_0
  networkx           pkgs/main/win-64::networkx-2.8.4-py310haa95532_1
  ninja              pkgs/main/win-64::ninja-1.10.2-haa95532_5
  ninja-base         pkgs/main/win-64::ninja-base-1.10.2-h6d14046_5
  nsight-compute     nvidia/win-64::nsight-compute-2023.1.1.4-0
  numpy              pkgs/main/win-64::numpy-1.24.3-py310hdc03b94_0
  numpy-base         pkgs/main/win-64::numpy-base-1.24.3-py310h3caf3d7_0
  pillow             pkgs/main/win-64::pillow-9.4.0-py310hd77b12b_0
  pycparser          pkgs/main/noarch::pycparser-2.21-pyhd3eb1b0_0
  pyopenssl          pkgs/main/win-64::pyopenssl-23.0.0-py310haa95532_0
  pysocks            pkgs/main/win-64::pysocks-1.7.1-py310haa95532_0
  pytorch            pytorch/win-64::pytorch-2.0.0-py3.10_cuda11.7_cudnn8_0
  pytorch-cuda       pytorch/win-64::pytorch-cuda-11.7-h16d0643_3
  pytorch-mutex      pytorch/noarch::pytorch-mutex-1.0-cuda
  requests           pkgs/main/win-64::requests-2.29.0-py310haa95532_0
  six                pkgs/main/noarch::six-1.16.0-pyhd3eb1b0_1
  sympy              pkgs/main/win-64::sympy-1.11.1-py310haa95532_0
  torchaudio         pytorch/win-64::torchaudio-2.0.0-py310_cu117
  torchvision        pytorch/win-64::torchvision-0.15.0-py310_cu117
  typing_extensions  pkgs/main/win-64::typing_extensions-4.5.0-py310haa95532_0
  urllib3            pkgs/main/win-64::urllib3-1.26.15-py310haa95532_0
  win_inet_pton      pkgs/main/win-64::win_inet_pton-1.1.0-py310haa95532_0
  zstd               pkgs/main/win-64::zstd-1.5.5-hd43e919_0

Downloading and Extracting Packages

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Cloning into 'text-generation-webui'...
remote: Enumerating objects: 6369, done.
remote: Counting objects: 100% (1750/1750), done.
remote: Compressing objects: 100% (243/243), done.
remote: Total 6369 (delta 1646), reused 1507 (delta 1507), pack-reused 4619 eceiving objects:  99% (6306/6369)
Receiving objects: 100% (6369/6369), 2.31 MiB | 11.45 MiB/s, done.
Resolving deltas: 100% (4259/4259), done.
Collecting bitsandbytes==0.38.1
  Using cached https://github.com/jllllll/bitsandbytes-windows-webui/raw/main/bitsandbytes-0.38.1-py3-none-any.whl (82.6 MB)
Installing collected packages: bitsandbytes
Successfully installed bitsandbytes-0.38.1
Already up to date.
Collecting git+https://github.com/huggingface/peft (from -r requirements.txt (line 16))
  Cloning https://github.com/huggingface/peft to c:\ai\oobabooga\installer_files\pip-req-build-7n1ntryd
  Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft 'C:\AI\oobabooga\installer_files\pip-req-build-7n1ntryd'
  Resolved https://github.com/huggingface/peft to commit 632997d1fb776c3cf05d8c2537ac9a98a7ce9435
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system != "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system != "Windows"' don't match your environment
Collecting llama-cpp-python==0.1.36
  Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.36/llama_cpp_python-0.1.36-cp310-cp310-win_amd64.whl (128 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.7/128.7 kB 1.3 MB/s eta 0:00:00
Collecting accelerate==0.18.0
  Using cached accelerate-0.18.0-py3-none-any.whl (215 kB)
Collecting colorama
  Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting datasets
  Using cached datasets-2.12.0-py3-none-any.whl (474 kB)
Collecting flexgen==0.1.7
  Using cached flexgen-0.1.7-py3-none-any.whl (50 kB)
Collecting gradio==3.25.0
  Using cached gradio-3.25.0-py3-none-any.whl (17.5 MB)
Collecting markdown
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (1.24.3)
Collecting pandas
  Using cached pandas-2.0.1-cp310-cp310-win_amd64.whl (10.7 MB)
Collecting Pillow>=9.5.0
  Using cached Pillow-9.5.0-cp310-cp310-win_amd64.whl (2.5 MB)
Collecting pyyaml
  Using cached PyYAML-6.0-cp310-cp310-win_amd64.whl (151 kB)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (2.29.0)
Collecting rwkv==0.7.3
  Using cached rwkv-0.7.3-py3-none-any.whl (16 kB)
Collecting safetensors==0.3.0
  Using cached safetensors-0.3.0-cp310-cp310-win_amd64.whl (262 kB)
Collecting sentencepiece
  Using cached sentencepiece-0.1.98-cp310-cp310-win_amd64.whl (977 kB)
Collecting tqdm
  Using cached tqdm-4.65.0-py3-none-any.whl (77 kB)
Collecting transformers==4.28.1
  Using cached transformers-4.28.1-py3-none-any.whl (7.0 MB)
Collecting packaging>=20.0
  Using cached packaging-23.1-py3-none-any.whl (48 kB)
Collecting psutil
  Using cached psutil-5.9.5-cp36-abi3-win_amd64.whl (255 kB)
Requirement already satisfied: torch>=1.4.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (2.0.0)
Collecting attrs
  Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting pulp
  Using cached PuLP-2.7.0-py3-none-any.whl (14.3 MB)
Requirement already satisfied: markupsafe in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.1.1)
Collecting semantic-version
  Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: typing-extensions in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (4.5.0)
Collecting uvicorn
  Using cached uvicorn-0.22.0-py3-none-any.whl (58 kB)
Collecting orjson
  Using cached orjson-3.8.11-cp310-none-win_amd64.whl (196 kB)
Requirement already satisfied: jinja2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.1.2)
Collecting websockets>=10.0
  Using cached websockets-11.0.2-cp310-cp310-win_amd64.whl (124 kB)
Collecting aiofiles
  Using cached aiofiles-23.1.0-py3-none-any.whl (14 kB)
Collecting fastapi
  Using cached fastapi-0.95.1-py3-none-any.whl (56 kB)
Collecting matplotlib
  Using cached matplotlib-3.7.1-cp310-cp310-win_amd64.whl (7.6 MB)
Collecting huggingface-hub>=0.13.0
  Using cached huggingface_hub-0.14.1-py3-none-any.whl (224 kB)
Collecting httpx
  Using cached httpx-0.24.0-py3-none-any.whl (75 kB)
Collecting aiohttp
  Using cached aiohttp-3.8.4-cp310-cp310-win_amd64.whl (319 kB)
Collecting mdit-py-plugins<=0.3.3
  Using cached mdit_py_plugins-0.3.3-py3-none-any.whl (50 kB)
Collecting pydantic
  Using cached pydantic-1.10.7-cp310-cp310-win_amd64.whl (2.1 MB)
Collecting altair>=4.2.0
  Using cached altair-4.2.2-py3-none-any.whl (813 kB)
Collecting pydub
  Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Collecting ffmpy
  Using cached ffmpy-0.3.0-py3-none-any.whl
Collecting gradio-client>=0.0.8
  Using cached gradio_client-0.1.4-py3-none-any.whl (286 kB)
Collecting python-multipart
  Using cached python_multipart-0.0.6-py3-none-any.whl (45 kB)
Collecting markdown-it-py[linkify]>=2.0.0
  Using cached markdown_it_py-2.2.0-py3-none-any.whl (84 kB)
Collecting tokenizers>=0.13.2
  Using cached tokenizers-0.13.3-cp310-cp310-win_amd64.whl (3.5 MB)
Requirement already satisfied: filelock in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.1->-r requirements.txt (line 17)) (3.9.0)
Collecting regex!=2019.12.17
  Using cached regex-2023.3.23-cp310-cp310-win_amd64.whl (267 kB)
Collecting responses<0.19
  Using cached responses-0.18.0-py3-none-any.whl (38 kB)
Collecting pyarrow>=8.0.0
  Using cached pyarrow-11.0.0-cp310-cp310-win_amd64.whl (20.6 MB)
Collecting dill<0.3.7,>=0.3.0
  Using cached dill-0.3.6-py3-none-any.whl (110 kB)
Collecting xxhash
  Using cached xxhash-3.2.0-cp310-cp310-win_amd64.whl (30 kB)
Collecting fsspec[http]>=2021.11.1
  Using cached fsspec-2023.4.0-py3-none-any.whl (153 kB)
Collecting multiprocess
  Using cached multiprocess-0.70.14-py310-none-any.whl (134 kB)
Collecting tzdata>=2022.1
  Using cached tzdata-2023.3-py2.py3-none-any.whl (341 kB)
Collecting pytz>=2020.1
  Using cached pytz-2023.3-py2.py3-none-any.whl (502 kB)
Collecting python-dateutil>=2.8.2
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (2022.12.7)
Collecting entrypoints
  Using cached entrypoints-0.4-py3-none-any.whl (5.3 kB)
Collecting jsonschema>=3.0
  Using cached jsonschema-4.17.3-py3-none-any.whl (90 kB)
Collecting toolz
  Using cached toolz-0.12.0-py3-none-any.whl (55 kB)
Collecting frozenlist>=1.1.1
  Using cached frozenlist-1.3.3-cp310-cp310-win_amd64.whl (33 kB)
Collecting multidict<7.0,>=4.5
  Using cached multidict-6.0.4-cp310-cp310-win_amd64.whl (28 kB)
Collecting aiosignal>=1.1.2
  Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting yarl<2.0,>=1.0
  Using cached yarl-1.9.2-cp310-cp310-win_amd64.whl (61 kB)
Collecting async-timeout<5.0,>=4.0.0a3
  Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting mdurl~=0.1
  Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Collecting linkify-it-py<3,>=1
  Using cached linkify_it_py-2.0.0-py3-none-any.whl (19 kB)
Requirement already satisfied: six>=1.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 8)) (1.16.0)
Requirement already satisfied: sympy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.11.1)
Requirement already satisfied: networkx in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (2.8.4)
Collecting starlette<0.27.0,>=0.26.1
  Using cached starlette-0.26.1-py3-none-any.whl (66 kB)
Collecting sniffio
  Using cached sniffio-1.3.0-py3-none-any.whl (10 kB)
Collecting httpcore<0.18.0,>=0.15.0
  Using cached httpcore-0.17.0-py3-none-any.whl (70 kB)
Collecting pyparsing>=2.3.1
  Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting cycler>=0.10
  Using cached cycler-0.11.0-py3-none-any.whl (6.4 kB)
Collecting kiwisolver>=1.0.1
  Using cached kiwisolver-1.4.4-cp310-cp310-win_amd64.whl (55 kB)
Collecting contourpy>=1.0.1
  Using cached contourpy-1.0.7-cp310-cp310-win_amd64.whl (162 kB)
Collecting fonttools>=4.22.0
  Using cached fonttools-4.39.3-py3-none-any.whl (1.0 MB)
Collecting h11>=0.8
  Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Collecting click>=7.0
  Using cached click-8.1.3-py3-none-any.whl (96 kB)
Collecting anyio<5.0,>=3.0
  Using cached anyio-3.6.2-py3-none-any.whl (80 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
  Using cached pyrsistent-0.19.3-cp310-cp310-win_amd64.whl (62 kB)
Collecting uc-micro-py
  Using cached uc_micro_py-1.0.1-py3-none-any.whl (6.2 kB)
Requirement already satisfied: mpmath>=0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.2.1)
Building wheels for collected packages: peft
  Building wheel for peft (pyproject.toml) ... done
  Created wheel for peft: filename=peft-0.3.0.dev0-py3-none-any.whl size=55901 sha256=34e7d770a1a3c6aac05daa71b1dc641cbd9cd4ee8ea4a54496a8d1decb85912a
  Stored in directory: C:\AI\oobabooga\installer_files\pip-ephem-wheel-cache-w0tqagr2\wheels\4c\16\67\1002a2d4daa822eff130e6d85b90051b75d2ce0d26b9448e4a
Successfully built peft
Installing collected packages: tokenizers, sentencepiece, safetensors, pytz, pydub, pulp, ffmpy, xxhash, websockets, uc-micro-py, tzdata, toolz, sniffio, semantic-version, rwkv, regex, pyyaml, python-multipart, python-dateutil, pyrsistent, pyparsing, pydantic, pyarrow, psutil, Pillow, packaging, orjson, multidict, mdurl, markdown, llama-cpp-python, kiwisolver, h11, fsspec, frozenlist, fonttools, entrypoints, dill, cycler, contourpy, colorama, attrs, async-timeout, aiofiles, yarl, tqdm, responses, pandas, multiprocess, matplotlib, markdown-it-py, linkify-it-py, jsonschema, click, anyio, aiosignal, uvicorn, starlette, mdit-py-plugins, huggingface-hub, httpcore, altair, aiohttp, accelerate, transformers, httpx, fastapi, peft, gradio-client, flexgen, datasets, gradio
  Attempting uninstall: Pillow
    Found existing installation: Pillow 9.4.0
    Uninstalling Pillow-9.4.0:
      Successfully uninstalled Pillow-9.4.0
Successfully installed Pillow-9.5.0 accelerate-0.18.0 aiofiles-23.1.0 aiohttp-3.8.4 aiosignal-1.3.1 altair-4.2.2 anyio-3.6.2 async-timeout-4.0.2 attrs-23.1.0 click-8.1.3 colorama-0.4.6 contourpy-1.0.7 cycler-0.11.0 datasets-2.12.0 dill-0.3.6 entrypoints-0.4 fastapi-0.95.1 ffmpy-0.3.0 flexgen-0.1.7 fonttools-4.39.3 frozenlist-1.3.3 fsspec-2023.4.0 gradio-3.25.0 gradio-client-0.1.4 h11-0.14.0 httpcore-0.17.0 httpx-0.24.0 huggingface-hub-0.14.1 jsonschema-4.17.3 kiwisolver-1.4.4 linkify-it-py-2.0.0 llama-cpp-python-0.1.36 markdown-3.4.3 markdown-it-py-2.2.0 matplotlib-3.7.1 mdit-py-plugins-0.3.3 mdurl-0.1.2 multidict-6.0.4 multiprocess-0.70.14 orjson-3.8.11 packaging-23.1 pandas-2.0.1 peft-0.3.0.dev0 psutil-5.9.5 pulp-2.7.0 pyarrow-11.0.0 pydantic-1.10.7 pydub-0.25.1 pyparsing-3.0.9 pyrsistent-0.19.3 python-dateutil-2.8.2 python-multipart-0.0.6 pytz-2023.3 pyyaml-6.0 regex-2023.3.23 responses-0.18.0 rwkv-0.7.3 safetensors-0.3.0 semantic-version-2.10.0 sentencepiece-0.1.98 sniffio-1.3.0 starlette-0.26.1 tokenizers-0.13.3 toolz-0.12.0 tqdm-4.65.0 transformers-4.28.1 tzdata-2023.3 uc-micro-py-1.0.1 uvicorn-0.22.0 websockets-11.0.2 xxhash-3.2.0 yarl-1.9.2
Collecting flask_cloudflared==0.0.12
  Using cached flask_cloudflared-0.0.12-py3-none-any.whl (6.3 kB)
Requirement already satisfied: websockets==11.0.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 2)) (11.0.2)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.29.0)
Collecting Flask>=0.8
  Using cached Flask-2.3.1-py3-none-any.whl (96 kB)
Requirement already satisfied: click>=8.1.3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3)
Collecting Werkzeug>=2.3.0
  Using cached Werkzeug-2.3.2-py3-none-any.whl (242 kB)
Collecting blinker>=1.6.2
  Using cached blinker-1.6.2-py3-none-any.whl (13 kB)
Requirement already satisfied: Jinja2>=3.1.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2)
Collecting itsdangerous>=2.1.2
  Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from click>=8.1.3->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.1)
Installing collected packages: Werkzeug, itsdangerous, blinker, Flask, flask_cloudflared
Successfully installed Flask-2.3.1 Werkzeug-2.3.2 blinker-1.6.2 flask_cloudflared-0.0.12 itsdangerous-2.1.2
Collecting elevenlabslib
  Using cached elevenlabslib-0.5.3-py3-none-any.whl (18 kB)
Collecting soundfile
  Using cached soundfile-0.12.1-py2.py3-none-win_amd64.whl (1.0 MB)
Collecting sounddevice
  Using cached sounddevice-0.4.6-py3-none-win_amd64.whl (199 kB)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.3)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.29.0)
Collecting typing
  Using cached typing-3.7.4.3-py3-none-any.whl
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7)
Installing collected packages: typing, soundfile, sounddevice, elevenlabslib
Successfully installed elevenlabslib-0.5.3 sounddevice-0.4.6 soundfile-0.12.1 typing-3.7.4.3
Collecting deep-translator==1.9.2
  Using cached deep_translator-1.9.2-py3-none-any.whl (30 kB)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.29.0)
Collecting beautifulsoup4<5.0.0,>=4.9.1
  Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.4.1-py3-none-any.whl (36 kB)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.4)
Installing collected packages: soupsieve, beautifulsoup4, deep-translator
Successfully installed beautifulsoup4-4.12.2 deep-translator-1.9.2 soupsieve-2.4.1
Collecting ipython
  Using cached ipython-8.13.1-py3-none-any.whl (797 kB)
Collecting num2words
  Using cached num2words-0.5.12-py3-none-any.whl (125 kB)
Collecting omegaconf
  Using cached omegaconf-2.3.0-py3-none-any.whl (79 kB)
Requirement already satisfied: pydub in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6)
Collecting stack-data
  Using cached stack_data-0.6.2-py3-none-any.whl (24 kB)
Collecting matplotlib-inline
  Using cached matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB)
Collecting pygments>=2.4.0
  Using cached Pygments-2.15.1-py3-none-any.whl (1.1 MB)
Collecting pickleshare
  Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting jedi>=0.16
  Using cached jedi-0.18.2-py2.py3-none-any.whl (1.6 MB)
Collecting decorator
  Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting traitlets>=5
  Using cached traitlets-5.9.0-py3-none-any.whl (117 kB)
Collecting backcall
  Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30
  Using cached prompt_toolkit-3.0.38-py3-none-any.whl (385 kB)
Collecting docopt>=0.6.2
  Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting antlr4-python3-runtime==4.9.*
  Using cached antlr4_python3_runtime-4.9.3-py3-none-any.whl
Collecting parso<0.9.0,>=0.8.0
  Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)
Collecting wcwidth
  Using cached wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
Collecting asttokens>=2.1.0
  Using cached asttokens-2.2.1-py2.py3-none-any.whl (26 kB)
Collecting pure-eval
  Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting executing>=1.2.0
  Using cached executing-1.2.0-py2.py3-none-any.whl (24 kB)
Requirement already satisfied: six in c:\ai\oobabooga\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0)
Installing collected packages: wcwidth, pure-eval, pickleshare, executing, docopt, backcall, antlr4-python3-runtime, traitlets, pygments, prompt-toolkit, parso, omegaconf, num2words, decorator, asttokens, stack-data, matplotlib-inline, jedi, ipython
Successfully installed antlr4-python3-runtime-4.9.3 asttokens-2.2.1 backcall-0.2.0 decorator-5.1.1 docopt-0.6.2 executing-1.2.0 ipython-8.13.1 jedi-0.18.2 matplotlib-inline-0.1.6 num2words-0.5.12 omegaconf-2.3.0 parso-0.8.3 pickleshare-0.7.5 prompt-toolkit-3.0.38 pure-eval-0.2.2 pygments-2.15.1 stack-data-0.6.2 traitlets-5.9.0 wcwidth-0.2.6
Collecting git+https://github.com/Uberi/speech_recognition.git@010382b80267f0f7794169fccc8e875ee7da7c19 (from -r extensions\whisper_stt\requirements.txt (line 1))
  Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b80267f0f7794169fccc8e875ee7da7c19) to c:\ai\oobabooga\installer_files\pip-req-build-gqm4yu0j
  Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\AI\oobabooga\installer_files\pip-req-build-gqm4yu0j'
  Running command git rev-parse -q --verify 'sha^010382b80267f0f7794169fccc8e875ee7da7c19'
  Running command git fetch -q https://github.com/Uberi/speech_recognition.git 010382b80267f0f7794169fccc8e875ee7da7c19
  Running command git checkout -q 010382b80267f0f7794169fccc8e875ee7da7c19
  Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b80267f0f7794169fccc8e875ee7da7c19
  Preparing metadata (setup.py) ... done
Collecting openai-whisper
  Using cached openai_whisper-20230314-py3-none-any.whl
Requirement already satisfied: soundfile in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1)
Collecting ffmpeg
  Using cached ffmpeg-1.4-py3-none-any.whl
Requirement already satisfied: requests>=2.26.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.29.0)
Collecting tiktoken==0.3.1
  Using cached tiktoken-0.3.1-cp310-cp310-win_amd64.whl (581 kB)
Collecting numba
  Using cached numba-0.56.4-cp310-cp310-win_amd64.whl (2.5 MB)
Requirement already satisfied: torch in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.3)
Collecting more-itertools
  Using cached more_itertools-9.1.0-py3-none-any.whl (54 kB)
Requirement already satisfied: tqdm in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0)
Collecting ffmpeg-python==0.2.0
  Using cached ffmpeg_python-0.2.0-py3-none-any.whl (25 kB)
Collecting future
  Using cached future-0.18.3-py3-none-any.whl
Requirement already satisfied: regex>=2022.1.18 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23)
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15)
Collecting llvmlite<0.40,>=0.39.0dev0
  Using cached llvmlite-0.39.1-cp310-cp310-win_amd64.whl (23.2 MB)
Collecting numpy
  Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
Requirement already satisfied: setuptools in c:\ai\oobabooga\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (66.0.0)
Requirement already satisfied: filelock in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.9.0)
Requirement already satisfied: typing-extensions in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: sympy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.8.4)
Requirement already satisfied: jinja2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from jinja2->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.1.1)
Requirement already satisfied: mpmath>=0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from sympy->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.2.1)
Building wheels for collected packages: SpeechRecognition
  Building wheel for SpeechRecognition (setup.py) ... done
  Created wheel for SpeechRecognition: filename=SpeechRecognition-3.9.0-py2.py3-none-any.whl size=32839782 sha256=388a75770165b5c097f8395eed8fb455805a8e3d09276638383fb9d8c06faf82
  Stored in directory: c:\users\bissop\appdata\local\pip\cache\wheels\0b\1a\30\6c60550fbf4a28521e10e90da86fe84ac713246235b33de004
Successfully built SpeechRecognition
Installing collected packages: ffmpeg, numpy, more-itertools, llvmlite, future, tiktoken, SpeechRecognition, numba, ffmpeg-python, openai-whisper
  Attempting uninstall: numpy
    Found existing installation: numpy 1.24.3
    Uninstalling numpy-1.24.3:
      Successfully uninstalled numpy-1.24.3
Successfully installed SpeechRecognition-3.9.0 ffmpeg-1.4 ffmpeg-python-0.2.0 future-0.18.3 llvmlite-0.39.1 more-itertools-9.1.0 numba-0.56.4 numpy-1.23.5 openai-whisper-20230314 tiktoken-0.3.1
Cloning into 'GPTQ-for-LLaMa'...
remote: Enumerating objects: 814, done.
remote: Total 814 (delta 0), reused 0 (delta 0), pack-reused 814Receiving objects:  98% (798/814)
Receiving objects: 100% (814/814), 473.43 KiB | 2.37 MiB/s, done.
Resolving deltas: 100% (490/490), done.
Already up to date.
Requirement already satisfied: safetensors==0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.3.0)
Collecting datasets==2.10.1
  Using cached datasets-2.10.1-py3-none-any.whl (469 kB)
Requirement already satisfied: sentencepiece in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (0.1.98)
Collecting transformers==4.28.0
  Using cached transformers-4.28.0-py3-none-any.whl (7.0 MB)
Requirement already satisfied: accelerate==0.18.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.18.0)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.3.6)
Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2023.4.0)
Requirement already satisfied: numpy>=1.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (1.23.5)
Requirement already satisfied: xxhash in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.2.0)
Requirement already satisfied: requests>=2.19.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.29.0)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.14.1)
Requirement already satisfied: packaging in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (23.1)
Requirement already satisfied: multiprocess in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.70.14)
Requirement already satisfied: pyarrow>=6.0.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (11.0.0)
Requirement already satisfied: pandas in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: pyyaml>=5.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (6.0)
Requirement already satisfied: tqdm>=4.62.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: aiohttp in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.8.4)
Requirement already satisfied: responses<0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.18.0)
Requirement already satisfied: filelock in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (3.9.0)
Requirement already satisfied: regex!=2019.12.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (2023.3.23)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (0.13.3)
Requirement already satisfied: torch>=1.4.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: psutil in c:\ai\oobabooga\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (5.9.5)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (4.0.2)
Requirement already satisfied: frozenlist>=1.1.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.3)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (2.0.4)
Requirement already satisfied: attrs>=17.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (23.1.0)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.9.2)
Requirement already satisfied: aiosignal>=1.1.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets==2.10.1->-r requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (3.4)
Requirement already satisfied: sympy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.11.1)
Requirement already satisfied: networkx in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (2.8.4)
Requirement already satisfied: jinja2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (3.1.2)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from tqdm>=4.62.1->datasets==2.10.1->-r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: pytz>=2020.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2.8.2)
Requirement already satisfied: tzdata>=2022.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: six>=1.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->datasets==2.10.1->-r requirements.txt (line 2)) (1.16.0)
Requirement already satisfied: MarkupSafe>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from jinja2->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (2.1.1)
Requirement already satisfied: mpmath>=0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.2.1)
Installing collected packages: transformers, datasets
  Attempting uninstall: transformers
    Found existing installation: transformers 4.28.1
    Uninstalling transformers-4.28.1:
      Successfully uninstalled transformers-4.28.1
  Attempting uninstall: datasets
    Found existing installation: datasets 2.12.0
    Uninstalling datasets-2.12.0:
      Successfully uninstalled datasets-2.12.0
Successfully installed datasets-2.10.1 transformers-4.28.0
Processing c:\ai\oobabooga\text-generation-webui\repositories\gptq-for-llama
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: quant-cuda
  Building wheel for quant-cuda (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [50 lines of output]
      running bdist_wheel
      running build
      running build_ext
      C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
        warnings.warn(f'Error checking compiler version for {compiler}: {error}')
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
          setup(
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
          return run_commands(dist)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
          dist.run_commands()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
          self.run_command(cmd)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\wheel\bdist_wheel.py", line 325, in run
          self.run_command("build")
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
          self.run_command(cmd_name)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
          _build_ext.run(self)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
          self.build_extensions()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 387, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for quant-cuda
  Running setup.py clean for quant-cuda
Failed to build quant-cuda
Installing collected packages: quant-cuda
  Running setup.py install for quant-cuda ... error
  error: subprocess-exited-with-error

  × Running setup.py install for quant-cuda did not run successfully.
  │ exit code: 1
  ╰─> [54 lines of output]
      running install
      C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
        warnings.warn(
      running build
      running build_ext
      C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
        warnings.warn(f'Error checking compiler version for {compiler}: {error}')
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
          setup(
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
          return run_commands(dist)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
          dist.run_commands()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
          self.run_command(cmd)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 68, in run
          return orig.install.run(self)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\install.py", line 698, in run
          self.run_command('build')
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
          self.run_command(cmd_name)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
          _build_ext.run(self)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
          self.build_extensions()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 387, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> quant-cuda

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
ERROR: GPTQ CUDA kernel compilation failed.
Attempting installation with wheel.
Collecting quant-cuda==0.0.0
  Using cached https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl (398 kB)
Installing collected packages: quant-cuda
Successfully installed quant-cuda-0.0.0
Wheel installation success!
Continuing with install..
Select the model that you want to download:

A) OPT 6.7B
B) OPT 2.7B
C) OPT 1.3B
D) OPT 350M
E) GALACTICA 6.7B
F) GALACTICA 1.3B
G) GALACTICA 125M
H) Pythia-6.9B-deduped
I) Pythia-2.8B-deduped
J) Pythia-1.4B-deduped
K) Pythia-410M-deduped
L) Manually specify a Hugging Face model
M) Do not download a model

Input>
xNul commented 1 year ago

@pyGisServer even though the compilation didn't work, it says the alternative install worked

Attempting installation with wheel. Wheel installation success!

Can you verify this by going to installer_files/env/Lib/site-packages and verifying that there is a folder which starts with quant_cuda?

pyGisServer commented 1 year ago

@xNul I checked the path and there is a folder called quant_cuda-0.0.0.dist-info and a file quant_cuda.cp310-win_amd64.pyd. But I guess something is still wrong because when I try to run update.bat I also get this error at the end of it all:

Already up to date.
Collecting git+https://github.com/huggingface/peft (from -r requirements.txt (line 16))
  Cloning https://github.com/huggingface/peft to c:\ai\oobabooga\installer_files\pip-req-build-2rb165ha
  Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft 'C:\AI\oobabooga\installer_files\pip-req-build-2rb165ha'
  Resolved https://github.com/huggingface/peft to commit 632997d1fb776c3cf05d8c2537ac9a98a7ce9435
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system != "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system != "Windows"' don't match your environment
Collecting llama-cpp-python==0.1.36
  Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.36/llama_cpp_python-0.1.36-cp310-cp310-win_amd64.whl (128 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.7/128.7 kB 1.3 MB/s eta 0:00:00
Requirement already satisfied: accelerate==0.18.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.18.0)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: datasets in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (2.10.1)
Collecting datasets
  Using cached datasets-2.12.0-py3-none-any.whl (474 kB)
Requirement already satisfied: flexgen==0.1.7 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (0.1.7)
Requirement already satisfied: gradio==3.25.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (3.25.0)
Requirement already satisfied: markdown in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 6)) (3.4.3)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (1.23.5)
Collecting numpy
  Using cached numpy-1.24.3-cp310-cp310-win_amd64.whl (14.8 MB)
Requirement already satisfied: pandas in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 8)) (2.0.1)
Requirement already satisfied: Pillow>=9.5.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 9)) (9.5.0)
Requirement already satisfied: pyyaml in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 10)) (6.0)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (2.29.0)
Requirement already satisfied: rwkv==0.7.3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 12)) (0.7.3)
Requirement already satisfied: safetensors==0.3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 13)) (0.3.0)
Requirement already satisfied: sentencepiece in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 14)) (0.1.98)
Requirement already satisfied: tqdm in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 15)) (4.65.0)
Collecting transformers==4.28.1
  Using cached transformers-4.28.1-py3-none-any.whl (7.0 MB)
Requirement already satisfied: packaging>=20.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (23.1)
Requirement already satisfied: psutil in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (5.9.4)
Requirement already satisfied: torch>=1.4.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (1.13.1+cu117)
Requirement already satisfied: pulp in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (2.7.0)
Requirement already satisfied: attrs in c:\users\bissop\appdata\roaming\python\python310\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (23.1.0)
Requirement already satisfied: markupsafe in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.1.2)
Requirement already satisfied: semantic-version in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.10.0)
Requirement already satisfied: gradio-client>=0.0.8 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.1.4)
Requirement already satisfied: huggingface-hub>=0.13.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.13.4)
Requirement already satisfied: typing-extensions in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (4.5.0)
Requirement already satisfied: uvicorn in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.21.1)
Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.2.0)
Requirement already satisfied: aiofiles in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (23.1.0)
Requirement already satisfied: orjson in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.8.10)
Requirement already satisfied: pydantic in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (1.10.7)
Requirement already satisfied: altair>=4.2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (4.2.2)
Requirement already satisfied: websockets>=10.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (11.0.2)
Requirement already satisfied: mdit-py-plugins<=0.3.3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.3.3)
Requirement already satisfied: pydub in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.25.1)
Requirement already satisfied: jinja2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.1.2)
Requirement already satisfied: ffmpy in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.3.0)
Requirement already satisfied: matplotlib in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.7.1)
Requirement already satisfied: aiohttp in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.8.4)
Requirement already satisfied: httpx in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.24.0)
Requirement already satisfied: python-multipart in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.0.6)
Requirement already satisfied: fastapi in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.94.0)
Requirement already satisfied: tokenizers>=0.13.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from rwkv==0.7.3->-r requirements.txt (line 12)) (0.13.3)
Requirement already satisfied: filelock in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.1->-r requirements.txt (line 17)) (3.11.0)
Requirement already satisfied: regex!=2019.12.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.1->-r requirements.txt (line 17)) (2023.3.23)
Requirement already satisfied: pyarrow>=8.0.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (11.0.0)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.3.6)
Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets->-r requirements.txt (line 3)) (2023.4.0)
Requirement already satisfied: responses<0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.18.0)
Requirement already satisfied: xxhash in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (3.2.0)
Requirement already satisfied: multiprocess in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.70.14)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->-r requirements.txt (line 8)) (2.8.2)
Requirement already satisfied: tzdata>=2022.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->-r requirements.txt (line 8)) (2023.3)
Requirement already satisfied: pytz>=2020.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->-r requirements.txt (line 8)) (2023.3)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (1.26.15)
Requirement already satisfied: jsonschema>=3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (4.17.3)
Requirement already satisfied: toolz in c:\users\bissop\appdata\roaming\python\python310\site-packages (from altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.12.0)
Requirement already satisfied: entrypoints in c:\users\bissop\appdata\roaming\python\python310\site-packages (from altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (4.0.2)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (1.3.1)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (1.8.2)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (1.3.3)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (6.0.4)
Requirement already satisfied: mdurl~=0.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.1.2)
Requirement already satisfied: linkify-it-py<3,>=1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.25.0->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: six>=1.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 8)) (1.16.0)
Requirement already satisfied: starlette<0.27.0,>=0.26.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from fastapi->gradio==3.25.0->-r requirements.txt (line 5)) (0.26.1)
Requirement already satisfied: sniffio in c:\users\bissop\appdata\roaming\python\python310\site-packages (from httpx->gradio==3.25.0->-r requirements.txt (line 5)) (1.3.0)
Requirement already satisfied: httpcore<0.18.0,>=0.15.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from httpx->gradio==3.25.0->-r requirements.txt (line 5)) (0.15.0)
Requirement already satisfied: contourpy>=1.0.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (1.0.7)
Requirement already satisfied: fonttools>=4.22.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (4.39.3)
Requirement already satisfied: pyparsing>=2.3.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (3.0.9)
Requirement already satisfied: cycler>=0.10 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (0.11.0)
Requirement already satisfied: kiwisolver>=1.0.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (1.4.4)
Requirement already satisfied: click>=7.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from uvicorn->gradio==3.25.0->-r requirements.txt (line 5)) (8.1.3)
Requirement already satisfied: h11>=0.8 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from uvicorn->gradio==3.25.0->-r requirements.txt (line 5)) (0.12.0)
Requirement already satisfied: anyio==3.* in c:\users\bissop\appdata\roaming\python\python310\site-packages (from httpcore<0.18.0,>=0.15.0->httpx->gradio==3.25.0->-r requirements.txt (line 5)) (3.6.2)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.19.3)
Requirement already satisfied: uc-micro-py in c:\users\bissop\appdata\roaming\python\python310\site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.25.0->-r requirements.txt (line 5)) (1.0.1)
Installing collected packages: numpy, transformers, datasets
  Attempting uninstall: numpy
    Found existing installation: numpy 1.23.5
    Uninstalling numpy-1.23.5:
      Successfully uninstalled numpy-1.23.5
  Attempting uninstall: transformers
    Found existing installation: transformers 4.28.0
    Uninstalling transformers-4.28.0:
      Successfully uninstalled transformers-4.28.0
  Attempting uninstall: datasets
    Found existing installation: datasets 2.10.1
    Uninstalling datasets-2.10.1:
      Successfully uninstalled datasets-2.10.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed.
numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.3 which is incompatible.
clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.29.0 which is incompatible.
Successfully installed datasets-2.12.0 numpy-1.24.3 transformers-4.28.1
Requirement already satisfied: flask_cloudflared==0.0.12 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: websockets==11.0.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 2)) (11.0.2)
Requirement already satisfied: Flask>=0.8 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.3.1)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: Werkzeug>=2.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.3.2)
Requirement already satisfied: blinker>=1.6.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.6.2)
Requirement already satisfied: click>=8.1.3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: Jinja2>=3.1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.10)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from click>=8.1.3->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: elevenlabslib in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.6.0)
Requirement already satisfied: soundfile in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 2)) (0.12.1)
Requirement already satisfied: sounddevice in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 3)) (0.4.6)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: typing in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.7.4.3)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.3)
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: deep-translator==1.9.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\google_translate\requirements.txt (line 1)) (1.9.2)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (4.12.2)
Requirement already satisfied: soupsieve>1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.4.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.10)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: ipython in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 1)) (8.13.1)
Requirement already satisfied: num2words in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 2)) (0.5.12)
Requirement already satisfied: omegaconf in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 3)) (2.3.0)
Requirement already satisfied: pydub in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0)
Requirement already satisfied: traitlets>=5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: backcall in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: pygments>=2.4.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.15.1)
Requirement already satisfied: matplotlib-inline in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: jedi>=0.16 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: stack-data in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: pickleshare in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: docopt>=0.6.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from num2words->-r extensions\silero_tts\requirements.txt (line 2)) (0.6.2)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in c:\users\bissop\appdata\roaming\python\python310\site-packages (from omegaconf->-r extensions\silero_tts\requirements.txt (line 3)) (4.9.3)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from jedi>=0.16->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: wcwidth in c:\users\bissop\appdata\roaming\python\python310\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: asttokens>=2.1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: executing>=1.2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: pure-eval in c:\ai\oobabooga\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six in c:\users\bissop\appdata\roaming\python\python310\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0)
Collecting git+https://github.com/Uberi/speech_recognition.git@010382b80267f0f7794169fccc8e875ee7da7c19 (from -r extensions\whisper_stt\requirements.txt (line 1))
  Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b80267f0f7794169fccc8e875ee7da7c19) to c:\ai\oobabooga\installer_files\pip-req-build-et96lr96
  Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\AI\oobabooga\installer_files\pip-req-build-et96lr96'
  Running command git rev-parse -q --verify 'sha^010382b80267f0f7794169fccc8e875ee7da7c19'
  Running command git fetch -q https://github.com/Uberi/speech_recognition.git 010382b80267f0f7794169fccc8e875ee7da7c19
  Running command git checkout -q 010382b80267f0f7794169fccc8e875ee7da7c19
  Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b80267f0f7794169fccc8e875ee7da7c19
  Preparing metadata (setup.py) ... done
Requirement already satisfied: openai-whisper in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 2)) (20230314)
Requirement already satisfied: soundfile in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1)
Requirement already satisfied: ffmpeg in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 4)) (1.4)
Requirement already satisfied: requests>=2.26.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: tqdm in c:\users\bissop\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: numba in c:\users\bissop\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.56.4)
Requirement already satisfied: torch in c:\users\bissop\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.13.1+cu117)
Requirement already satisfied: more-itertools in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (9.1.0)
Requirement already satisfied: tiktoken==0.3.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.3.1)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.3)
Requirement already satisfied: ffmpeg-python==0.2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.2.0)
Requirement already satisfied: future in c:\users\bissop\appdata\roaming\python\python310\site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.18.3)
Requirement already satisfied: regex>=2022.1.18 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23)
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.10)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.39.1)
Collecting numpy
  Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
Requirement already satisfied: setuptools in c:\ai\oobabooga\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (66.0.0)
Requirement already satisfied: typing-extensions in c:\users\bissop\appdata\roaming\python\python310\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6)
Installing collected packages: numpy
  Attempting uninstall: numpy
    Found existing installation: numpy 1.24.3
    Uninstalling numpy-1.24.3:
      Successfully uninstalled numpy-1.24.3
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed.
clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.29.0 which is incompatible.
Successfully installed numpy-1.23.5
Cloning into 'GPTQ-for-LLaMa'...
remote: Enumerating objects: 814, done.
remote: Counting objects: 100% (814/814), done.
remote: Compressing objects: 100% (320/320), done.
Receiving objects:  91% (741/814): Total 814 (delta 495), reused 793 (delta 489), pack-reused 0
Receiving objects: 100% (814/814), 468.18 KiB | 2.87 MiB/s, done.
Resolving deltas: 100% (495/495), done.
Already up to date.
Requirement already satisfied: safetensors==0.3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 1)) (0.3.0)
Collecting datasets==2.10.1
  Using cached datasets-2.10.1-py3-none-any.whl (469 kB)
Requirement already satisfied: sentencepiece in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 3)) (0.1.98)
Collecting transformers==4.28.0
  Using cached transformers-4.28.0-py3-none-any.whl (7.0 MB)
Requirement already satisfied: accelerate==0.18.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.18.0)
Requirement already satisfied: aiohttp in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.8.4)
Requirement already satisfied: multiprocess in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.70.14)
Requirement already satisfied: numpy>=1.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (1.23.5)
Requirement already satisfied: xxhash in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.2.0)
Requirement already satisfied: responses<0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.18.0)
Requirement already satisfied: pyarrow>=6.0.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (11.0.0)
Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2023.4.0)
Requirement already satisfied: packaging in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (23.1)
Requirement already satisfied: pyyaml>=5.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (6.0)
Requirement already satisfied: requests>=2.19.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.29.0)
Requirement already satisfied: tqdm>=4.62.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.13.4)
Requirement already satisfied: pandas in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.3.6)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (0.13.3)
Requirement already satisfied: filelock in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (3.11.0)
Requirement already satisfied: regex!=2019.12.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (2023.3.23)
Requirement already satisfied: psutil in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (5.9.4)
Requirement already satisfied: torch>=1.4.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (1.13.1+cu117)
Requirement already satisfied: attrs>=17.3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (3.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (4.0.2)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.8.2)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.1)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.3)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets==2.10.1->-r requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2.10)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (1.26.15)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from tqdm>=4.62.1->datasets==2.10.1->-r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: tzdata>=2022.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: six>=1.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from python-dateutil>=2.8.2->pandas->datasets==2.10.1->-r requirements.txt (line 2)) (1.16.0)
Installing collected packages: transformers, datasets
  Attempting uninstall: transformers
    Found existing installation: transformers 4.28.1
    Uninstalling transformers-4.28.1:
      Successfully uninstalled transformers-4.28.1
  Attempting uninstall: datasets
    Found existing installation: datasets 2.12.0
    Uninstalling datasets-2.12.0:
      Successfully uninstalled datasets-2.12.0
Successfully installed datasets-2.10.1 transformers-4.28.0
Processing c:\ai\oobabooga\text-generation-webui\repositories\gptq-for-llama
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: quant-cuda
  Building wheel for quant-cuda (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [50 lines of output]
      running bdist_wheel
      running build
      running build_ext
      C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
        warnings.warn(f'Error checking compiler version for {compiler}: {error}')
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
          setup(
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
          return run_commands(dist)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
          dist.run_commands()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
          self.run_command(cmd)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\wheel\bdist_wheel.py", line 343, in run
          self.run_command("build")
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
          self.run_command(cmd_name)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
          _build_ext.run(self)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
          self.build_extensions()
        File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 386, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for quant-cuda
  Running setup.py clean for quant-cuda
Failed to build quant-cuda
Installing collected packages: quant-cuda
  Attempting uninstall: quant-cuda
    Found existing installation: quant-cuda 0.0.0
    Uninstalling quant-cuda-0.0.0:
      Successfully uninstalled quant-cuda-0.0.0
  Running setup.py install for quant-cuda ... error
  error: subprocess-exited-with-error

  × Running setup.py install for quant-cuda did not run successfully.
  │ exit code: 1
  ╰─> [54 lines of output]
      running install
      C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
        warnings.warn(
      running build
      running build_ext
      C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
        warnings.warn(f'Error checking compiler version for {compiler}: {error}')
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
          setup(
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
          return run_commands(dist)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
          dist.run_commands()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
          self.run_command(cmd)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 68, in run
          return orig.install.run(self)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\install.py", line 698, in run
          self.run_command('build')
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
          self.run_command(cmd_name)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
          self.distribution.run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
          super().run_command(command)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
          cmd_obj.run()
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
          _build_ext.run(self)
        File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
          self.build_extensions()
        File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
          _check_cuda_version(compiler_name, compiler_version)
        File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 386, in _check_cuda_version
          raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
      RuntimeError:
      The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  Rolling back uninstall of quant-cuda
  Moving to c:\ai\oobabooga\installer_files\env\lib\site-packages\quant_cuda-0.0.0.dist-info\
   from C:\AI\oobabooga\installer_files\env\Lib\site-packages\~uant_cuda-0.0.0.dist-info
  Moving to c:\ai\oobabooga\installer_files\env\lib\site-packages\quant_cuda.cp310-win_amd64.pyd
   from C:\AI\oobabooga\installer_files\pip-uninstall-ivttdq8a\quant_cuda.cp310-win_amd64.pyd
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> quant-cuda

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

Done!
xNul commented 1 year ago

@pyGisServer no worries about that. It will try to recompile every time you update and since there's a problem with compilation, it fails every time, but the wheel is still installed. Let's try running a model to verify that it works properly.

Let's use the model https://huggingface.co/wcde/llama-7b-4bit-gr128 to check. You can enter it after pressing the L option during installation or by opening cmd_windows.bat, using cd text-generation-webui, and then using python download-model.py

github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.