Closed pyGisServer closed 1 year ago
The compilation of that library failed, but the wheel installation succeeded so you should be good to go. To fix the error anyway, we have some info in https://github.com/oobabooga/text-generation-webui/issues/1456.
The other couple dependency conflicts shouldn't be an issue, but if they turn out to be, you can try using my newest version of the one-click installers which may fix them.
The compilation of that library failed, but the wheel installation succeeded so you should be good to go. To fix the error anyway, we have some info in oobabooga/text-generation-webui#1456.
The other couple dependency conflicts shouldn't be an issue, but if they turn out to be, you can try using my newest version of the one-click installers which may fix them.
I tried using your installer but I get exactly the same errors. The problem is that it does not allow me to use any quantized model and if I try to run python setup_cuda.py install
I also receive cuda errors.
Gotcha, then try applying the fix in https://github.com/oobabooga/text-generation-webui/issues/1456. That has worked for other people.
Gotcha, then try applying the fix in oobabooga/text-generation-webui#1456. That has worked for other people.
I have followed the advice, but I have not been able to solve it. I think it could be due to a conflict with another conda installation on the system.
If you tried to set the CUDA_PATH
and it didn't work then, try installing using the latest version of the one-click installer that I have here https://github.com/xNul/one-click-installers It's been updated since you last tried it.
If that still doesn't work, please send your full install log so I can try to pinpoint the source of the problem.
I tried again to install it with your latest version, the problems with PIP seem to have been resolved, but it still keeps giving error with CUDA.
Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.1.0-1-Windows-x86_64.exe to C:\AI\oobabooga\installer_files\miniconda_installer.exe
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 53.1M 100 53.1M 0 0 58.6M 0 --:--:-- --:--:-- --:--:-- 58.6M
Installing Miniconda to C:\AI\oobabooga\installer_files\conda
Miniconda version:
conda 22.11.1
Packages to install:
Collecting package metadata (current_repodata.json): done
Solving environment: done
## Package Plan ##
environment location: C:\AI\oobabooga\installer_files\env
added / updated specs:
- python=3.10
The following packages will be downloaded:
package | build
---------------------------|-----------------
openssl-1.1.1t | h2bbff1b_0 5.5 MB
pip-23.0.1 | py310haa95532_0 2.8 MB
python-3.10.11 | h966fe2a_2 15.8 MB
setuptools-66.0.0 | py310haa95532_0 1.2 MB
sqlite-3.41.2 | h2bbff1b_0 894 KB
tzdata-2023c | h04d1e81_0 116 KB
wheel-0.38.4 | py310haa95532_0 83 KB
------------------------------------------------------------
Total: 26.3 MB
The following NEW packages will be INSTALLED:
bzip2 pkgs/main/win-64::bzip2-1.0.8-he774522_0
ca-certificates pkgs/main/win-64::ca-certificates-2023.01.10-haa95532_0
libffi pkgs/main/win-64::libffi-3.4.2-hd77b12b_6
openssl pkgs/main/win-64::openssl-1.1.1t-h2bbff1b_0
pip pkgs/main/win-64::pip-23.0.1-py310haa95532_0
python pkgs/main/win-64::python-3.10.11-h966fe2a_2
setuptools pkgs/main/win-64::setuptools-66.0.0-py310haa95532_0
sqlite pkgs/main/win-64::sqlite-3.41.2-h2bbff1b_0
tk pkgs/main/win-64::tk-8.6.12-h2bbff1b_0
tzdata pkgs/main/noarch::tzdata-2023c-h04d1e81_0
vc pkgs/main/win-64::vc-14.2-h21ff451_1
vs2015_runtime pkgs/main/win-64::vs2015_runtime-14.27.29016-h5e58377_2
wheel pkgs/main/win-64::wheel-0.38.4-py310haa95532_0
xz pkgs/main/win-64::xz-5.2.10-h8cc25b3_1
zlib pkgs/main/win-64::zlib-1.2.13-h8cc25b3_0
Downloading and Extracting Packages
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate C:\AI\oobabooga\installer_files\env
#
# To deactivate an active environment, use
#
# $ conda deactivate
What is your GPU
A) NVIDIA
B) AMD
C) Apple M Series
D) None (I want to run in CPU mode)
Input> a
Collecting package metadata (current_repodata.json): done
Solving environment: done
==> WARNING: A newer version of conda exists. <==
current version: 23.1.0
latest version: 23.3.1
Please update conda by running
$ conda update -n base -c defaults conda
Or to minimize the number of packages updated during conda update use
conda install conda=23.3.1
## Package Plan ##
environment location: C:\AI\oobabooga\installer_files\env
added / updated specs:
- cuda-toolkit
- git
- ninja
- pytorch-cuda=11.7
- pytorch==2[build=py3.10_cuda11.7*]
- torchaudio
- torchvision
The following packages will be downloaded:
package | build
---------------------------|-----------------
blas-1.0 | mkl 6 KB
cryptography-39.0.1 | py310h21b164f_0 1.0 MB
cuda-cccl-12.1.109 | 0 1.2 MB nvidia
cuda-command-line-tools-11.7.0| 0 1 KB nvidia/label/cuda-11.7.0
cuda-compiler-12.1.1 | 0 2 KB nvidia
cuda-cudart-11.7.60 | 0 1.4 MB nvidia/label/cuda-11.7.0
cuda-cudart-dev-11.7.60 | 0 695 KB nvidia/label/cuda-11.7.0
cuda-cuobjdump-12.1.111 | 0 3.7 MB nvidia
cuda-cupti-11.7.50 | 0 10.2 MB nvidia/label/cuda-11.7.0
cuda-cuxxfilt-12.1.105 | 0 163 KB nvidia
cuda-documentation-12.1.105| 0 89 KB nvidia
cuda-libraries-11.7.0 | 0 1 KB nvidia/label/cuda-11.7.0
cuda-libraries-dev-11.7.0 | 0 1 KB nvidia/label/cuda-11.7.0
cuda-memcheck-11.8.86 | 0 183 KB nvidia
cuda-nsight-compute-12.1.1 | 0 2 KB nvidia
cuda-nvcc-12.1.105 | 0 55.3 MB nvidia
cuda-nvdisasm-12.1.105 | 0 48.0 MB nvidia
cuda-nvml-dev-12.1.105 | 0 88 KB nvidia
cuda-nvprof-12.1.105 | 0 1.6 MB nvidia
cuda-nvprune-12.1.105 | 0 150 KB nvidia
cuda-nvrtc-11.7.50 | 0 71.9 MB nvidia/label/cuda-11.7.0
cuda-nvrtc-dev-11.7.50 | 0 14.3 MB nvidia/label/cuda-11.7.0
cuda-nvtx-11.7.50 | 0 43 KB nvidia/label/cuda-11.7.0
cuda-nvvp-12.1.105 | 0 113.6 MB nvidia
cuda-runtime-11.7.0 | 0 1 KB nvidia/label/cuda-11.7.0
cuda-sanitizer-api-12.1.105| 0 12.9 MB nvidia
cuda-toolkit-11.7.0 | 0 1 KB nvidia/label/cuda-11.7.0
cuda-tools-11.7.0 | 0 1 KB nvidia/label/cuda-11.7.0
cuda-visual-tools-11.7.0 | 0 1 KB nvidia/label/cuda-11.7.0
filelock-3.9.0 | py310haa95532_0 19 KB
freetype-2.12.1 | ha860e81_0 490 KB
giflib-5.2.1 | h8cc25b3_3 88 KB
git-2.34.1 | haa95532_0 50.4 MB
intel-openmp-2021.4.0 | haa95532_3556 2.2 MB
jinja2-3.1.2 | py310haa95532_0 215 KB
jpeg-9e | h2bbff1b_1 320 KB
lerc-3.0 | hd77b12b_0 120 KB
libcublas-11.10.1.25 | 0 24 KB nvidia/label/cuda-11.7.0
libcublas-dev-11.10.1.25 | 0 286.3 MB nvidia/label/cuda-11.7.0
libcufft-10.7.2.50 | 0 6 KB nvidia/label/cuda-11.7.0
libcufft-dev-10.7.2.50 | 0 249.8 MB nvidia/label/cuda-11.7.0
libcurand-10.3.2.106 | 0 3 KB nvidia
libcurand-dev-10.3.2.106 | 0 50.0 MB nvidia
libcusolver-11.3.5.50 | 0 29 KB nvidia/label/cuda-11.7.0
libcusolver-dev-11.3.5.50 | 0 86.6 MB nvidia/label/cuda-11.7.0
libcusparse-11.7.3.50 | 0 13 KB nvidia/label/cuda-11.7.0
libcusparse-dev-11.7.3.50 | 0 147.6 MB nvidia/label/cuda-11.7.0
libdeflate-1.17 | h2bbff1b_0 151 KB
libnpp-11.7.3.21 | 0 286 KB nvidia/label/cuda-11.7.0
libnpp-dev-11.7.3.21 | 0 114.3 MB nvidia/label/cuda-11.7.0
libnvjpeg-11.7.2.34 | 0 4 KB nvidia/label/cuda-11.7.0
libnvjpeg-dev-11.7.2.34 | 0 1.8 MB nvidia/label/cuda-11.7.0
libpng-1.6.39 | h8cc25b3_0 369 KB
libtiff-4.5.0 | h6c2663c_2 1.2 MB
libuv-1.44.2 | h2bbff1b_0 288 KB
libwebp-1.2.4 | hbc33d0d_1 73 KB
libwebp-base-1.2.4 | h2bbff1b_1 304 KB
lz4-c-1.9.4 | h2bbff1b_0 143 KB
markupsafe-2.1.1 | py310h2bbff1b_0 26 KB
mkl-2021.4.0 | haa95532_640 114.9 MB
mkl-service-2.4.0 | py310h2bbff1b_0 48 KB
mkl_fft-1.3.1 | py310ha0764ea_0 136 KB
mkl_random-1.2.2 | py310h4ed8f06_0 221 KB
mpmath-1.2.1 | py310haa95532_0 779 KB
networkx-2.8.4 | py310haa95532_1 2.6 MB
ninja-1.10.2 | haa95532_5 14 KB
ninja-base-1.10.2 | h6d14046_5 255 KB
nsight-compute-2023.1.1.4 | 0 602.4 MB nvidia
numpy-1.24.3 | py310hdc03b94_0 11 KB
numpy-base-1.24.3 | py310h3caf3d7_0 6.1 MB
pillow-9.4.0 | py310hd77b12b_0 1007 KB
pyopenssl-23.0.0 | py310haa95532_0 98 KB
pytorch-2.0.0 |py3.10_cuda11.7_cudnn8_0 1.17 GB pytorch
pytorch-cuda-11.7 | h16d0643_3 7 KB pytorch
pytorch-mutex-1.0 | cuda 3 KB pytorch
requests-2.29.0 | py310haa95532_0 98 KB
sympy-1.11.1 | py310haa95532_0 11.8 MB
torchaudio-2.0.0 | py310_cu117 5.7 MB pytorch
torchvision-0.15.0 | py310_cu117 7.7 MB pytorch
typing_extensions-4.5.0 | py310haa95532_0 49 KB
urllib3-1.26.15 | py310haa95532_0 195 KB
zstd-1.5.5 | hd43e919_0 682 KB
------------------------------------------------------------
Total: 3.20 GB
The following NEW packages will be INSTALLED:
blas pkgs/main/win-64::blas-1.0-mkl
brotlipy pkgs/main/win-64::brotlipy-0.7.0-py310h2bbff1b_1002
certifi pkgs/main/win-64::certifi-2022.12.7-py310haa95532_0
cffi pkgs/main/win-64::cffi-1.15.1-py310h2bbff1b_3
charset-normalizer pkgs/main/noarch::charset-normalizer-2.0.4-pyhd3eb1b0_0
cryptography pkgs/main/win-64::cryptography-39.0.1-py310h21b164f_0
cuda-cccl nvidia/win-64::cuda-cccl-12.1.109-0
cuda-command-line~ nvidia/label/cuda-11.7.0/win-64::cuda-command-line-tools-11.7.0-0
cuda-compiler nvidia/win-64::cuda-compiler-12.1.1-0
cuda-cudart nvidia/label/cuda-11.7.0/win-64::cuda-cudart-11.7.60-0
cuda-cudart-dev nvidia/label/cuda-11.7.0/win-64::cuda-cudart-dev-11.7.60-0
cuda-cuobjdump nvidia/win-64::cuda-cuobjdump-12.1.111-0
cuda-cupti nvidia/label/cuda-11.7.0/win-64::cuda-cupti-11.7.50-0
cuda-cuxxfilt nvidia/win-64::cuda-cuxxfilt-12.1.105-0
cuda-documentation nvidia/win-64::cuda-documentation-12.1.105-0
cuda-libraries nvidia/label/cuda-11.7.0/win-64::cuda-libraries-11.7.0-0
cuda-libraries-dev nvidia/label/cuda-11.7.0/win-64::cuda-libraries-dev-11.7.0-0
cuda-memcheck nvidia/win-64::cuda-memcheck-11.8.86-0
cuda-nsight-compu~ nvidia/win-64::cuda-nsight-compute-12.1.1-0
cuda-nvcc nvidia/win-64::cuda-nvcc-12.1.105-0
cuda-nvdisasm nvidia/win-64::cuda-nvdisasm-12.1.105-0
cuda-nvml-dev nvidia/win-64::cuda-nvml-dev-12.1.105-0
cuda-nvprof nvidia/win-64::cuda-nvprof-12.1.105-0
cuda-nvprune nvidia/win-64::cuda-nvprune-12.1.105-0
cuda-nvrtc nvidia/label/cuda-11.7.0/win-64::cuda-nvrtc-11.7.50-0
cuda-nvrtc-dev nvidia/label/cuda-11.7.0/win-64::cuda-nvrtc-dev-11.7.50-0
cuda-nvtx nvidia/label/cuda-11.7.0/win-64::cuda-nvtx-11.7.50-0
cuda-nvvp nvidia/win-64::cuda-nvvp-12.1.105-0
cuda-runtime nvidia/label/cuda-11.7.0/win-64::cuda-runtime-11.7.0-0
cuda-sanitizer-api nvidia/win-64::cuda-sanitizer-api-12.1.105-0
cuda-toolkit nvidia/label/cuda-11.7.0/win-64::cuda-toolkit-11.7.0-0
cuda-tools nvidia/label/cuda-11.7.0/win-64::cuda-tools-11.7.0-0
cuda-visual-tools nvidia/label/cuda-11.7.0/win-64::cuda-visual-tools-11.7.0-0
filelock pkgs/main/win-64::filelock-3.9.0-py310haa95532_0
freetype pkgs/main/win-64::freetype-2.12.1-ha860e81_0
giflib pkgs/main/win-64::giflib-5.2.1-h8cc25b3_3
git pkgs/main/win-64::git-2.34.1-haa95532_0
idna pkgs/main/win-64::idna-3.4-py310haa95532_0
intel-openmp pkgs/main/win-64::intel-openmp-2021.4.0-haa95532_3556
jinja2 pkgs/main/win-64::jinja2-3.1.2-py310haa95532_0
jpeg pkgs/main/win-64::jpeg-9e-h2bbff1b_1
lerc pkgs/main/win-64::lerc-3.0-hd77b12b_0
libcublas nvidia/label/cuda-11.7.0/win-64::libcublas-11.10.1.25-0
libcublas-dev nvidia/label/cuda-11.7.0/win-64::libcublas-dev-11.10.1.25-0
libcufft nvidia/label/cuda-11.7.0/win-64::libcufft-10.7.2.50-0
libcufft-dev nvidia/label/cuda-11.7.0/win-64::libcufft-dev-10.7.2.50-0
libcurand nvidia/win-64::libcurand-10.3.2.106-0
libcurand-dev nvidia/win-64::libcurand-dev-10.3.2.106-0
libcusolver nvidia/label/cuda-11.7.0/win-64::libcusolver-11.3.5.50-0
libcusolver-dev nvidia/label/cuda-11.7.0/win-64::libcusolver-dev-11.3.5.50-0
libcusparse nvidia/label/cuda-11.7.0/win-64::libcusparse-11.7.3.50-0
libcusparse-dev nvidia/label/cuda-11.7.0/win-64::libcusparse-dev-11.7.3.50-0
libdeflate pkgs/main/win-64::libdeflate-1.17-h2bbff1b_0
libnpp nvidia/label/cuda-11.7.0/win-64::libnpp-11.7.3.21-0
libnpp-dev nvidia/label/cuda-11.7.0/win-64::libnpp-dev-11.7.3.21-0
libnvjpeg nvidia/label/cuda-11.7.0/win-64::libnvjpeg-11.7.2.34-0
libnvjpeg-dev nvidia/label/cuda-11.7.0/win-64::libnvjpeg-dev-11.7.2.34-0
libpng pkgs/main/win-64::libpng-1.6.39-h8cc25b3_0
libtiff pkgs/main/win-64::libtiff-4.5.0-h6c2663c_2
libuv pkgs/main/win-64::libuv-1.44.2-h2bbff1b_0
libwebp pkgs/main/win-64::libwebp-1.2.4-hbc33d0d_1
libwebp-base pkgs/main/win-64::libwebp-base-1.2.4-h2bbff1b_1
lz4-c pkgs/main/win-64::lz4-c-1.9.4-h2bbff1b_0
markupsafe pkgs/main/win-64::markupsafe-2.1.1-py310h2bbff1b_0
mkl pkgs/main/win-64::mkl-2021.4.0-haa95532_640
mkl-service pkgs/main/win-64::mkl-service-2.4.0-py310h2bbff1b_0
mkl_fft pkgs/main/win-64::mkl_fft-1.3.1-py310ha0764ea_0
mkl_random pkgs/main/win-64::mkl_random-1.2.2-py310h4ed8f06_0
mpmath pkgs/main/win-64::mpmath-1.2.1-py310haa95532_0
networkx pkgs/main/win-64::networkx-2.8.4-py310haa95532_1
ninja pkgs/main/win-64::ninja-1.10.2-haa95532_5
ninja-base pkgs/main/win-64::ninja-base-1.10.2-h6d14046_5
nsight-compute nvidia/win-64::nsight-compute-2023.1.1.4-0
numpy pkgs/main/win-64::numpy-1.24.3-py310hdc03b94_0
numpy-base pkgs/main/win-64::numpy-base-1.24.3-py310h3caf3d7_0
pillow pkgs/main/win-64::pillow-9.4.0-py310hd77b12b_0
pycparser pkgs/main/noarch::pycparser-2.21-pyhd3eb1b0_0
pyopenssl pkgs/main/win-64::pyopenssl-23.0.0-py310haa95532_0
pysocks pkgs/main/win-64::pysocks-1.7.1-py310haa95532_0
pytorch pytorch/win-64::pytorch-2.0.0-py3.10_cuda11.7_cudnn8_0
pytorch-cuda pytorch/win-64::pytorch-cuda-11.7-h16d0643_3
pytorch-mutex pytorch/noarch::pytorch-mutex-1.0-cuda
requests pkgs/main/win-64::requests-2.29.0-py310haa95532_0
six pkgs/main/noarch::six-1.16.0-pyhd3eb1b0_1
sympy pkgs/main/win-64::sympy-1.11.1-py310haa95532_0
torchaudio pytorch/win-64::torchaudio-2.0.0-py310_cu117
torchvision pytorch/win-64::torchvision-0.15.0-py310_cu117
typing_extensions pkgs/main/win-64::typing_extensions-4.5.0-py310haa95532_0
urllib3 pkgs/main/win-64::urllib3-1.26.15-py310haa95532_0
win_inet_pton pkgs/main/win-64::win_inet_pton-1.1.0-py310haa95532_0
zstd pkgs/main/win-64::zstd-1.5.5-hd43e919_0
Downloading and Extracting Packages
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Cloning into 'text-generation-webui'...
remote: Enumerating objects: 6369, done.
remote: Counting objects: 100% (1750/1750), done.
remote: Compressing objects: 100% (243/243), done.
remote: Total 6369 (delta 1646), reused 1507 (delta 1507), pack-reused 4619 eceiving objects: 99% (6306/6369)
Receiving objects: 100% (6369/6369), 2.31 MiB | 11.45 MiB/s, done.
Resolving deltas: 100% (4259/4259), done.
Collecting bitsandbytes==0.38.1
Using cached https://github.com/jllllll/bitsandbytes-windows-webui/raw/main/bitsandbytes-0.38.1-py3-none-any.whl (82.6 MB)
Installing collected packages: bitsandbytes
Successfully installed bitsandbytes-0.38.1
Already up to date.
Collecting git+https://github.com/huggingface/peft (from -r requirements.txt (line 16))
Cloning https://github.com/huggingface/peft to c:\ai\oobabooga\installer_files\pip-req-build-7n1ntryd
Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft 'C:\AI\oobabooga\installer_files\pip-req-build-7n1ntryd'
Resolved https://github.com/huggingface/peft to commit 632997d1fb776c3cf05d8c2537ac9a98a7ce9435
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system != "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system != "Windows"' don't match your environment
Collecting llama-cpp-python==0.1.36
Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.36/llama_cpp_python-0.1.36-cp310-cp310-win_amd64.whl (128 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.7/128.7 kB 1.3 MB/s eta 0:00:00
Collecting accelerate==0.18.0
Using cached accelerate-0.18.0-py3-none-any.whl (215 kB)
Collecting colorama
Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting datasets
Using cached datasets-2.12.0-py3-none-any.whl (474 kB)
Collecting flexgen==0.1.7
Using cached flexgen-0.1.7-py3-none-any.whl (50 kB)
Collecting gradio==3.25.0
Using cached gradio-3.25.0-py3-none-any.whl (17.5 MB)
Collecting markdown
Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (1.24.3)
Collecting pandas
Using cached pandas-2.0.1-cp310-cp310-win_amd64.whl (10.7 MB)
Collecting Pillow>=9.5.0
Using cached Pillow-9.5.0-cp310-cp310-win_amd64.whl (2.5 MB)
Collecting pyyaml
Using cached PyYAML-6.0-cp310-cp310-win_amd64.whl (151 kB)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (2.29.0)
Collecting rwkv==0.7.3
Using cached rwkv-0.7.3-py3-none-any.whl (16 kB)
Collecting safetensors==0.3.0
Using cached safetensors-0.3.0-cp310-cp310-win_amd64.whl (262 kB)
Collecting sentencepiece
Using cached sentencepiece-0.1.98-cp310-cp310-win_amd64.whl (977 kB)
Collecting tqdm
Using cached tqdm-4.65.0-py3-none-any.whl (77 kB)
Collecting transformers==4.28.1
Using cached transformers-4.28.1-py3-none-any.whl (7.0 MB)
Collecting packaging>=20.0
Using cached packaging-23.1-py3-none-any.whl (48 kB)
Collecting psutil
Using cached psutil-5.9.5-cp36-abi3-win_amd64.whl (255 kB)
Requirement already satisfied: torch>=1.4.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (2.0.0)
Collecting attrs
Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting pulp
Using cached PuLP-2.7.0-py3-none-any.whl (14.3 MB)
Requirement already satisfied: markupsafe in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.1.1)
Collecting semantic-version
Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: typing-extensions in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (4.5.0)
Collecting uvicorn
Using cached uvicorn-0.22.0-py3-none-any.whl (58 kB)
Collecting orjson
Using cached orjson-3.8.11-cp310-none-win_amd64.whl (196 kB)
Requirement already satisfied: jinja2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.1.2)
Collecting websockets>=10.0
Using cached websockets-11.0.2-cp310-cp310-win_amd64.whl (124 kB)
Collecting aiofiles
Using cached aiofiles-23.1.0-py3-none-any.whl (14 kB)
Collecting fastapi
Using cached fastapi-0.95.1-py3-none-any.whl (56 kB)
Collecting matplotlib
Using cached matplotlib-3.7.1-cp310-cp310-win_amd64.whl (7.6 MB)
Collecting huggingface-hub>=0.13.0
Using cached huggingface_hub-0.14.1-py3-none-any.whl (224 kB)
Collecting httpx
Using cached httpx-0.24.0-py3-none-any.whl (75 kB)
Collecting aiohttp
Using cached aiohttp-3.8.4-cp310-cp310-win_amd64.whl (319 kB)
Collecting mdit-py-plugins<=0.3.3
Using cached mdit_py_plugins-0.3.3-py3-none-any.whl (50 kB)
Collecting pydantic
Using cached pydantic-1.10.7-cp310-cp310-win_amd64.whl (2.1 MB)
Collecting altair>=4.2.0
Using cached altair-4.2.2-py3-none-any.whl (813 kB)
Collecting pydub
Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Collecting ffmpy
Using cached ffmpy-0.3.0-py3-none-any.whl
Collecting gradio-client>=0.0.8
Using cached gradio_client-0.1.4-py3-none-any.whl (286 kB)
Collecting python-multipart
Using cached python_multipart-0.0.6-py3-none-any.whl (45 kB)
Collecting markdown-it-py[linkify]>=2.0.0
Using cached markdown_it_py-2.2.0-py3-none-any.whl (84 kB)
Collecting tokenizers>=0.13.2
Using cached tokenizers-0.13.3-cp310-cp310-win_amd64.whl (3.5 MB)
Requirement already satisfied: filelock in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.1->-r requirements.txt (line 17)) (3.9.0)
Collecting regex!=2019.12.17
Using cached regex-2023.3.23-cp310-cp310-win_amd64.whl (267 kB)
Collecting responses<0.19
Using cached responses-0.18.0-py3-none-any.whl (38 kB)
Collecting pyarrow>=8.0.0
Using cached pyarrow-11.0.0-cp310-cp310-win_amd64.whl (20.6 MB)
Collecting dill<0.3.7,>=0.3.0
Using cached dill-0.3.6-py3-none-any.whl (110 kB)
Collecting xxhash
Using cached xxhash-3.2.0-cp310-cp310-win_amd64.whl (30 kB)
Collecting fsspec[http]>=2021.11.1
Using cached fsspec-2023.4.0-py3-none-any.whl (153 kB)
Collecting multiprocess
Using cached multiprocess-0.70.14-py310-none-any.whl (134 kB)
Collecting tzdata>=2022.1
Using cached tzdata-2023.3-py2.py3-none-any.whl (341 kB)
Collecting pytz>=2020.1
Using cached pytz-2023.3-py2.py3-none-any.whl (502 kB)
Collecting python-dateutil>=2.8.2
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 11)) (2022.12.7)
Collecting entrypoints
Using cached entrypoints-0.4-py3-none-any.whl (5.3 kB)
Collecting jsonschema>=3.0
Using cached jsonschema-4.17.3-py3-none-any.whl (90 kB)
Collecting toolz
Using cached toolz-0.12.0-py3-none-any.whl (55 kB)
Collecting frozenlist>=1.1.1
Using cached frozenlist-1.3.3-cp310-cp310-win_amd64.whl (33 kB)
Collecting multidict<7.0,>=4.5
Using cached multidict-6.0.4-cp310-cp310-win_amd64.whl (28 kB)
Collecting aiosignal>=1.1.2
Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting yarl<2.0,>=1.0
Using cached yarl-1.9.2-cp310-cp310-win_amd64.whl (61 kB)
Collecting async-timeout<5.0,>=4.0.0a3
Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting mdurl~=0.1
Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Collecting linkify-it-py<3,>=1
Using cached linkify_it_py-2.0.0-py3-none-any.whl (19 kB)
Requirement already satisfied: six>=1.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 8)) (1.16.0)
Requirement already satisfied: sympy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.11.1)
Requirement already satisfied: networkx in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (2.8.4)
Collecting starlette<0.27.0,>=0.26.1
Using cached starlette-0.26.1-py3-none-any.whl (66 kB)
Collecting sniffio
Using cached sniffio-1.3.0-py3-none-any.whl (10 kB)
Collecting httpcore<0.18.0,>=0.15.0
Using cached httpcore-0.17.0-py3-none-any.whl (70 kB)
Collecting pyparsing>=2.3.1
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting cycler>=0.10
Using cached cycler-0.11.0-py3-none-any.whl (6.4 kB)
Collecting kiwisolver>=1.0.1
Using cached kiwisolver-1.4.4-cp310-cp310-win_amd64.whl (55 kB)
Collecting contourpy>=1.0.1
Using cached contourpy-1.0.7-cp310-cp310-win_amd64.whl (162 kB)
Collecting fonttools>=4.22.0
Using cached fonttools-4.39.3-py3-none-any.whl (1.0 MB)
Collecting h11>=0.8
Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Collecting click>=7.0
Using cached click-8.1.3-py3-none-any.whl (96 kB)
Collecting anyio<5.0,>=3.0
Using cached anyio-3.6.2-py3-none-any.whl (80 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Using cached pyrsistent-0.19.3-cp310-cp310-win_amd64.whl (62 kB)
Collecting uc-micro-py
Using cached uc_micro_py-1.0.1-py3-none-any.whl (6.2 kB)
Requirement already satisfied: mpmath>=0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.2.1)
Building wheels for collected packages: peft
Building wheel for peft (pyproject.toml) ... done
Created wheel for peft: filename=peft-0.3.0.dev0-py3-none-any.whl size=55901 sha256=34e7d770a1a3c6aac05daa71b1dc641cbd9cd4ee8ea4a54496a8d1decb85912a
Stored in directory: C:\AI\oobabooga\installer_files\pip-ephem-wheel-cache-w0tqagr2\wheels\4c\16\67\1002a2d4daa822eff130e6d85b90051b75d2ce0d26b9448e4a
Successfully built peft
Installing collected packages: tokenizers, sentencepiece, safetensors, pytz, pydub, pulp, ffmpy, xxhash, websockets, uc-micro-py, tzdata, toolz, sniffio, semantic-version, rwkv, regex, pyyaml, python-multipart, python-dateutil, pyrsistent, pyparsing, pydantic, pyarrow, psutil, Pillow, packaging, orjson, multidict, mdurl, markdown, llama-cpp-python, kiwisolver, h11, fsspec, frozenlist, fonttools, entrypoints, dill, cycler, contourpy, colorama, attrs, async-timeout, aiofiles, yarl, tqdm, responses, pandas, multiprocess, matplotlib, markdown-it-py, linkify-it-py, jsonschema, click, anyio, aiosignal, uvicorn, starlette, mdit-py-plugins, huggingface-hub, httpcore, altair, aiohttp, accelerate, transformers, httpx, fastapi, peft, gradio-client, flexgen, datasets, gradio
Attempting uninstall: Pillow
Found existing installation: Pillow 9.4.0
Uninstalling Pillow-9.4.0:
Successfully uninstalled Pillow-9.4.0
Successfully installed Pillow-9.5.0 accelerate-0.18.0 aiofiles-23.1.0 aiohttp-3.8.4 aiosignal-1.3.1 altair-4.2.2 anyio-3.6.2 async-timeout-4.0.2 attrs-23.1.0 click-8.1.3 colorama-0.4.6 contourpy-1.0.7 cycler-0.11.0 datasets-2.12.0 dill-0.3.6 entrypoints-0.4 fastapi-0.95.1 ffmpy-0.3.0 flexgen-0.1.7 fonttools-4.39.3 frozenlist-1.3.3 fsspec-2023.4.0 gradio-3.25.0 gradio-client-0.1.4 h11-0.14.0 httpcore-0.17.0 httpx-0.24.0 huggingface-hub-0.14.1 jsonschema-4.17.3 kiwisolver-1.4.4 linkify-it-py-2.0.0 llama-cpp-python-0.1.36 markdown-3.4.3 markdown-it-py-2.2.0 matplotlib-3.7.1 mdit-py-plugins-0.3.3 mdurl-0.1.2 multidict-6.0.4 multiprocess-0.70.14 orjson-3.8.11 packaging-23.1 pandas-2.0.1 peft-0.3.0.dev0 psutil-5.9.5 pulp-2.7.0 pyarrow-11.0.0 pydantic-1.10.7 pydub-0.25.1 pyparsing-3.0.9 pyrsistent-0.19.3 python-dateutil-2.8.2 python-multipart-0.0.6 pytz-2023.3 pyyaml-6.0 regex-2023.3.23 responses-0.18.0 rwkv-0.7.3 safetensors-0.3.0 semantic-version-2.10.0 sentencepiece-0.1.98 sniffio-1.3.0 starlette-0.26.1 tokenizers-0.13.3 toolz-0.12.0 tqdm-4.65.0 transformers-4.28.1 tzdata-2023.3 uc-micro-py-1.0.1 uvicorn-0.22.0 websockets-11.0.2 xxhash-3.2.0 yarl-1.9.2
Collecting flask_cloudflared==0.0.12
Using cached flask_cloudflared-0.0.12-py3-none-any.whl (6.3 kB)
Requirement already satisfied: websockets==11.0.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 2)) (11.0.2)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.29.0)
Collecting Flask>=0.8
Using cached Flask-2.3.1-py3-none-any.whl (96 kB)
Requirement already satisfied: click>=8.1.3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3)
Collecting Werkzeug>=2.3.0
Using cached Werkzeug-2.3.2-py3-none-any.whl (242 kB)
Collecting blinker>=1.6.2
Using cached blinker-1.6.2-py3-none-any.whl (13 kB)
Requirement already satisfied: Jinja2>=3.1.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2)
Collecting itsdangerous>=2.1.2
Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from click>=8.1.3->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.1)
Installing collected packages: Werkzeug, itsdangerous, blinker, Flask, flask_cloudflared
Successfully installed Flask-2.3.1 Werkzeug-2.3.2 blinker-1.6.2 flask_cloudflared-0.0.12 itsdangerous-2.1.2
Collecting elevenlabslib
Using cached elevenlabslib-0.5.3-py3-none-any.whl (18 kB)
Collecting soundfile
Using cached soundfile-0.12.1-py2.py3-none-win_amd64.whl (1.0 MB)
Collecting sounddevice
Using cached sounddevice-0.4.6-py3-none-win_amd64.whl (199 kB)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.3)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.29.0)
Collecting typing
Using cached typing-3.7.4.3-py3-none-any.whl
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7)
Installing collected packages: typing, soundfile, sounddevice, elevenlabslib
Successfully installed elevenlabslib-0.5.3 sounddevice-0.4.6 soundfile-0.12.1 typing-3.7.4.3
Collecting deep-translator==1.9.2
Using cached deep_translator-1.9.2-py3-none-any.whl (30 kB)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.29.0)
Collecting beautifulsoup4<5.0.0,>=4.9.1
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.4.1-py3-none-any.whl (36 kB)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.4)
Installing collected packages: soupsieve, beautifulsoup4, deep-translator
Successfully installed beautifulsoup4-4.12.2 deep-translator-1.9.2 soupsieve-2.4.1
Collecting ipython
Using cached ipython-8.13.1-py3-none-any.whl (797 kB)
Collecting num2words
Using cached num2words-0.5.12-py3-none-any.whl (125 kB)
Collecting omegaconf
Using cached omegaconf-2.3.0-py3-none-any.whl (79 kB)
Requirement already satisfied: pydub in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6)
Collecting stack-data
Using cached stack_data-0.6.2-py3-none-any.whl (24 kB)
Collecting matplotlib-inline
Using cached matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB)
Collecting pygments>=2.4.0
Using cached Pygments-2.15.1-py3-none-any.whl (1.1 MB)
Collecting pickleshare
Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting jedi>=0.16
Using cached jedi-0.18.2-py2.py3-none-any.whl (1.6 MB)
Collecting decorator
Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting traitlets>=5
Using cached traitlets-5.9.0-py3-none-any.whl (117 kB)
Collecting backcall
Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30
Using cached prompt_toolkit-3.0.38-py3-none-any.whl (385 kB)
Collecting docopt>=0.6.2
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting antlr4-python3-runtime==4.9.*
Using cached antlr4_python3_runtime-4.9.3-py3-none-any.whl
Collecting parso<0.9.0,>=0.8.0
Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)
Collecting wcwidth
Using cached wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
Collecting asttokens>=2.1.0
Using cached asttokens-2.2.1-py2.py3-none-any.whl (26 kB)
Collecting pure-eval
Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting executing>=1.2.0
Using cached executing-1.2.0-py2.py3-none-any.whl (24 kB)
Requirement already satisfied: six in c:\ai\oobabooga\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0)
Installing collected packages: wcwidth, pure-eval, pickleshare, executing, docopt, backcall, antlr4-python3-runtime, traitlets, pygments, prompt-toolkit, parso, omegaconf, num2words, decorator, asttokens, stack-data, matplotlib-inline, jedi, ipython
Successfully installed antlr4-python3-runtime-4.9.3 asttokens-2.2.1 backcall-0.2.0 decorator-5.1.1 docopt-0.6.2 executing-1.2.0 ipython-8.13.1 jedi-0.18.2 matplotlib-inline-0.1.6 num2words-0.5.12 omegaconf-2.3.0 parso-0.8.3 pickleshare-0.7.5 prompt-toolkit-3.0.38 pure-eval-0.2.2 pygments-2.15.1 stack-data-0.6.2 traitlets-5.9.0 wcwidth-0.2.6
Collecting git+https://github.com/Uberi/speech_recognition.git@010382b80267f0f7794169fccc8e875ee7da7c19 (from -r extensions\whisper_stt\requirements.txt (line 1))
Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b80267f0f7794169fccc8e875ee7da7c19) to c:\ai\oobabooga\installer_files\pip-req-build-gqm4yu0j
Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\AI\oobabooga\installer_files\pip-req-build-gqm4yu0j'
Running command git rev-parse -q --verify 'sha^010382b80267f0f7794169fccc8e875ee7da7c19'
Running command git fetch -q https://github.com/Uberi/speech_recognition.git 010382b80267f0f7794169fccc8e875ee7da7c19
Running command git checkout -q 010382b80267f0f7794169fccc8e875ee7da7c19
Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b80267f0f7794169fccc8e875ee7da7c19
Preparing metadata (setup.py) ... done
Collecting openai-whisper
Using cached openai_whisper-20230314-py3-none-any.whl
Requirement already satisfied: soundfile in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1)
Collecting ffmpeg
Using cached ffmpeg-1.4-py3-none-any.whl
Requirement already satisfied: requests>=2.26.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.29.0)
Collecting tiktoken==0.3.1
Using cached tiktoken-0.3.1-cp310-cp310-win_amd64.whl (581 kB)
Collecting numba
Using cached numba-0.56.4-cp310-cp310-win_amd64.whl (2.5 MB)
Requirement already satisfied: torch in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.3)
Collecting more-itertools
Using cached more_itertools-9.1.0-py3-none-any.whl (54 kB)
Requirement already satisfied: tqdm in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0)
Collecting ffmpeg-python==0.2.0
Using cached ffmpeg_python-0.2.0-py3-none-any.whl (25 kB)
Collecting future
Using cached future-0.18.3-py3-none-any.whl
Requirement already satisfied: regex>=2022.1.18 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23)
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15)
Collecting llvmlite<0.40,>=0.39.0dev0
Using cached llvmlite-0.39.1-cp310-cp310-win_amd64.whl (23.2 MB)
Collecting numpy
Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
Requirement already satisfied: setuptools in c:\ai\oobabooga\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (66.0.0)
Requirement already satisfied: filelock in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.9.0)
Requirement already satisfied: typing-extensions in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: sympy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.8.4)
Requirement already satisfied: jinja2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from jinja2->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.1.1)
Requirement already satisfied: mpmath>=0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from sympy->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.2.1)
Building wheels for collected packages: SpeechRecognition
Building wheel for SpeechRecognition (setup.py) ... done
Created wheel for SpeechRecognition: filename=SpeechRecognition-3.9.0-py2.py3-none-any.whl size=32839782 sha256=388a75770165b5c097f8395eed8fb455805a8e3d09276638383fb9d8c06faf82
Stored in directory: c:\users\bissop\appdata\local\pip\cache\wheels\0b\1a\30\6c60550fbf4a28521e10e90da86fe84ac713246235b33de004
Successfully built SpeechRecognition
Installing collected packages: ffmpeg, numpy, more-itertools, llvmlite, future, tiktoken, SpeechRecognition, numba, ffmpeg-python, openai-whisper
Attempting uninstall: numpy
Found existing installation: numpy 1.24.3
Uninstalling numpy-1.24.3:
Successfully uninstalled numpy-1.24.3
Successfully installed SpeechRecognition-3.9.0 ffmpeg-1.4 ffmpeg-python-0.2.0 future-0.18.3 llvmlite-0.39.1 more-itertools-9.1.0 numba-0.56.4 numpy-1.23.5 openai-whisper-20230314 tiktoken-0.3.1
Cloning into 'GPTQ-for-LLaMa'...
remote: Enumerating objects: 814, done.
remote: Total 814 (delta 0), reused 0 (delta 0), pack-reused 814Receiving objects: 98% (798/814)
Receiving objects: 100% (814/814), 473.43 KiB | 2.37 MiB/s, done.
Resolving deltas: 100% (490/490), done.
Already up to date.
Requirement already satisfied: safetensors==0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.3.0)
Collecting datasets==2.10.1
Using cached datasets-2.10.1-py3-none-any.whl (469 kB)
Requirement already satisfied: sentencepiece in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (0.1.98)
Collecting transformers==4.28.0
Using cached transformers-4.28.0-py3-none-any.whl (7.0 MB)
Requirement already satisfied: accelerate==0.18.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.18.0)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.3.6)
Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2023.4.0)
Requirement already satisfied: numpy>=1.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (1.23.5)
Requirement already satisfied: xxhash in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.2.0)
Requirement already satisfied: requests>=2.19.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.29.0)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.14.1)
Requirement already satisfied: packaging in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (23.1)
Requirement already satisfied: multiprocess in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.70.14)
Requirement already satisfied: pyarrow>=6.0.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (11.0.0)
Requirement already satisfied: pandas in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: pyyaml>=5.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (6.0)
Requirement already satisfied: tqdm>=4.62.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: aiohttp in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.8.4)
Requirement already satisfied: responses<0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.18.0)
Requirement already satisfied: filelock in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (3.9.0)
Requirement already satisfied: regex!=2019.12.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (2023.3.23)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (0.13.3)
Requirement already satisfied: torch>=1.4.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: psutil in c:\ai\oobabooga\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (5.9.5)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (4.0.2)
Requirement already satisfied: frozenlist>=1.1.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.3)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (2.0.4)
Requirement already satisfied: attrs>=17.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (23.1.0)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.9.2)
Requirement already satisfied: aiosignal>=1.1.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets==2.10.1->-r requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (3.4)
Requirement already satisfied: sympy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.11.1)
Requirement already satisfied: networkx in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (2.8.4)
Requirement already satisfied: jinja2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (3.1.2)
Requirement already satisfied: colorama in c:\ai\oobabooga\installer_files\env\lib\site-packages (from tqdm>=4.62.1->datasets==2.10.1->-r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: pytz>=2020.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2.8.2)
Requirement already satisfied: tzdata>=2022.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: six>=1.5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->datasets==2.10.1->-r requirements.txt (line 2)) (1.16.0)
Requirement already satisfied: MarkupSafe>=2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from jinja2->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (2.1.1)
Requirement already satisfied: mpmath>=0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.2.1)
Installing collected packages: transformers, datasets
Attempting uninstall: transformers
Found existing installation: transformers 4.28.1
Uninstalling transformers-4.28.1:
Successfully uninstalled transformers-4.28.1
Attempting uninstall: datasets
Found existing installation: datasets 2.12.0
Uninstalling datasets-2.12.0:
Successfully uninstalled datasets-2.12.0
Successfully installed datasets-2.10.1 transformers-4.28.0
Processing c:\ai\oobabooga\text-generation-webui\repositories\gptq-for-llama
Preparing metadata (setup.py) ... done
Building wheels for collected packages: quant-cuda
Building wheel for quant-cuda (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [50 lines of output]
running bdist_wheel
running build
running build_ext
C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
setup(
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
return distutils.core.setup(**attrs)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\wheel\bdist_wheel.py", line 325, in run
self.run_command("build")
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
self.run_command(cmd_name)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
_build_ext.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
self.build_extensions()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 387, in _check_cuda_version
raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for quant-cuda
Running setup.py clean for quant-cuda
Failed to build quant-cuda
Installing collected packages: quant-cuda
Running setup.py install for quant-cuda ... error
error: subprocess-exited-with-error
× Running setup.py install for quant-cuda did not run successfully.
│ exit code: 1
╰─> [54 lines of output]
running install
C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_ext
C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
setup(
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
return distutils.core.setup(**attrs)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 68, in run
return orig.install.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\install.py", line 698, in run
self.run_command('build')
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
self.run_command(cmd_name)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
_build_ext.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
self.build_extensions()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py", line 387, in _check_cuda_version
raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> quant-cuda
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
ERROR: GPTQ CUDA kernel compilation failed.
Attempting installation with wheel.
Collecting quant-cuda==0.0.0
Using cached https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl (398 kB)
Installing collected packages: quant-cuda
Successfully installed quant-cuda-0.0.0
Wheel installation success!
Continuing with install..
Select the model that you want to download:
A) OPT 6.7B
B) OPT 2.7B
C) OPT 1.3B
D) OPT 350M
E) GALACTICA 6.7B
F) GALACTICA 1.3B
G) GALACTICA 125M
H) Pythia-6.9B-deduped
I) Pythia-2.8B-deduped
J) Pythia-1.4B-deduped
K) Pythia-410M-deduped
L) Manually specify a Hugging Face model
M) Do not download a model
Input>
@pyGisServer even though the compilation didn't work, it says the alternative install worked
Attempting installation with wheel. Wheel installation success!
Can you verify this by going to installer_files/env/Lib/site-packages
and verifying that there is a folder which starts with quant_cuda
?
@xNul I checked the path and there is a folder called quant_cuda-0.0.0.dist-info
and a file quant_cuda.cp310-win_amd64.pyd
.
But I guess something is still wrong because when I try to run update.bat
I also get this error at the end of it all:
Already up to date.
Collecting git+https://github.com/huggingface/peft (from -r requirements.txt (line 16))
Cloning https://github.com/huggingface/peft to c:\ai\oobabooga\installer_files\pip-req-build-2rb165ha
Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft 'C:\AI\oobabooga\installer_files\pip-req-build-2rb165ha'
Resolved https://github.com/huggingface/peft to commit 632997d1fb776c3cf05d8c2537ac9a98a7ce9435
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system != "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system != "Windows"' don't match your environment
Collecting llama-cpp-python==0.1.36
Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.36/llama_cpp_python-0.1.36-cp310-cp310-win_amd64.whl (128 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.7/128.7 kB 1.3 MB/s eta 0:00:00
Requirement already satisfied: accelerate==0.18.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.18.0)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: datasets in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (2.10.1)
Collecting datasets
Using cached datasets-2.12.0-py3-none-any.whl (474 kB)
Requirement already satisfied: flexgen==0.1.7 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (0.1.7)
Requirement already satisfied: gradio==3.25.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (3.25.0)
Requirement already satisfied: markdown in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 6)) (3.4.3)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (1.23.5)
Collecting numpy
Using cached numpy-1.24.3-cp310-cp310-win_amd64.whl (14.8 MB)
Requirement already satisfied: pandas in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 8)) (2.0.1)
Requirement already satisfied: Pillow>=9.5.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 9)) (9.5.0)
Requirement already satisfied: pyyaml in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 10)) (6.0)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (2.29.0)
Requirement already satisfied: rwkv==0.7.3 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 12)) (0.7.3)
Requirement already satisfied: safetensors==0.3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 13)) (0.3.0)
Requirement already satisfied: sentencepiece in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 14)) (0.1.98)
Requirement already satisfied: tqdm in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 15)) (4.65.0)
Collecting transformers==4.28.1
Using cached transformers-4.28.1-py3-none-any.whl (7.0 MB)
Requirement already satisfied: packaging>=20.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (23.1)
Requirement already satisfied: psutil in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (5.9.4)
Requirement already satisfied: torch>=1.4.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (1.13.1+cu117)
Requirement already satisfied: pulp in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (2.7.0)
Requirement already satisfied: attrs in c:\users\bissop\appdata\roaming\python\python310\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (23.1.0)
Requirement already satisfied: markupsafe in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.1.2)
Requirement already satisfied: semantic-version in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.10.0)
Requirement already satisfied: gradio-client>=0.0.8 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.1.4)
Requirement already satisfied: huggingface-hub>=0.13.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.13.4)
Requirement already satisfied: typing-extensions in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (4.5.0)
Requirement already satisfied: uvicorn in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.21.1)
Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (2.2.0)
Requirement already satisfied: aiofiles in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (23.1.0)
Requirement already satisfied: orjson in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.8.10)
Requirement already satisfied: pydantic in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (1.10.7)
Requirement already satisfied: altair>=4.2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (4.2.2)
Requirement already satisfied: websockets>=10.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (11.0.2)
Requirement already satisfied: mdit-py-plugins<=0.3.3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.3.3)
Requirement already satisfied: pydub in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.25.1)
Requirement already satisfied: jinja2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.1.2)
Requirement already satisfied: ffmpy in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.3.0)
Requirement already satisfied: matplotlib in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.7.1)
Requirement already satisfied: aiohttp in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (3.8.4)
Requirement already satisfied: httpx in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.24.0)
Requirement already satisfied: python-multipart in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.0.6)
Requirement already satisfied: fastapi in c:\users\bissop\appdata\roaming\python\python310\site-packages (from gradio==3.25.0->-r requirements.txt (line 5)) (0.94.0)
Requirement already satisfied: tokenizers>=0.13.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from rwkv==0.7.3->-r requirements.txt (line 12)) (0.13.3)
Requirement already satisfied: filelock in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.1->-r requirements.txt (line 17)) (3.11.0)
Requirement already satisfied: regex!=2019.12.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.1->-r requirements.txt (line 17)) (2023.3.23)
Requirement already satisfied: pyarrow>=8.0.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (11.0.0)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.3.6)
Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets->-r requirements.txt (line 3)) (2023.4.0)
Requirement already satisfied: responses<0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.18.0)
Requirement already satisfied: xxhash in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (3.2.0)
Requirement already satisfied: multiprocess in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.70.14)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->-r requirements.txt (line 8)) (2.8.2)
Requirement already satisfied: tzdata>=2022.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->-r requirements.txt (line 8)) (2023.3)
Requirement already satisfied: pytz>=2020.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->-r requirements.txt (line 8)) (2023.3)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->-r requirements.txt (line 11)) (1.26.15)
Requirement already satisfied: jsonschema>=3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (4.17.3)
Requirement already satisfied: toolz in c:\users\bissop\appdata\roaming\python\python310\site-packages (from altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.12.0)
Requirement already satisfied: entrypoints in c:\users\bissop\appdata\roaming\python\python310\site-packages (from altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (4.0.2)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (1.3.1)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (1.8.2)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (1.3.3)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->gradio==3.25.0->-r requirements.txt (line 5)) (6.0.4)
Requirement already satisfied: mdurl~=0.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.1.2)
Requirement already satisfied: linkify-it-py<3,>=1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.25.0->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: six>=1.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 8)) (1.16.0)
Requirement already satisfied: starlette<0.27.0,>=0.26.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from fastapi->gradio==3.25.0->-r requirements.txt (line 5)) (0.26.1)
Requirement already satisfied: sniffio in c:\users\bissop\appdata\roaming\python\python310\site-packages (from httpx->gradio==3.25.0->-r requirements.txt (line 5)) (1.3.0)
Requirement already satisfied: httpcore<0.18.0,>=0.15.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from httpx->gradio==3.25.0->-r requirements.txt (line 5)) (0.15.0)
Requirement already satisfied: contourpy>=1.0.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (1.0.7)
Requirement already satisfied: fonttools>=4.22.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (4.39.3)
Requirement already satisfied: pyparsing>=2.3.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (3.0.9)
Requirement already satisfied: cycler>=0.10 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (0.11.0)
Requirement already satisfied: kiwisolver>=1.0.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from matplotlib->gradio==3.25.0->-r requirements.txt (line 5)) (1.4.4)
Requirement already satisfied: click>=7.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from uvicorn->gradio==3.25.0->-r requirements.txt (line 5)) (8.1.3)
Requirement already satisfied: h11>=0.8 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from uvicorn->gradio==3.25.0->-r requirements.txt (line 5)) (0.12.0)
Requirement already satisfied: anyio==3.* in c:\users\bissop\appdata\roaming\python\python310\site-packages (from httpcore<0.18.0,>=0.15.0->httpx->gradio==3.25.0->-r requirements.txt (line 5)) (3.6.2)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.25.0->-r requirements.txt (line 5)) (0.19.3)
Requirement already satisfied: uc-micro-py in c:\users\bissop\appdata\roaming\python\python310\site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.25.0->-r requirements.txt (line 5)) (1.0.1)
Installing collected packages: numpy, transformers, datasets
Attempting uninstall: numpy
Found existing installation: numpy 1.23.5
Uninstalling numpy-1.23.5:
Successfully uninstalled numpy-1.23.5
Attempting uninstall: transformers
Found existing installation: transformers 4.28.0
Uninstalling transformers-4.28.0:
Successfully uninstalled transformers-4.28.0
Attempting uninstall: datasets
Found existing installation: datasets 2.10.1
Uninstalling datasets-2.10.1:
Successfully uninstalled datasets-2.10.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed.
numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.3 which is incompatible.
clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.29.0 which is incompatible.
Successfully installed datasets-2.12.0 numpy-1.24.3 transformers-4.28.1
Requirement already satisfied: flask_cloudflared==0.0.12 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: websockets==11.0.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 2)) (11.0.2)
Requirement already satisfied: Flask>=0.8 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.3.1)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: Werkzeug>=2.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.3.2)
Requirement already satisfied: blinker>=1.6.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.6.2)
Requirement already satisfied: click>=8.1.3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: Jinja2>=3.1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.10)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from click>=8.1.3->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: elevenlabslib in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.6.0)
Requirement already satisfied: soundfile in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 2)) (0.12.1)
Requirement already satisfied: sounddevice in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 3)) (0.4.6)
Requirement already satisfied: requests in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: typing in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.7.4.3)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.3)
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: deep-translator==1.9.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\google_translate\requirements.txt (line 1)) (1.9.2)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (4.12.2)
Requirement already satisfied: soupsieve>1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.4.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.10)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: ipython in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 1)) (8.13.1)
Requirement already satisfied: num2words in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 2)) (0.5.12)
Requirement already satisfied: omegaconf in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 3)) (2.3.0)
Requirement already satisfied: pydub in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0)
Requirement already satisfied: traitlets>=5 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: backcall in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: pygments>=2.4.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.15.1)
Requirement already satisfied: matplotlib-inline in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: jedi>=0.16 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: stack-data in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: pickleshare in c:\ai\oobabooga\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: docopt>=0.6.2 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from num2words->-r extensions\silero_tts\requirements.txt (line 2)) (0.6.2)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in c:\users\bissop\appdata\roaming\python\python310\site-packages (from omegaconf->-r extensions\silero_tts\requirements.txt (line 3)) (4.9.3)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from jedi>=0.16->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: wcwidth in c:\users\bissop\appdata\roaming\python\python310\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: asttokens>=2.1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: executing>=1.2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: pure-eval in c:\ai\oobabooga\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six in c:\users\bissop\appdata\roaming\python\python310\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0)
Collecting git+https://github.com/Uberi/speech_recognition.git@010382b80267f0f7794169fccc8e875ee7da7c19 (from -r extensions\whisper_stt\requirements.txt (line 1))
Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b80267f0f7794169fccc8e875ee7da7c19) to c:\ai\oobabooga\installer_files\pip-req-build-et96lr96
Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\AI\oobabooga\installer_files\pip-req-build-et96lr96'
Running command git rev-parse -q --verify 'sha^010382b80267f0f7794169fccc8e875ee7da7c19'
Running command git fetch -q https://github.com/Uberi/speech_recognition.git 010382b80267f0f7794169fccc8e875ee7da7c19
Running command git checkout -q 010382b80267f0f7794169fccc8e875ee7da7c19
Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b80267f0f7794169fccc8e875ee7da7c19
Preparing metadata (setup.py) ... done
Requirement already satisfied: openai-whisper in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 2)) (20230314)
Requirement already satisfied: soundfile in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1)
Requirement already satisfied: ffmpeg in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 4)) (1.4)
Requirement already satisfied: requests>=2.26.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.29.0)
Requirement already satisfied: tqdm in c:\users\bissop\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: numba in c:\users\bissop\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.56.4)
Requirement already satisfied: torch in c:\users\bissop\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.13.1+cu117)
Requirement already satisfied: more-itertools in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (9.1.0)
Requirement already satisfied: tiktoken==0.3.1 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.3.1)
Requirement already satisfied: numpy in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.3)
Requirement already satisfied: ffmpeg-python==0.2.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.2.0)
Requirement already satisfied: future in c:\users\bissop\appdata\roaming\python\python310\site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.18.3)
Requirement already satisfied: regex>=2022.1.18 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23)
Requirement already satisfied: cffi>=1.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in c:\ai\oobabooga\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.10)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.39.1)
Collecting numpy
Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
Requirement already satisfied: setuptools in c:\ai\oobabooga\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (66.0.0)
Requirement already satisfied: typing-extensions in c:\users\bissop\appdata\roaming\python\python310\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6)
Installing collected packages: numpy
Attempting uninstall: numpy
Found existing installation: numpy 1.24.3
Uninstalling numpy-1.24.3:
Successfully uninstalled numpy-1.24.3
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed.
clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.29.0 which is incompatible.
Successfully installed numpy-1.23.5
Cloning into 'GPTQ-for-LLaMa'...
remote: Enumerating objects: 814, done.
remote: Counting objects: 100% (814/814), done.
remote: Compressing objects: 100% (320/320), done.
Receiving objects: 91% (741/814): Total 814 (delta 495), reused 793 (delta 489), pack-reused 0
Receiving objects: 100% (814/814), 468.18 KiB | 2.87 MiB/s, done.
Resolving deltas: 100% (495/495), done.
Already up to date.
Requirement already satisfied: safetensors==0.3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 1)) (0.3.0)
Collecting datasets==2.10.1
Using cached datasets-2.10.1-py3-none-any.whl (469 kB)
Requirement already satisfied: sentencepiece in c:\users\bissop\appdata\roaming\python\python310\site-packages (from -r requirements.txt (line 3)) (0.1.98)
Collecting transformers==4.28.0
Using cached transformers-4.28.0-py3-none-any.whl (7.0 MB)
Requirement already satisfied: accelerate==0.18.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.18.0)
Requirement already satisfied: aiohttp in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.8.4)
Requirement already satisfied: multiprocess in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.70.14)
Requirement already satisfied: numpy>=1.17 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (1.23.5)
Requirement already satisfied: xxhash in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.2.0)
Requirement already satisfied: responses<0.19 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.18.0)
Requirement already satisfied: pyarrow>=6.0.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (11.0.0)
Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2023.4.0)
Requirement already satisfied: packaging in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (23.1)
Requirement already satisfied: pyyaml>=5.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (6.0)
Requirement already satisfied: requests>=2.19.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.29.0)
Requirement already satisfied: tqdm>=4.62.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.13.4)
Requirement already satisfied: pandas in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\ai\oobabooga\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.3.6)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (0.13.3)
Requirement already satisfied: filelock in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (3.11.0)
Requirement already satisfied: regex!=2019.12.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (2023.3.23)
Requirement already satisfied: psutil in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (5.9.4)
Requirement already satisfied: torch>=1.4.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (1.13.1+cu117)
Requirement already satisfied: attrs>=17.3.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (3.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (4.0.2)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.8.2)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.1)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.3)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets==2.10.1->-r requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2.10)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (1.26.15)
Requirement already satisfied: colorama in c:\users\bissop\appdata\roaming\python\python310\site-packages (from tqdm>=4.62.1->datasets==2.10.1->-r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: tzdata>=2022.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: six>=1.5 in c:\users\bissop\appdata\roaming\python\python310\site-packages (from python-dateutil>=2.8.2->pandas->datasets==2.10.1->-r requirements.txt (line 2)) (1.16.0)
Installing collected packages: transformers, datasets
Attempting uninstall: transformers
Found existing installation: transformers 4.28.1
Uninstalling transformers-4.28.1:
Successfully uninstalled transformers-4.28.1
Attempting uninstall: datasets
Found existing installation: datasets 2.12.0
Uninstalling datasets-2.12.0:
Successfully uninstalled datasets-2.12.0
Successfully installed datasets-2.10.1 transformers-4.28.0
Processing c:\ai\oobabooga\text-generation-webui\repositories\gptq-for-llama
Preparing metadata (setup.py) ... done
Building wheels for collected packages: quant-cuda
Building wheel for quant-cuda (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [50 lines of output]
running bdist_wheel
running build
running build_ext
C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
setup(
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
return distutils.core.setup(**attrs)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\wheel\bdist_wheel.py", line 343, in run
self.run_command("build")
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
self.run_command(cmd_name)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
_build_ext.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
self.build_extensions()
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 386, in _check_cuda_version
raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for quant-cuda
Running setup.py clean for quant-cuda
Failed to build quant-cuda
Installing collected packages: quant-cuda
Attempting uninstall: quant-cuda
Found existing installation: quant-cuda 0.0.0
Uninstalling quant-cuda-0.0.0:
Successfully uninstalled quant-cuda-0.0.0
Running setup.py install for quant-cuda ... error
error: subprocess-exited-with-error
× Running setup.py install for quant-cuda did not run successfully.
│ exit code: 1
╰─> [54 lines of output]
running install
C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_ext
C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup.py", line 4, in <module>
setup(
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
return distutils.core.setup(**attrs)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 68, in run
return orig.install.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\install.py", line 698, in run
self.run_command('build')
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build.py", line 132, in run
self.run_command(cmd_name)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
_build_ext.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
self.build_extensions()
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 386, in _check_cuda_version
raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
Rolling back uninstall of quant-cuda
Moving to c:\ai\oobabooga\installer_files\env\lib\site-packages\quant_cuda-0.0.0.dist-info\
from C:\AI\oobabooga\installer_files\env\Lib\site-packages\~uant_cuda-0.0.0.dist-info
Moving to c:\ai\oobabooga\installer_files\env\lib\site-packages\quant_cuda.cp310-win_amd64.pyd
from C:\AI\oobabooga\installer_files\pip-uninstall-ivttdq8a\quant_cuda.cp310-win_amd64.pyd
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> quant-cuda
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
Done!
@pyGisServer no worries about that. It will try to recompile every time you update and since there's a problem with compilation, it fails every time, but the wheel is still installed. Let's try running a model to verify that it works properly.
Let's use the model https://huggingface.co/wcde/llama-7b-4bit-gr128 to check. You can enter it after pressing the L option during installation or by opening cmd_windows.bat
, using cd text-generation-webui
, and then using python download-model.py
This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.
I have repeatedly tried to relizar the installation following the instructions. The problem is that I always get the same errors and although I have individually looked for how to solve some of the errors, I still have not succeeded. During installation, I get the following errors:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed. numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.3 which is incompatible. clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.28.2 which is incompatible.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed. clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.28.2 which is incompatible.
Finally, despite the above errors the installation continues, appearing at the end the following message: