oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.52k stars 5.31k forks source link

Installation issues: TypeError: expected string or bytes-like object #1249

Closed Andie-Squirrel closed 1 year ago

Andie-Squirrel commented 1 year ago

Describe the bug

I have been running into issues with running the start-webuil.bat file. After running install.bat to upgrade, I get a TypeError and the installer halts. Prior to this, after selecting a model and inputting a prompt the program ran into another error with torch and bitsandbytes. After following the instructions in the comments to run pip install -i https://test.pypi.org/simple/ bitsandbytes-cuda113, I re-ran the webui and got this: image

and the log:

Starting the web UI... Traceback (most recent call last): File "A:\oogabooga\oobabooga-windows\oobabooga-windows\text-generation-webui\server.py", line 28, in <module> from modules import api, chat, shared, training, ui File "A:\oogabooga\oobabooga-windows\oobabooga-windows\text-generation-webui\modules\training.py", line 12, in <module> from peft import (LoraConfig, get_peft_model, get_peft_model_state_dict, File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\peft\__init__.py", line 22, in <module> from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING, PEFT_TYPE_TO_CONFIG_MAPPING, get_peft_config, get_peft_model File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\peft\mapping.py", line 16, in <module> from .peft_model import ( File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\peft\peft_model.py", line 31, in <module> from .tuners import AdaLoraModel, LoraModel, PrefixEncoder, PromptEmbedding, PromptEncoder File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\peft\tuners\__init__.py", line 20, in <module> from .lora import LoraConfig, LoraModel File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\peft\tuners\lora.py", line 39, in <module> import bitsandbytes as bnb File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\bitsandbytes\__init__.py", line 6, in <module> from .nn import modules File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\bitsandbytes\nn\__init__.py", line 5, in <module> from .modules import StableEmbedding, Linear8bit, Linear8bitLt, Int8Params File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\bitsandbytes\nn\modules.py", line 15, in <module> from bitsandbytes.optim import GlobalOptimManager File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\bitsandbytes\optim\__init__.py", line 6, in <module> from bitsandbytes.cextension import COMPILED_WITH_CUDA File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\bitsandbytes\cextension.py", line 5, in <module> lib = ct.cdll.LoadLibrary(os.path.dirname(__file__) + '/libbitsandbytes.so') File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\ctypes\__init__.py", line 452, in LoadLibrary return self._dlltype(name) File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\ctypes\__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: [WinError 193] %1 is not a valid Win32 application Press any key to continue . . .

To fix this, I ran the installer which yielded the log I will include in the Logs section.

Additionally, another possible cause for this is that I have two installations of Python (3.9 and 3.10), but both are added to PATH.

This may be a duplicate of https://github.com/oobabooga/text-generation-webui/issues/1037#issue-1661748221

Is there an existing issue for this?

Reproduction

Running install.bat in the oobabooga-windows directory.

Screenshot

image image

Logs

WARNING: This script relies on Micromamba which may have issues on some systems when installed under a path with spaces.
         May also have issues with long paths.

What is your GPU?

A) NVIDIA
B) None (I want to run in CPU mode)

Input> A
Cloning into 'text-generation-webui'...
remote: Enumerating objects: 5827, done.
remote: Counting objects: 100% (162/162), done.
remote: Compressing objects: 100% (106/106), done.
remote: Total 5827 (delta 91), reused 115 (delta 56), pack-reused 5665
Receiving objects: 100% (5827/5827), 2.18 MiB | 1.13 MiB/s, done.
Resolving deltas: 100% (3857/3857), done.
Collecting bitsandbytes==0.37.2
  Using cached https://github.com/jllllll/bitsandbytes-windows-webui/raw/main/bitsandbytes-0.37.2-py3-none-any.whl (13.1 MB)
Collecting git+https://github.com/huggingface/peft (from -r requirements.txt (line 14))
  Cloning https://github.com/huggingface/peft to c:\users\[name]\appdata\local\temp\pip-req-build-5z9tmhcf
  Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft 'C:\Users\[name]\AppData\Local\Temp\pip-req-build-5z9tmhcf'
  Resolved https://github.com/huggingface/peft to commit b21559e042555a8370f4b3cf1ad581c45291cf15
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system != "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system != "Windows"' don't match your environment
Collecting llama-cpp-python==0.1.33
  Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.33/llama_cpp_python-0.1.33-cp310-cp310-win_amd64.whl (106 kB)
     ---------------------------------------- 106.9/106.9 kB 773.5 kB/s eta 0:00:00
Requirement already satisfied: accelerate==0.18.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.18.0)
Requirement already satisfied: datasets in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 2)) (2.10.1)
Collecting datasets
  Using cached datasets-2.11.0-py3-none-any.whl (468 kB)
Requirement already satisfied: flexgen==0.1.7 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (0.1.7)
Requirement already satisfied: gradio==3.25 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (3.25.0)
Requirement already satisfied: markdown in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (3.4.3)
Requirement already satisfied: numpy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 6)) (1.23.5)
Collecting numpy
  Using cached numpy-1.24.2-cp310-cp310-win_amd64.whl (14.8 MB)
Requirement already satisfied: Pillow>=9.5.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (9.5.0)
Requirement already satisfied: requests in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 8)) (2.28.2)
Requirement already satisfied: rwkv==0.7.3 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 9)) (0.7.3)
Requirement already satisfied: safetensors==0.3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 10)) (0.3.0)
Requirement already satisfied: sentencepiece in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (0.1.98)
Requirement already satisfied: pyyaml in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 12)) (6.0)
Requirement already satisfied: tqdm in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 13)) (4.65.0)
Requirement already satisfied: transformers==4.28.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 15)) (4.28.0)
Requirement already satisfied: torch>=1.4.0 in c:\users\[name]\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: psutil in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (5.9.4)
Requirement already satisfied: packaging>=20.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (23.0)
Requirement already satisfied: attrs in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 3)) (22.2.0)
Requirement already satisfied: pulp in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 3)) (2.7.0)
Requirement already satisfied: python-multipart in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.0.6)
Requirement already satisfied: jinja2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (3.1.2)
Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (2.2.0)
Requirement already satisfied: semantic-version in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (2.10.0)
Requirement already satisfied: matplotlib in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (3.7.1)
Requirement already satisfied: orjson in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (3.8.10)
Requirement already satisfied: uvicorn in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.21.1)
Requirement already satisfied: pydantic in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (1.10.7)
Requirement already satisfied: pandas in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (2.0.0)
Requirement already satisfied: gradio-client>=0.0.8 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.0.8)
Requirement already satisfied: huggingface-hub>=0.13.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.13.4)
Requirement already satisfied: fastapi in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.95.0)
Requirement already satisfied: websockets>=10.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (11.0.1)
Requirement already satisfied: ffmpy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.3.0)
Requirement already satisfied: markupsafe in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (2.1.2)
Requirement already satisfied: pydub in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: aiohttp in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (3.8.4)
Requirement already satisfied: aiofiles in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (23.1.0)
Requirement already satisfied: typing-extensions in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (4.5.0)
Requirement already satisfied: httpx in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.23.3)
Requirement already satisfied: altair>=4.2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (4.2.2)
Requirement already satisfied: mdit-py-plugins<=0.3.3 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.25->-r requirements.txt (line 4)) (0.3.3)
Requirement already satisfied: tokenizers>=0.13.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from rwkv==0.7.3->-r requirements.txt (line 9)) (0.13.3)
Requirement already satisfied: regex!=2019.12.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 15)) (2023.3.23)
Requirement already satisfied: filelock in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 15)) (3.11.0)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 2)) (0.3.6)
Requirement already satisfied: xxhash in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 2)) (3.2.0)
Requirement already satisfied: responses<0.19 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 2)) (0.18.0)
Requirement already satisfied: fsspec[http]>=2021.11.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 2)) (2023.4.0)
Requirement already satisfied: multiprocess in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 2)) (0.70.14)
Requirement already satisfied: pyarrow>=8.0.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 2)) (11.0.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 8)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 8)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 8)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 8)) (3.4)
Requirement already satisfied: colorama in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm->-r requirements.txt (line 13)) (0.4.6)
Requirement already satisfied: toolz in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.25->-r requirements.txt (line 4)) (0.12.0)
Requirement already satisfied: entrypoints in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.25->-r requirements.txt (line 4)) (0.4)
Requirement already satisfied: jsonschema>=3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.25->-r requirements.txt (line 4)) (4.17.3)
Requirement already satisfied: yarl<2.0,>=1.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.25->-r requirements.txt (line 4)) (1.8.2)
Requirement already satisfied: aiosignal>=1.1.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.25->-r requirements.txt (line 4)) (1.3.1)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.25->-r requirements.txt (line 4)) (4.0.2)
Requirement already satisfied: frozenlist>=1.1.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.25->-r requirements.txt (line 4)) (1.3.3)
Requirement already satisfied: multidict<7.0,>=4.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.25->-r requirements.txt (line 4)) (6.0.4)
Requirement already satisfied: mdurl~=0.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.25->-r requirements.txt (line 4)) (0.1.2)
Requirement already satisfied: linkify-it-py<3,>=1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.25->-r requirements.txt (line 4)) (2.0.0)
Requirement already satisfied: pytz>=2020.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.25->-r requirements.txt (line 4)) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.25->-r requirements.txt (line 4)) (2023.3)
Requirement already satisfied: python-dateutil>=2.8.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.25->-r requirements.txt (line 4)) (2.8.2)
Requirement already satisfied: networkx in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (3.1)
Requirement already satisfied: sympy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.11.1)
Requirement already satisfied: starlette<0.27.0,>=0.26.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from fastapi->gradio==3.25->-r requirements.txt (line 4)) (0.26.1)
Requirement already satisfied: httpcore<0.17.0,>=0.15.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.25->-r requirements.txt (line 4)) (0.16.3)
Requirement already satisfied: sniffio in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.25->-r requirements.txt (line 4)) (1.3.0)
Requirement already satisfied: rfc3986[idna2008]<2,>=1.3 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.25->-r requirements.txt (line 4)) (1.5.0)
Requirement already satisfied: cycler>=0.10 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.25->-r requirements.txt (line 4)) (0.11.0)
Requirement already satisfied: pyparsing>=2.3.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.25->-r requirements.txt (line 4)) (3.0.9)
Requirement already satisfied: contourpy>=1.0.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.25->-r requirements.txt (line 4)) (1.0.7)
Requirement already satisfied: kiwisolver>=1.0.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.25->-r requirements.txt (line 4)) (1.4.4)
Requirement already satisfied: fonttools>=4.22.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.25->-r requirements.txt (line 4)) (4.39.3)
Requirement already satisfied: click>=7.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from uvicorn->gradio==3.25->-r requirements.txt (line 4)) (8.1.3)
Requirement already satisfied: h11>=0.8 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from uvicorn->gradio==3.25->-r requirements.txt (line 4)) (0.14.0)
Requirement already satisfied: anyio<5.0,>=3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from httpcore<0.17.0,>=0.15.0->httpx->gradio==3.25->-r requirements.txt (line 4)) (3.6.2)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.25->-r requirements.txt (line 4)) (0.19.3)
Requirement already satisfied: uc-micro-py in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.25->-r requirements.txt (line 4)) (1.0.1)
Requirement already satisfied: six>=1.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->gradio==3.25->-r requirements.txt (line 4)) (1.16.0)
Requirement already satisfied: mpmath>=0.19 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.3.0)
Installing collected packages: numpy, datasets
  Attempting uninstall: numpy
    Found existing installation: numpy 1.23.5
    Uninstalling numpy-1.23.5:
      Successfully uninstalled numpy-1.23.5
  Attempting uninstall: datasets
    Found existing installation: datasets 2.10.1
    Uninstalling datasets-2.10.1:
      Successfully uninstalled datasets-2.10.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.2 which is incompatible.
Successfully installed datasets-2.11.0 numpy-1.24.2
Requirement already satisfied: flask_cloudflared==0.0.12 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: Flask>=0.8 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.2.3)
Requirement already satisfied: requests in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.28.2)
Requirement already satisfied: itsdangerous>=2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: Werkzeug>=2.2.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.2.3)
Requirement already satisfied: Jinja2>=3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: click>=8.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: certifi>=2017.4.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.4)
Requirement already satisfied: colorama in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from click>=8.0->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from Jinja2>=3.0->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: elevenlabslib in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.4.2)
Requirement already satisfied: soundfile in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 2)) (0.12.1)
Requirement already satisfied: sounddevice in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 3)) (0.4.6)
Requirement already satisfied: requests in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.28.2)
Requirement already satisfied: typing in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.7.4.3)
Requirement already satisfied: numpy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.2)
Requirement already satisfied: cffi>=1.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1)
Requirement already satisfied: pycparser in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21)
Requirement already satisfied: certifi>=2017.4.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: deep-translator==1.9.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\google_translate\requirements.txt (line 1)) (1.9.2)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (4.12.2)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.28.2)
Requirement already satisfied: soupsieve>1.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.4)
Requirement already satisfied: charset-normalizer<4,>=2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: ipython in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 1)) (8.12.0)
Requirement already satisfied: num2words in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 2)) (0.5.12)
Requirement already satisfied: omegaconf in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 3)) (2.3.0)
Requirement already satisfied: pydub in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0)
Requirement already satisfied: pickleshare in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: jedi>=0.16 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: pygments>=2.4.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.14.0)
Requirement already satisfied: decorator in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: backcall in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: stack-data in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: traitlets>=5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: matplotlib-inline in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: colorama in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: docopt>=0.6.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from num2words->-r extensions\silero_tts\requirements.txt (line 2)) (0.6.2)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from omegaconf->-r extensions\silero_tts\requirements.txt (line 3)) (4.9.3)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from jedi>=0.16->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: wcwidth in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: asttokens>=2.1.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: pure-eval in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: executing>=1.2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: six in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0)
Collecting git+https://github.com/Uberi/speech_recognition.git@010382b80267f0f7794169fccc8e875ee7da7c19 (from -r extensions\whisper_stt\requirements.txt (line 1))
  Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b80267f0f7794169fccc8e875ee7da7c19) to c:\users\[name]\appdata\local\temp\pip-req-build-m0wk9o_e
  Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\Users\[name]\AppData\Local\Temp\pip-req-build-m0wk9o_e'
  Running command git rev-parse -q --verify 'sha^010382b80267f0f7794169fccc8e875ee7da7c19'
  Running command git fetch -q https://github.com/Uberi/speech_recognition.git 010382b80267f0f7794169fccc8e875ee7da7c19
  Running command git checkout -q 010382b80267f0f7794169fccc8e875ee7da7c19
  Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b80267f0f7794169fccc8e875ee7da7c19
  Preparing metadata (setup.py) ... done
Requirement already satisfied: openai-whisper in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 2)) (20230314)
Requirement already satisfied: soundfile in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1)
Requirement already satisfied: ffmpeg in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 4)) (1.4)
Requirement already satisfied: requests>=2.26.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.28.2)
Requirement already satisfied: ffmpeg-python==0.2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.2.0)
Requirement already satisfied: more-itertools in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (9.1.0)
Requirement already satisfied: numpy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.2)
Requirement already satisfied: tqdm in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: tiktoken==0.3.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.3.1)
Requirement already satisfied: numba in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.56.4)
Requirement already satisfied: torch in c:\users\[name]\appdata\roaming\python\python310\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: future in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.18.3)
Requirement already satisfied: regex>=2022.1.18 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23)
Requirement already satisfied: cffi>=1.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21)
Requirement already satisfied: charset-normalizer<4,>=2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.39.1)
Collecting numpy
  Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
Requirement already satisfied: setuptools in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (67.6.1)
Requirement already satisfied: filelock in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.11.0)
Requirement already satisfied: networkx in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1)
Requirement already satisfied: typing-extensions in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: jinja2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: sympy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: colorama in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from jinja2->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.3.0)
Installing collected packages: numpy
  Attempting uninstall: numpy
    Found existing installation: numpy 1.24.2
    Uninstalling numpy-1.24.2:
      Successfully uninstalled numpy-1.24.2
Successfully installed numpy-1.23.5
Cloning into 'GPTQ-for-LLaMa'...
remote: Enumerating objects: 814, done.
remote: Counting objects: 100% (414/414), done.
remote: Compressing objects: 100% (30/30), done.
remote: Total 814 (delta 396), reused 384 (delta 384), pack-reused 400Receiving objects:  93% (758/814), 388.00 KiB | 74Receiving objects: 100% (814/814), 467.32 KiB | 816.00 KiB/s, done.

Resolving deltas: 100% (494/494), done.
Requirement already satisfied: safetensors==0.3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.3.0)
Collecting datasets==2.10.1
  Using cached datasets-2.10.1-py3-none-any.whl (469 kB)
Requirement already satisfied: sentencepiece in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (0.1.98)
Requirement already satisfied: transformers==4.28.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (4.28.0)
Requirement already satisfied: accelerate==0.18.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.18.0)
Requirement already satisfied: requests>=2.19.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.28.2)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.3.6)
Requirement already satisfied: pyyaml>=5.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (6.0)
Requirement already satisfied: tqdm>=4.62.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: packaging in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (23.0)
Requirement already satisfied: xxhash in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.2.0)
Requirement already satisfied: numpy>=1.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (1.23.5)
Requirement already satisfied: aiohttp in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.8.4)
Requirement already satisfied: pyarrow>=6.0.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (11.0.0)
Requirement already satisfied: pandas in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: multiprocess in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.70.14)
Requirement already satisfied: fsspec[http]>=2021.11.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2023.4.0)
Requirement already satisfied: responses<0.19 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.18.0)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.13.4)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (0.13.3)
Requirement already satisfied: filelock in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (3.11.0)
Requirement already satisfied: regex!=2019.12.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0->-r requirements.txt (line 4)) (2023.3.23)
Requirement already satisfied: torch>=1.4.0 in c:\users\[name]\appdata\roaming\python\python310\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: psutil in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (5.9.4)
Requirement already satisfied: multidict<7.0,>=4.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (6.0.4)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (3.1.0)
Requirement already satisfied: frozenlist>=1.1.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.3)
Requirement already satisfied: yarl<2.0,>=1.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.8.2)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (4.0.2)
Requirement already satisfied: attrs>=17.3.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (22.2.0)
Requirement already satisfied: aiosignal>=1.1.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets==2.10.1->-r requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (3.4)
Requirement already satisfied: sympy in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.11.1)
Requirement already satisfied: jinja2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (3.1.2)
Requirement already satisfied: networkx in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (3.1)
Requirement already satisfied: colorama in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm>=4.62.1->datasets==2.10.1->-r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: pytz>=2020.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3)
Requirement already satisfied: python-dateutil>=2.8.2 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2.8.2)
Requirement already satisfied: six>=1.5 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->datasets==2.10.1->-r requirements.txt (line 2)) (1.16.0)
Requirement already satisfied: MarkupSafe>=2.0 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from jinja2->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in a:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.3.0)
Installing collected packages: datasets
  Attempting uninstall: datasets
    Found existing installation: datasets 2.11.0
    Uninstalling datasets-2.11.0:
      Successfully uninstalled datasets-2.11.0
Successfully installed datasets-2.10.1
No CUDA runtime is found, using CUDA_HOME='C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.7'
running install
A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
running bdist_egg
running egg_info
creating quant_cuda.egg-info
writing quant_cuda.egg-info\PKG-INFO
writing dependency_links to quant_cuda.egg-info\dependency_links.txt
writing top-level names to quant_cuda.egg-info\top_level.txt
writing manifest file 'quant_cuda.egg-info\SOURCES.txt'
reading manifest file 'quant_cuda.egg-info\SOURCES.txt'
writing manifest file 'quant_cuda.egg-info\SOURCES.txt'
installing library code to build\bdist.win-amd64\egg
running install_lib
running build_ext
C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] The system cannot find the file specified
  warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\text-generation-webui\repositories\GPTQ-for-LLaMa\setup_cuda.py", line 4, in <module>
    setup(
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\__init__.py", line 108, in setup
    return distutils.core.setup(**attrs)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
    return run_commands(dist)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
    dist.run_commands()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
    self.run_command(cmd)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\dist.py", line 1221, in run_command
    super().run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\install.py", line 74, in run
    self.do_egg_install()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\install.py", line 123, in do_egg_install
    self.run_command('bdist_egg')
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
    self.distribution.run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\dist.py", line 1221, in run_command
    super().run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\bdist_egg.py", line 164, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\bdist_egg.py", line 150, in call_command
    self.run_command(cmdname)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
    self.distribution.run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\dist.py", line 1221, in run_command
    super().run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\install_lib.py", line 11, in run
    self.build()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\command\install_lib.py", line 111, in build
    self.run_command('build_ext')
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
    self.distribution.run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\dist.py", line 1221, in run_command
    super().run_command(command)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
    cmd_obj.run()
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
    _build_ext.run(self)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 345, in run
    self.build_extensions()
  File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
    _check_cuda_version(compiler_name, compiler_version)
  File "C:\Users\[name]\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 383, in _check_cuda_version
    torch_cuda_version = packaging.version.parse(torch.version.cuda)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\pkg_resources\_vendor\packaging\version.py", line 52, in parse
    return Version(version)
  File "A:\oogabooga\oobabooga-windows\oobabooga-windows\installer_files\env\lib\site-packages\pkg_resources\_vendor\packaging\version.py", line 195, in __init__
    match = self._regex.search(version)
TypeError: expected string or bytes-like object
Press any key to continue . . .

System Info

Running Windows10, NVidia RTX 3080Ti
mrvirus9898 commented 1 year ago

Looks like Bits and Bytes issue. See

https://github.com/oobabooga/text-generation-webui/issues/1068#issuecomment-1504869445 https://github.com/oobabooga/text-generation-webui/issues/1068#issuecomment-1506107242

Basically you will need a different bitsandbytes file, or need to edit the existing file to be correct. Also see: Install bitsandbytes for 8bit support (skip this on Linux) Install bitsandbytes (Windows only)

Download these 2 dll files: https://github.com/DeXtmL/bitsandbytes-win-prebuilt/raw/main/libbitsandbytes_cpu.dll https://github.com/DeXtmL/bitsandbytes-win-prebuilt/raw/main/libbitsandbytes_cuda116.dll Move those files into C:\Users\xxx\miniconda3\envs\textgen\lib\site-packages\bitsandbytes\ Now edit bitsandbytes\cuda_setup\main.py with these: Change ct.cdll.LoadLibrary(binary_path) to ct.cdll.LoadLibrary(str(binary_path)) two times in the file. Then replace if not torch.cuda.is_available(): return 'libsbitsandbytes_cpu.so', None, None, None, None with if torch.cuda.is_available(): return 'libbitsandbytes_cuda116.dll', None, None, None, None

from https://rentry.org/llama-tard-v2#bonus-3-4bit-llama-basic-setup

Andie-Squirrel commented 1 year ago

Hey MrVirus, thank you very much. I was wondering if bitsandbytes was the source of the problem. Appreciate your detailed solution, I will try it and report back if it works.

Andie-Squirrel commented 1 year ago

It appears I do not have a 'miniconda3' directory in my C:\Users[name]\ folder. Do I need to have miniconda installed?

Andie-Squirrel commented 1 year ago

Looks like Bits and Bytes issue. See

#1068 (comment) #1068 (comment)

Basically you will need a different bitsandbytes file, or need to edit the existing file to be correct. Also see: Install bitsandbytes for 8bit support (skip this on Linux) Install bitsandbytes (Windows only)

Download these 2 dll files: https://github.com/DeXtmL/bitsandbytes-win-prebuilt/raw/main/libbitsandbytes_cpu.dll https://github.com/DeXtmL/bitsandbytes-win-prebuilt/raw/main/libbitsandbytes_cuda116.dll Move those files into C:\Users\xxx\miniconda3\envs\textgen\lib\site-packages\bitsandbytes Now edit bitsandbytes\cuda_setup\main.py with these: Change ct.cdll.LoadLibrary(binary_path) to ct.cdll.LoadLibrary(str(binary_path)) two times in the file. Then replace if not torch.cuda.is_available(): return 'libsbitsandbytes_cpu.so', None, None, None, None with if torch.cuda.is_available(): return 'libbitsandbytes_cuda116.dll', None, None, None, None

from https://rentry.org/llama-tard-v2#bonus-3-4bit-llama-basic-setup

I have been searching but I don't believe I have the required directory. If this specifically is an issue with an unrelated piece of software, should this be closed as it doesn't relate to oobabooga?

Andie-Squirrel commented 1 year ago

Alright, it's been fixed for me after figuring out where the libbitsandbytes_cuda116.dll belongs. Still having an issue with CUDA but that's a different issue entirely.