oobabooga / one-click-installers

Simplified installers for oobabooga/text-generation-webui.
GNU Affero General Public License v3.0
552 stars 186 forks source link

ModuleNotFoundError: No module named 'llama_inference_offload' #12

Closed theman23290 closed 1 year ago

theman23290 commented 1 year ago

I am trying to run this program in CPU mode. Whenever I try to run the install.bat file it crashed after downloading the assets. I believe there is something with installation it is hanging on. In the installer.bat I am selecting b for the choice and running start-webui.bat results in the ModuleNotFoundError: No module named 'llama_inference_offload' error. If I select a, the install goes according to plan and start-webui.bat starts with no errors. Once I send a prompt though the program crashes because there are no cuda cores because there is no GPU attached. I am attaching some log file I have created to show what the programs are doing while ran.

start-webui.bat python flags: call python server.py --cpu --chat --model vicuna-13b-GPTQ-4bit-128g --wbit 4 --groupsize 128

Running install.bat option b:

WARNING: This script relies on Micromamba which may have issues on some systems when installed under a path with spaces. May also have issues with long paths.

What is your GPU?

A) NVIDIA B) None (I want to run in CPU mode)

Input> Already up to date. Collecting git+https://github.com/huggingface/transformers (from -r requirements.txt (line 15)) Cloning https://github.com/huggingface/transformers to c:\users\senpai\appdata\local\temp\pip-req-build-gkpc8g01 Resolved https://github.com/huggingface/transformers to commit 656e869a4523f6a0ce90b3aacbb05cc8fb5794bb Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Requirement already satisfied: accelerate==0.18.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.18.0) Requirement already satisfied: bitsandbytes==0.37.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 2)) (0.37.2) Requirement already satisfied: datasets in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (2.11.0) Requirement already satisfied: flexgen==0.1.7 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (0.1.7) Requirement already satisfied: gradio==3.24.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (3.24.1) Requirement already satisfied: markdown in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 6)) (3.4.3) Requirement already satisfied: numpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (1.23.5) Collecting numpy Using cached numpy-1.24.2-cp310-cp310-win_amd64.whl (14.8 MB) Requirement already satisfied: peft==0.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 8)) (0.2.0) Requirement already satisfied: requests in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 9)) (2.28.2) Requirement already satisfied: rwkv==0.7.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 10)) (0.7.3) Requirement already satisfied: safetensors==0.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (0.3.0) Requirement already satisfied: sentencepiece in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 12)) (0.1.97) Requirement already satisfied: pyyaml in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 13)) (6.0) Requirement already satisfied: tqdm in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 14)) (4.65.0) Requirement already satisfied: psutil in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (5.9.4) Requirement already satisfied: packaging>=20.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (23.0) Requirement already satisfied: torch>=1.4.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (2.0.0) Requirement already satisfied: pulp in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (2.7.0) Requirement already satisfied: attrs in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (22.2.0) Requirement already satisfied: gradio-client>=0.0.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.0.8) Requirement already satisfied: typing-extensions in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (4.5.0) Requirement already satisfied: aiofiles in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (23.1.0) Requirement already satisfied: pydantic in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (1.10.7) Requirement already satisfied: pandas in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.0.0) Requirement already satisfied: uvicorn in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.21.1) Requirement already satisfied: jinja2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.1.2) Requirement already satisfied: ffmpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.3.0) Requirement already satisfied: aiohttp in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.8.4) Requirement already satisfied: httpx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.23.3) Requirement already satisfied: pillow in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (9.4.0) Requirement already satisfied: semantic-version in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.10.0) Requirement already satisfied: websockets>=10.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (11.0.1) Requirement already satisfied: altair>=4.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (4.2.2) Requirement already satisfied: matplotlib in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.7.1) Requirement already satisfied: python-multipart in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.0.6) Requirement already satisfied: pydub in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.25.1) Requirement already satisfied: markupsafe in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.1.2) Requirement already satisfied: fastapi in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.95.0) Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.2.0) Requirement already satisfied: orjson in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.8.9) Requirement already satisfied: mdit-py-plugins<=0.3.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.3.3) Requirement already satisfied: huggingface-hub>=0.13.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.13.4) Requirement already satisfied: tokenizers>=0.13.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from rwkv==0.7.3->-r requirements.txt (line 10)) (0.13.3) Requirement already satisfied: multiprocess in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.70.14) Requirement already satisfied: pyarrow>=8.0.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (11.0.0) Requirement already satisfied: xxhash in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (3.2.0) Requirement already satisfied: responses<0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.18.0) Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (2023.4.0) Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.3.6) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (3.4) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (1.26.15) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (3.1.0) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (2022.12.7) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm->-r requirements.txt (line 14)) (0.4.6) Requirement already satisfied: filelock in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 15)) (3.11.0) Requirement already satisfied: regex!=2019.12.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 15)) (2023.3.23) Requirement already satisfied: toolz in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.12.0) Requirement already satisfied: entrypoints in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.4) Requirement already satisfied: jsonschema>=3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (4.17.3) Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (1.8.2) Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (4.0.2) Requirement already satisfied: frozenlist>=1.1.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (1.3.3) Requirement already satisfied: aiosignal>=1.1.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (1.3.1) Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (6.0.4) Requirement already satisfied: mdurl~=0.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.1.2) Requirement already satisfied: linkify-it-py<3,>=1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.24.1->-r requirements.txt (line 5)) (2.0.0) Requirement already satisfied: tzdata>=2022.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.24.1->-r requirements.txt (line 5)) (2023.3) Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.24.1->-r requirements.txt (line 5)) (2.8.2) Requirement already satisfied: pytz>=2020.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.24.1->-r requirements.txt (line 5)) (2023.3) Requirement already satisfied: sympy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.11.1) Requirement already satisfied: networkx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (3.1) Requirement already satisfied: starlette<0.27.0,>=0.26.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from fastapi->gradio==3.24.1->-r requirements.txt (line 5)) (0.26.1) Requirement already satisfied: rfc3986[idna2008]<2,>=1.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.24.1->-r requirements.txt (line 5)) (1.5.0) Requirement already satisfied: httpcore<0.17.0,>=0.15.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.24.1->-r requirements.txt (line 5)) (0.16.3) Requirement already satisfied: sniffio in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.24.1->-r requirements.txt (line 5)) (1.3.0) Requirement already satisfied: kiwisolver>=1.0.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (1.4.4) Requirement already satisfied: cycler>=0.10 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (0.11.0) Requirement already satisfied: contourpy>=1.0.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (1.0.7) Requirement already satisfied: fonttools>=4.22.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (4.39.3) Requirement already satisfied: pyparsing>=2.3.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (3.0.9) Requirement already satisfied: click>=7.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from uvicorn->gradio==3.24.1->-r requirements.txt (line 5)) (8.1.3) Requirement already satisfied: h11>=0.8 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from uvicorn->gradio==3.24.1->-r requirements.txt (line 5)) (0.14.0) Requirement already satisfied: anyio<5.0,>=3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpcore<0.17.0,>=0.15.0->httpx->gradio==3.24.1->-r requirements.txt (line 5)) (3.6.2) Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.19.3) Requirement already satisfied: uc-micro-py in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.24.1->-r requirements.txt (line 5)) (1.0.1) Requirement already satisfied: six>=1.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->gradio==3.24.1->-r requirements.txt (line 5)) (1.16.0) Requirement already satisfied: mpmath>=0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.3.0) Installing collected packages: numpy Attempting uninstall: numpy Found existing installation: numpy 1.23.5 Uninstalling numpy-1.23.5: Successfully uninstalled numpy-1.23.5 Successfully installed numpy-1.24.2 Requirement already satisfied: flask_cloudflared==0.0.12 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 1)) (0.0.12) Requirement already satisfied: requests in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: Flask>=0.8 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.2.3) Requirement already satisfied: Jinja2>=3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2) Requirement already satisfied: click>=8.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3) Requirement already satisfied: itsdangerous>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2) Requirement already satisfied: Werkzeug>=2.2.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.2.3) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.4) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from click>=8.0->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6) Requirement already satisfied: MarkupSafe>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Jinja2>=3.0->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2) Requirement already satisfied: elevenlabslib in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.4.1) Requirement already satisfied: soundfile in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 2)) (0.12.1) Requirement already satisfied: sounddevice in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 3)) (0.4.6) Requirement already satisfied: typing in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.7.4.3) Requirement already satisfied: requests in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: numpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.2) Requirement already satisfied: cffi>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1) Requirement already satisfied: pycparser in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.4) Requirement already satisfied: deep-translator==1.9.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\google_translate\requirements.txt (line 1)) (1.9.2) Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (4.12.2) Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: soupsieve>1.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.4) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.4) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: ipython in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 1)) (8.12.0) Requirement already satisfied: num2words in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 2)) (0.5.12) Requirement already satisfied: omegaconf in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 3)) (2.3.0) Requirement already satisfied: pydub in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1) Requirement already satisfied: PyYAML in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0) Requirement already satisfied: decorator in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.1.1) Requirement already satisfied: jedi>=0.16 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.18.2) Requirement already satisfied: traitlets>=5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.9.0) Requirement already satisfied: stack-data in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.6.2) Requirement already satisfied: pygments>=2.4.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.14.0) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6) Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (3.0.38) Requirement already satisfied: backcall in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.0) Requirement already satisfied: pickleshare in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.7.5) Requirement already satisfied: matplotlib-inline in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.1.6) Requirement already satisfied: docopt>=0.6.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from num2words->-r extensions\silero_tts\requirements.txt (line 2)) (0.6.2) Requirement already satisfied: antlr4-python3-runtime==4.9.* in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from omegaconf->-r extensions\silero_tts\requirements.txt (line 3)) (4.9.3) Requirement already satisfied: parso<0.9.0,>=0.8.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jedi>=0.16->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.8.3) Requirement already satisfied: wcwidth in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.6) Requirement already satisfied: pure-eval in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.2) Requirement already satisfied: executing>=1.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.2.0) Requirement already satisfied: asttokens>=2.1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.2.1) Requirement already satisfied: six in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0) Collecting git+https://github.com/Uberi/speech_recognition.git@010382b (from -r extensions\whisper_stt\requirements.txt (line 1)) Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b) to c:\users\senpai\appdata\local\temp\pip-req-build-4ojingrm Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: openai-whisper in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 2)) (20230314) Requirement already satisfied: soundfile in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1) Requirement already satisfied: ffmpeg in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 4)) (1.4) Requirement already satisfied: requests>=2.26.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: numpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.2) Requirement already satisfied: more-itertools in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (9.1.0) Requirement already satisfied: tiktoken==0.3.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.3.1) Requirement already satisfied: ffmpeg-python==0.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.2.0) Requirement already satisfied: torch in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.0.0) Requirement already satisfied: numba in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.56.4) Requirement already satisfied: tqdm in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0) Requirement already satisfied: future in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.18.3) Requirement already satisfied: regex>=2022.1.18 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23) Requirement already satisfied: cffi>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1) Requirement already satisfied: pycparser in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.4) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: setuptools in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (67.6.1) Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.39.1) Collecting numpy Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB) Requirement already satisfied: filelock in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.11.0) Requirement already satisfied: typing-extensions in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0) Requirement already satisfied: sympy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.11.1) Requirement already satisfied: networkx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1) Requirement already satisfied: jinja2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1.2) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6) Requirement already satisfied: MarkupSafe>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jinja2->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.1.2) Requirement already satisfied: mpmath>=0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.3.0) Installing collected packages: numpy Attempting uninstall: numpy Found existing installation: numpy 1.24.2 Uninstalling numpy-1.24.2: Successfully uninstalled numpy-1.24.2 Successfully installed numpy-1.23.5 Running command git clone --filter=blob:none --quiet https://github.com/huggingface/transformers 'C:\Users\senpai\AppData\Local\Temp\pip-req-build-gkpc8g01' ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.2 which is incompatible. Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\Users\senpai\AppData\Local\Temp\pip-req-build-4ojingrm' WARNING: Did not find branch or tag '010382b', assuming revision or ref. Running command git checkout -q 010382b The system cannot find the batch label specified - bandaid

Running start-webui.bat

Starting the web UI...

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

CUDA SETUP: Loading binary C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.dll... C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\bitsandbytes\cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without GPU support. " Loading vicuna-13b-GPTQ-4bit-128g... Traceback (most recent call last): File "C:\Users\senpai\Downloads\oobabooga-windows\text-generation-webui\server.py", line 302, in shared.model, shared.tokenizer = load_model(shared.model_name) File "C:\Users\senpai\Downloads\oobabooga-windows\text-generation-webui\modules\models.py", line 100, in load_model from modules.GPTQ_loader import load_quantized File "C:\Users\senpai\Downloads\oobabooga-windows\text-generation-webui\modules\GPTQ_loader.py", line 14, in import llama_inference_offload ModuleNotFoundError: No module named 'llama_inference_offload' Press any key to continue . . .

Possible installer bug?

Winver: Windows 10 22H2 (Virtualized) System: CPU: Xeon(R) CPU E5-2670 v3 (12 cores virtualized) RAM: 32GB HDD: 256GB

theman23290 commented 1 year ago

Running install.bat option a:

WARNING: This script relies on Micromamba which may have issues on some systems when installed under a path with spaces. May also have issues with long paths.

What is your GPU?

A) NVIDIA B) None (I want to run in CPU mode)

Input> Already up to date. Collecting git+https://github.com/huggingface/transformers (from -r requirements.txt (line 15)) Cloning https://github.com/huggingface/transformers to c:\users\senpai\appdata\local\temp\pip-req-build-dz1v0utq Resolved https://github.com/huggingface/transformers to commit 656e869a4523f6a0ce90b3aacbb05cc8fb5794bb Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Requirement already satisfied: accelerate==0.18.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.18.0) Requirement already satisfied: bitsandbytes==0.37.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 2)) (0.37.2) Requirement already satisfied: datasets in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (2.11.0) Requirement already satisfied: flexgen==0.1.7 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (0.1.7) Requirement already satisfied: gradio==3.24.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (3.24.1) Requirement already satisfied: markdown in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 6)) (3.4.3) Requirement already satisfied: numpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (1.23.5) Collecting numpy Using cached numpy-1.24.2-cp310-cp310-win_amd64.whl (14.8 MB) Requirement already satisfied: peft==0.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 8)) (0.2.0) Requirement already satisfied: requests in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 9)) (2.28.2) Requirement already satisfied: rwkv==0.7.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 10)) (0.7.3) Requirement already satisfied: safetensors==0.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (0.3.0) Requirement already satisfied: sentencepiece in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 12)) (0.1.97) Requirement already satisfied: pyyaml in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 13)) (6.0) Requirement already satisfied: tqdm in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 14)) (4.65.0) Requirement already satisfied: torch>=1.4.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (2.0.0) Requirement already satisfied: psutil in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (5.9.4) Requirement already satisfied: packaging>=20.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 1)) (23.0) Requirement already satisfied: attrs in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (22.2.0) Requirement already satisfied: pulp in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (2.7.0) Requirement already satisfied: orjson in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.8.9) Requirement already satisfied: jinja2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.1.2) Requirement already satisfied: altair>=4.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (4.2.2) Requirement already satisfied: pillow in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (9.4.0) Requirement already satisfied: pydub in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.25.1) Requirement already satisfied: pandas in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.0.0) Requirement already satisfied: aiohttp in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.8.4) Requirement already satisfied: pydantic in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (1.10.7) Requirement already satisfied: markupsafe in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.1.2) Requirement already satisfied: uvicorn in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.21.1) Requirement already satisfied: websockets>=10.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (11.0.1) Requirement already satisfied: matplotlib in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (3.7.1) Requirement already satisfied: gradio-client>=0.0.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.0.8) Requirement already satisfied: huggingface-hub>=0.13.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.13.4) Requirement already satisfied: typing-extensions in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (4.5.0) Requirement already satisfied: mdit-py-plugins<=0.3.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.3.3) Requirement already satisfied: semantic-version in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.10.0) Requirement already satisfied: fastapi in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.95.0) Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (2.2.0) Requirement already satisfied: ffmpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.3.0) Requirement already satisfied: aiofiles in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (23.1.0) Requirement already satisfied: httpx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.23.3) Requirement already satisfied: python-multipart in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from gradio==3.24.1->-r requirements.txt (line 5)) (0.0.6) Requirement already satisfied: tokenizers>=0.13.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from rwkv==0.7.3->-r requirements.txt (line 10)) (0.13.3) Requirement already satisfied: xxhash in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (3.2.0) Requirement already satisfied: pyarrow>=8.0.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (11.0.0) Requirement already satisfied: responses<0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.18.0) Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.3.6) Requirement already satisfied: multiprocess in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.70.14) Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (2023.4.0) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (3.4) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (1.26.15) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (3.1.0) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 9)) (2022.12.7) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm->-r requirements.txt (line 14)) (0.4.6) Requirement already satisfied: regex!=2019.12.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 15)) (2023.3.23) Requirement already satisfied: filelock in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 15)) (3.11.0) Requirement already satisfied: entrypoints in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.4) Requirement already satisfied: jsonschema>=3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (4.17.3) Requirement already satisfied: toolz in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.12.0) Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (6.0.4) Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (1.8.2) Requirement already satisfied: aiosignal>=1.1.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (1.3.1) Requirement already satisfied: frozenlist>=1.1.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (1.3.3) Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.24.1->-r requirements.txt (line 5)) (4.0.2) Requirement already satisfied: mdurl~=0.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.1.2) Requirement already satisfied: linkify-it-py<3,>=1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.24.1->-r requirements.txt (line 5)) (2.0.0) Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.24.1->-r requirements.txt (line 5)) (2.8.2) Requirement already satisfied: tzdata>=2022.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.24.1->-r requirements.txt (line 5)) (2023.3) Requirement already satisfied: pytz>=2020.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->gradio==3.24.1->-r requirements.txt (line 5)) (2023.3) Requirement already satisfied: sympy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.11.1) Requirement already satisfied: networkx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (3.1) Requirement already satisfied: starlette<0.27.0,>=0.26.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from fastapi->gradio==3.24.1->-r requirements.txt (line 5)) (0.26.1) Requirement already satisfied: sniffio in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.24.1->-r requirements.txt (line 5)) (1.3.0) Requirement already satisfied: httpcore<0.17.0,>=0.15.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.24.1->-r requirements.txt (line 5)) (0.16.3) Requirement already satisfied: rfc3986[idna2008]<2,>=1.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpx->gradio==3.24.1->-r requirements.txt (line 5)) (1.5.0) Requirement already satisfied: kiwisolver>=1.0.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (1.4.4) Requirement already satisfied: contourpy>=1.0.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (1.0.7) Requirement already satisfied: cycler>=0.10 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (0.11.0) Requirement already satisfied: pyparsing>=2.3.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (3.0.9) Requirement already satisfied: fonttools>=4.22.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.24.1->-r requirements.txt (line 5)) (4.39.3) Requirement already satisfied: click>=7.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from uvicorn->gradio==3.24.1->-r requirements.txt (line 5)) (8.1.3) Requirement already satisfied: h11>=0.8 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from uvicorn->gradio==3.24.1->-r requirements.txt (line 5)) (0.14.0) Requirement already satisfied: anyio<5.0,>=3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from httpcore<0.17.0,>=0.15.0->httpx->gradio==3.24.1->-r requirements.txt (line 5)) (3.6.2) Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.24.1->-r requirements.txt (line 5)) (0.19.3) Requirement already satisfied: uc-micro-py in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.24.1->-r requirements.txt (line 5)) (1.0.1) Requirement already satisfied: six>=1.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->gradio==3.24.1->-r requirements.txt (line 5)) (1.16.0) Requirement already satisfied: mpmath>=0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 1)) (1.3.0) Installing collected packages: numpy Attempting uninstall: numpy Found existing installation: numpy 1.23.5 Uninstalling numpy-1.23.5: Successfully uninstalled numpy-1.23.5 Successfully installed numpy-1.24.2 Requirement already satisfied: flask_cloudflared==0.0.12 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 1)) (0.0.12) Requirement already satisfied: requests in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: Flask>=0.8 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.2.3) Requirement already satisfied: itsdangerous>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2) Requirement already satisfied: Jinja2>=3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2) Requirement already satisfied: click>=8.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3) Requirement already satisfied: Werkzeug>=2.2.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.2.3) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.4) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from click>=8.0->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6) Requirement already satisfied: MarkupSafe>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from Jinja2>=3.0->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2) Requirement already satisfied: elevenlabslib in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.4.1) Requirement already satisfied: soundfile in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 2)) (0.12.1) Requirement already satisfied: sounddevice in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 3)) (0.4.6) Requirement already satisfied: numpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.24.2) Requirement already satisfied: typing in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.7.4.3) Requirement already satisfied: requests in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: cffi>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (1.15.1) Requirement already satisfied: pycparser in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\elevenlabs_tts\requirements.txt (line 2)) (2.21) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.4) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests->elevenlabslib->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: deep-translator==1.9.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\google_translate\requirements.txt (line 1)) (1.9.2) Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (4.12.2) Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: soupsieve>1.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.4) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.4) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: ipython in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 1)) (8.12.0) Requirement already satisfied: num2words in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 2)) (0.5.12) Requirement already satisfied: omegaconf in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 3)) (2.3.0) Requirement already satisfied: pydub in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1) Requirement already satisfied: PyYAML in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0) Requirement already satisfied: stack-data in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.6.2) Requirement already satisfied: pygments>=2.4.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.14.0) Requirement already satisfied: jedi>=0.16 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.18.2) Requirement already satisfied: decorator in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.1.1) Requirement already satisfied: backcall in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.0) Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (3.0.38) Requirement already satisfied: pickleshare in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.7.5) Requirement already satisfied: matplotlib-inline in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.1.6) Requirement already satisfied: traitlets>=5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.9.0) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6) Requirement already satisfied: docopt>=0.6.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from num2words->-r extensions\silero_tts\requirements.txt (line 2)) (0.6.2) Requirement already satisfied: antlr4-python3-runtime==4.9.* in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from omegaconf->-r extensions\silero_tts\requirements.txt (line 3)) (4.9.3) Requirement already satisfied: parso<0.9.0,>=0.8.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jedi>=0.16->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.8.3) Requirement already satisfied: wcwidth in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.6) Requirement already satisfied: executing>=1.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.2.0) Requirement already satisfied: pure-eval in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.2) Requirement already satisfied: asttokens>=2.1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.2.1) Requirement already satisfied: six in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0) Collecting git+https://github.com/Uberi/speech_recognition.git@010382b (from -r extensions\whisper_stt\requirements.txt (line 1)) Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b) to c:\users\senpai\appdata\local\temp\pip-req-build-w1x1hgqy Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: openai-whisper in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 2)) (20230314) Requirement already satisfied: soundfile in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1) Requirement already satisfied: ffmpeg in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 4)) (1.4) Requirement already satisfied: requests>=2.26.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.28.2) Requirement already satisfied: numpy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.2) Requirement already satisfied: tqdm in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0) Requirement already satisfied: tiktoken==0.3.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.3.1) Requirement already satisfied: ffmpeg-python==0.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.2.0) Requirement already satisfied: torch in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.0.0) Requirement already satisfied: numba in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.56.4) Requirement already satisfied: more-itertools in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (9.1.0) Requirement already satisfied: future in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.18.3) Requirement already satisfied: regex>=2022.1.18 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.3.23) Requirement already satisfied: cffi>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1) Requirement already satisfied: pycparser in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.4) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.1.0) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2022.12.7) Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.39.1) Requirement already satisfied: setuptools in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (67.6.1) Collecting numpy Using cached numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB) Requirement already satisfied: filelock in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.11.0) Requirement already satisfied: typing-extensions in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0) Requirement already satisfied: sympy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.11.1) Requirement already satisfied: networkx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1) Requirement already satisfied: jinja2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1.2) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6) Requirement already satisfied: MarkupSafe>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jinja2->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.1.2) Requirement already satisfied: mpmath>=0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.3.0) Installing collected packages: numpy Attempting uninstall: numpy Found existing installation: numpy 1.24.2 Uninstalling numpy-1.24.2: Successfully uninstalled numpy-1.24.2 Successfully installed numpy-1.23.5 Collecting git+https://github.com/huggingface/transformers (from -r requirements.txt (line 4)) Cloning https://github.com/huggingface/transformers to c:\users\senpai\appdata\local\temp\pip-req-build-4tr9nxhx Resolved https://github.com/huggingface/transformers to commit 656e869a4523f6a0ce90b3aacbb05cc8fb5794bb Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Requirement already satisfied: safetensors==0.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.3.0) Collecting datasets==2.10.1 Using cached datasets-2.10.1-py3-none-any.whl (469 kB) Requirement already satisfied: sentencepiece in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (0.1.97) Requirement already satisfied: accelerate==0.18.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.18.0) Requirement already satisfied: huggingface-hub<1.0.0,>=0.2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.13.4) Requirement already satisfied: pandas in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.0.0) Requirement already satisfied: fsspec[http]>=2021.11.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2023.4.0) Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.3.6) Requirement already satisfied: tqdm>=4.62.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (4.65.0) Requirement already satisfied: requests>=2.19.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (2.28.2) Requirement already satisfied: xxhash in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.2.0) Requirement already satisfied: pyarrow>=6.0.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (11.0.0) Requirement already satisfied: aiohttp in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (3.8.4) Requirement already satisfied: packaging in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (23.0) Requirement already satisfied: numpy>=1.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (1.23.5) Requirement already satisfied: multiprocess in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.70.14) Requirement already satisfied: responses<0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (0.18.0) Requirement already satisfied: pyyaml>=5.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from datasets==2.10.1->-r requirements.txt (line 2)) (6.0) Requirement already satisfied: torch>=1.4.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (2.0.0) Requirement already satisfied: psutil in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from accelerate==0.18.0->-r requirements.txt (line 5)) (5.9.4) Requirement already satisfied: regex!=2019.12.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 4)) (2023.3.23) Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 4)) (0.13.3) Requirement already satisfied: filelock in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from transformers==4.28.0.dev0->-r requirements.txt (line 4)) (3.11.0) Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (4.0.2) Requirement already satisfied: attrs>=17.3.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (22.2.0) Requirement already satisfied: frozenlist>=1.1.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.3) Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (6.0.4) Requirement already satisfied: aiosignal>=1.1.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.3.1) Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (1.8.2) Requirement already satisfied: charset-normalizer<4.0,>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from aiohttp->datasets==2.10.1->-r requirements.txt (line 2)) (3.1.0) Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets==2.10.1->-r requirements.txt (line 2)) (4.5.0) Requirement already satisfied: idna<4,>=2.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (3.4) Requirement already satisfied: certifi>=2017.4.17 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (2022.12.7) Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from requests>=2.19.0->datasets==2.10.1->-r requirements.txt (line 2)) (1.26.15) Requirement already satisfied: sympy in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.11.1) Requirement already satisfied: networkx in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (3.1) Requirement already satisfied: jinja2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (3.1.2) Requirement already satisfied: colorama in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from tqdm>=4.62.1->datasets==2.10.1->-r requirements.txt (line 2)) (0.4.6) Requirement already satisfied: tzdata>=2022.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3) Requirement already satisfied: pytz>=2020.1 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2023.3) Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from pandas->datasets==2.10.1->-r requirements.txt (line 2)) (2.8.2) Requirement already satisfied: six>=1.5 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->datasets==2.10.1->-r requirements.txt (line 2)) (1.16.0) Requirement already satisfied: MarkupSafe>=2.0 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from jinja2->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (2.1.2) Requirement already satisfied: mpmath>=0.19 in c:\users\senpai\downloads\oobabooga-windows\installer_files\env\lib\site-packages (from sympy->torch>=1.4.0->accelerate==0.18.0->-r requirements.txt (line 5)) (1.3.0) Installing collected packages: datasets Attempting uninstall: datasets Found existing installation: datasets 2.11.0 Uninstalling datasets-2.11.0: Successfully uninstalled datasets-2.11.0 Successfully installed datasets-2.10.1 CUDA kernal compilation failed. Will try to install from wheel. Collecting quant-cuda==0.0.0 Using cached https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl (158 kB) Installing collected packages: quant-cuda Successfully installed quant-cuda-0.0.0 Press any key to continue . . .

Running start-webui.bat

Starting the web UI...

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

CUDA SETUP: Loading binary C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.dll... C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\bitsandbytes\cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without GPU support. " Loading vicuna-13b-GPTQ-4bit-128g... Loading model ... C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\safetensors\torch.py:99: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() with safe_open(filename, framework="pt", device=device) as f: C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() return self.fget.get(instance, owner)() C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\storage.py:899: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() storage = cls(wrap_storage=untyped_storage) Done. Loaded the model in 68.84 seconds. Loading the extension "gallery"... Ok. Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch().

But after running a prompt:

Traceback (most recent call last): File "C:\Users\senpai\Downloads\oobabooga-windows\text-generation-webui\modules\callbacks.py", line 66, in gentask ret = self.mfunc(callback=_callback, self.kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\text-generation-webui\modules\text_generation.py", line 224, in generate_with_callback shared.model.generate(kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\utils_contextlib.py", line 115, in decorate_context return func(*args, kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\transformers\generation\utils.py", line 1485, in generate return self.sample( File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\transformers\generation\utils.py", line 2524, in sample outputs = self( File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(*args, *kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\transformers\models\llama\modeling_llama.py", line 687, in forward outputs = self.model( File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(args, kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\transformers\models\llama\modeling_llama.py", line 577, in forward layer_outputs = decoder_layer( File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(*args, kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\transformers\models\llama\modeling_llama.py", line 292, in forward hidden_states, self_attn_weights, present_key_value = self.self_attn( File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(*args, *kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\transformers\models\llama\modeling_llama.py", line 196, in forward query_states = self.q_proj(hidden_states).view(bsz, q_len, self.num_heads, self.head_dim).transpose(1, 2) File "C:\Users\senpai\Downloads\oobabooga-windows\installer_files\env\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(args, kwargs) File "C:\Users\senpai\Downloads\oobabooga-windows\text-generation-webui\repositories\GPTQ-for-LLaMa\quant.py", line 426, in forward quant_cuda.vecquant4matmul(x, self.qweight, y, self.scales, self.qzeros, self.groupsize) RuntimeError: t == DeviceType::CUDA INTERNAL ASSERT FAILED at "G:\F\Projects\AI\text-generation-webui\test\installer_files\env\lib\site-packages\torch\include\c10/cuda/impl/CUDAGuardImpl.h":25, please report a bug to PyTorch. Output generated in 0.87 seconds (0.00 tokens/s, 0 tokens, context 44)

necessities commented 1 year ago

Also getting this issue when installed for cpu

ModuleNotFoundError: No module named 'llama_inference_offload'

More people reporting it here: https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g/discussions/6

IceC00l commented 1 year ago

I am encountering this too (tried on 2 Windows 10 22H2 machines (without GPU / hardware CUDA support - I have 2 Nvidia cards but only 4GB). In both machines I already have a general dev environment present (VS 2022, python 3, nump and more tools installed) so this may influence the installer. I also have noticed that the installer batch file points to a "bandaid" tag which doesn't" exist - I just renamed this to end in order for it to skip the part for GPU builds. Apart from this minor bug which shouldn't affect the build there must be some other issue when building without* GPU support. The offload python module apparently isn't being imported for some reason or being referenced to incorrectly (necessary for CPU mode?). **update - after checking the huggingface discussions it is clear that the version without GPU support doesn't install properly and won't work due incorrect model and setup for non GPU builds. The method with new powershell script [iex (irm vicuna.tb.ag)] from https://www.youtube.com/watch?v=d4dk_7FptXk works for CPU only support (ggml) and references the correct model files. The important thing is to download the correct model file(s) for your type of build, if CPU (one bin file) or GPU (.pt or safetensor files) and have the env prepped for that type (CPU or GPU).

github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.