jllllll
commented
1 year ago Not too sure what is going on here. However, it does say Rolling back uninstall of quant-cuda, so you should be fine.
Closed Shark-Eater closed 1 year ago
jllllll
commented
1 year ago Not too sure what is going on here. However, it does say Rolling back uninstall of quant-cuda, so you should be fine.
Shark-Eater
commented
1 year ago Hmm okay. Unfortunately, I think it might be causing an error in the chat functions. When I try to use the dummy message, dummy reply, and replace last reply. They aren't working as intended. :/ Or maybe I don't know how to use it correctly?
levicki
commented
1 year ago It is failing to build quant_cuda package. For that to work you must have Visual Studio build tools (C++ development) and CUDA (the code requires version 11.7 despite 12.1 being the latest because 11.7 is what torch is using).
Really this should fail more graciously — it should fall back to installing a pre-built wheel if it can't build one. Instead it fails to install and also makes it impossible to load models in .safetensors format.
jllllll
commented
1 year ago It is failing to build quant_cuda package. For that to work you must have Visual Studio build tools (C++ development) and CUDA (the code requires version 11.7 despite 12.1 being the latest because 11.7 is what torch is using).
Really this should fail more graciously — it should fall back to installing a pre-built wheel if it can't build one. Instead it fails to install and also makes it impossible to load models in
.safetensorsformat.
That is exactly what it does. It didn't install the wheel in this case because it was already installed. When the quant_cuda package failed to build, it rolled back the uninstall of quant_cuda.
It's possible that this behavior will prevent fully auto-updating gptq on systems without a c++ compiler. In that case, you can probably just add or args.update to line 149. Just bear in mind that it there is potential for breaking a working gptq setup should there be a big change to gptq code.
Shark-Eater
commented
1 year ago @levicki I have the tools downloaded for Visual Studio C++ but not CUDA. What is CUDA? Like another program? It 'works' fine but some things don't work.
@jllllll under what file would I add or args.update ? Also would that be inside the if statement? What kind of breaking are we talking about? I'm somewhat lost here.
jllllll
commented
1 year ago @levicki I have the tools downloaded for Visual Studio C++ but not CUDA. What is CUDA? Like another program? It 'works' fine but some things don't work.
@jllllll under what file would I add or args.update ? Also would that be inside the if statement? What kind of breaking are we talking about? I'm somewhat lost here.
Adding or args.update to webui.py is just to allow for updating GPTQ-for-LLaMa kernels. There haven't been any updates for that, so there isn't any need for it right now. To achieve the same result, you can enter this command in cmd_windows.bat:
python -m pip install https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl --force-reinstall --no-deps@Shark-Eater CUDA toolkit is a general purpose GPU software development kit which you can download and install from here. It is used a lot in all AI projects. However, keep in mind that CUDA version installed must match the version used to build pytorch. If you don't have NVIDIA GPU then you don't need to bother.
levicki
commented
1 year ago @jllllll Yeah well about that... I tried reinstalling like you said but since the last update I am getting this error:
INFO:Loading TheBloke_Wizard-Vicuna-13B-Uncensored-GPTQ...
Traceback (most recent call last):
File "c:\PROGRAMS\OOBABOOGA\text-generation-webui\server.py", line 1045, in <module>
shared.model, shared.tokenizer = load_model(shared.model_name)
File "c:\PROGRAMS\OOBABOOGA\text-generation-webui\modules\models.py", line 95, in load_model
output = load_func(model_name)
File "c:\PROGRAMS\OOBABOOGA\text-generation-webui\modules\models.py", line 153, in huggingface_loader
model = LoaderClass.from_pretrained(Path(f"{shared.args.model_dir}/{model_name}"), low_cpu_mem_usage=True, torch_dtype=torch.bfloat16 if shared.args.bf16 else torch.float16, trust_remote_code=shared.args.trust_remote_code)
File "C:\PROGRAMS\OOBABOOGA\venv\lib\site-packages\transformers\models\auto\auto_factory.py", line 467, in from_pretrained
return model_class.from_pretrained(
File "C:\PROGRAMS\OOBABOOGA\venv\lib\site-packages\transformers\modeling_utils.py", line 2387, in from_pretrained
raise EnvironmentError(
OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory models\TheBloke_Wizard-Vicuna-13B-Uncensored-GPTQ.Your package is installed (and I can run the test_kernel.py), but for some reason it won't load this model (in .safetensors format) anymore. It worked before the latest updates.
Ignore the venv in the path — I tried installing manually into clean venv to make sure it's not a fluke. I get the same error with conda and official one-click installer.
levicki
commented
1 year ago @jllllll Also about this:
When the quant_cuda package failed to build, it rolled back the uninstall of quant_cuda.
My point was more that it shouldn't even try to build it, because you should not expect random people wanting to play with AI chat to have CUDA 11.7 and MSVC on their system, much less know how to set up build environment on Windows. For example, this package won't build without executing vcvarsall.bat and set DISTUTILS_USE_SDK=1 before building. From my own machine which has VS 2022 Professional installed, this build script doesn't seem to detect it at all and it also doesn't seem to detect CUDA and when it does it doesn't check the version but instead tries to build with whatever version it finds.
jllllll
commented
1 year ago @levicki Generally I agree. Not having to compile anything provides a better user experience overall. The reason for not using vcvarsall.bat in the script is that MSVC is typically auto-detected by Python's setuptools. The reasons for it not getting auto-detected are unknown. It works just fine on my system, and I'm even building wheels through GitHub Actions with similar results. As for not detecting CUDA, this needs to be added to the script: set "CUDA_PATH=%INSTALL_ENV_DIR%"
As well as equivalents for Linux and MacOS. I haven't added it yet myself as I wanted to make sure that this doesn't cause any unforeseen issues.
The error you are getting Error no file named pytorch_model.bin is because of how the webui auto-detects gptq model parameters. Add -4bit-128g to the model folder's name. You can also use the old way of specifying the relevant command-line flags in webui.py: --wbits 4 --groupsize 128
levicki
commented
1 year ago @jllllll
Sorry for the off-topic.
The error you are getting Error no file named pytorch_model.bin is because of how the webui auto-detects gptq model parameters.
Thanks for explaining that to me. I didn't notice it in a wiki when I was reading instructions.
The reason for not using
vcvarsall.batin the script is that MSVC is typically auto-detected by Python'ssetuptools
From setuptools\msvc.py:
Known supported compilers:
--------------------------
Microsoft Visual C++ 14.X:
Microsoft Visual C++ Build Tools 2015 (x86, x64, arm)
Microsoft Visual Studio Build Tools 2017 (x86, x64, arm, arm64)
Microsoft Visual Studio Build Tools 2019 (x86, x64, arm, arm64)
This may also support compilers shipped with compatible Visual Studio versions.So no Visual Studio 2022 support in it, that's why it can't find it, and why it insists on me using DISTUTILS_USE_SDK=1 and running vcvarsall.bat.
I am on the latest Visual Studio release (17.6 which is 14.36.32532 for runtime and 19.36.32532 for compiler).
A brief look at their code also gives me the impression that setuptools insists on finding and using the same version of MSC used to build Python itself (in my case MSC v.1929 64 bit (AMD64)) which is ridiculous because VC 2015-2022 runtimes are all compatible and served from a single redistributable nowadays meaning that building with MSC v.1936 shouldn't be a problem.
Anyway, I managed to update the venv to use torch-2.1.0.dev20230520+cu121, torchaudio-2.1.0.dev20230521+cu121, and torchvision-0.16.0.dev20230520+cu121 (note the one day difference for dependencies), and to compile quant_cuda with CUDA 12.1. Now just to disable updates to it and everything will be fine :-)
Shark-Eater
commented
1 year ago @levicki So I do have a Nvidia GPU but how do I know if I need to get the 12.1 or 11.7? How do I disable updates? What specific steps should I take now? I'm lost with very thing 😅😭
@jllllll Should I still try using the command: python -m pip install https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl --force-reinstall --no-deps
Sorry guys, you guys know way more than I know on this stuff. I'm trying to keep up 😅
jllllll
commented
1 year ago @levicki So I do have a Nvidia GPU but how do I know if I need to get the 12.1 or 11.7? How do I disable updates? What specific steps should I take now? I'm lost with very thing 😅😭
@jllllll Should I still try using the command: python -m pip install https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl --force-reinstall --no-deps
Sorry guys, you guys know way more than I know on this stuff. I'm trying to keep up 😅
That command won't hurt anything. At worst, it will just not fix whatever issues you are having. I don't know of any specific reason to upgrade to Cuda 12.1 other than better performance with 40XX GPUs, which you can also get with Cuda 11.8. It's entirely up to you whether you want to change Cuda versions. Here are the commands that I've used before to change versions.
You will need to adjust the path to vcvars64.bat to match your build tools install.
Cuda 12.1:
conda install pytorch[build=py*_cuda12.1*] torchvision torchaudio pytorch-cuda=12.1 cuda-toolkit -c pytorch-nightly -c nvidia/label/cuda-12.1.1 -c nvidia/label/cuda-12.1.0 -c conda-forge
call "C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\Build\vcvars64.bat"
set DISTUTILS_USE_SDK=1
set "CUDA_PATH=%CONDA_PREFIX%"
cd .\text-generation-webui\repositories\GPTQ-for-LLaMa
python -m pip install .
python -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/raw/main/bitsandbytes-0.38.1-py3-none-any.whl --force-reinstall --no-depsThe bistandbytes command at the end is to ensure that you have the latest version as I recently updated it for better 12.x compatibility.
Cuda 11.8:
conda install pytorch[version=2.0.1,build=py*_cuda11.8*] torchvision torchaudio pytorch-cuda=11.8 cuda-toolkit -c pytorch -c nvidia/label/cuda-11.8.0 -c conda-forge
call "C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\Build\vcvars64.bat"
set DISTUTILS_USE_SDK=1
set "CUDA_PATH=%CONDA_PREFIX%"
cd .\text-generation-webui\repositories\GPTQ-for-LLaMa
python -m pip install .@jllllll Thanks for the help.
I created a FR for setuptools (https://github.com/pypa/setuptools/issues/3933), I'd rather no do this manually every time something changes or have to edit scripts and play with git stash.
Shark-Eater
commented
1 year ago @jllllll I updated the Cuda to 11.8 and got and it installed successfully. However, I got more an equal number of errors and it looks like this:
Already up to date.
Collecting git+https://github.com/huggingface/peft@4fd374e80d670781c0d82c96ce94d1215ff23306 (from -r requirements.txt (line 17))
Cloning https://github.com/huggingface/peft (to revision 4fd374e80d670781c0d82c96ce94d1215ff23306) to c:\users\ajket\oobabooga_windows\installer_files\pip-req-build-ijmqoqh9
Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft 'C:\Users\ajket\oobabooga_windows\installer_files\pip-req-build-ijmqoqh9'
Running command git rev-parse -q --verify 'sha^4fd374e80d670781c0d82c96ce94d1215ff23306'
Running command git fetch -q https://github.com/huggingface/peft 4fd374e80d670781c0d82c96ce94d1215ff23306
Running command git checkout -q 4fd374e80d670781c0d82c96ce94d1215ff23306
Resolved https://github.com/huggingface/peft to commit 4fd374e80d670781c0d82c96ce94d1215ff23306
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system != "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system != "Windows"' don't match your environment
Collecting llama-cpp-python==0.1.53
Downloading https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.53/llama_cpp_python-0.1.53-cp310-cp310-win_amd64.whl (255 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 255.5/255.5 kB 7.9 MB/s eta 0:00:00
Requirement already satisfied: accelerate==0.19.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 1)) (0.19.0)
Requirement already satisfied: colorama in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: datasets in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 3)) (2.12.0)
Requirement already satisfied: flexgen==0.1.7 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 4)) (0.1.7)
Requirement already satisfied: gradio_client==0.2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 5)) (0.2.5)
Requirement already satisfied: gradio==3.31.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 6)) (3.31.0)
Requirement already satisfied: markdown in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: numpy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 8)) (1.24.3)
Requirement already satisfied: pandas in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 9)) (2.0.1)
Requirement already satisfied: Pillow>=9.5.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: pyyaml in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 11)) (6.0)
Requirement already satisfied: requests in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: safetensors==0.3.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 13)) (0.3.1)
Requirement already satisfied: sentencepiece in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 14)) (0.1.99)
Requirement already satisfied: transformers==4.29.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 15)) (4.29.2)
Requirement already satisfied: tqdm in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r requirements.txt (line 16)) (4.65.0)
Requirement already satisfied: packaging>=20.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from accelerate==0.19.0->-r requirements.txt (line 1)) (23.1)
Requirement already satisfied: psutil in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from accelerate==0.19.0->-r requirements.txt (line 1)) (5.9.5)
Requirement already satisfied: torch>=1.6.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from accelerate==0.19.0->-r requirements.txt (line 1)) (2.0.1)
Requirement already satisfied: attrs in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (23.1.0)
Requirement already satisfied: pulp in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from flexgen==0.1.7->-r requirements.txt (line 4)) (2.7.0)
Requirement already satisfied: fsspec in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio_client==0.2.5->-r requirements.txt (line 5)) (2023.5.0)
Requirement already satisfied: httpx in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio_client==0.2.5->-r requirements.txt (line 5)) (0.24.0)
Requirement already satisfied: websockets in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio_client==0.2.5->-r requirements.txt (line 5)) (11.0.2)
Requirement already satisfied: typing-extensions in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio_client==0.2.5->-r requirements.txt (line 5)) (4.5.0)
Requirement already satisfied: huggingface-hub>=0.13.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio_client==0.2.5->-r requirements.txt (line 5)) (0.14.1)
Requirement already satisfied: jinja2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (3.1.2)
Requirement already satisfied: altair>=4.2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (5.0.0)
Requirement already satisfied: fastapi in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (0.95.2)
Requirement already satisfied: semantic-version in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (2.10.0)
Requirement already satisfied: markupsafe in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (2.1.1)
Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (2.2.0)
Requirement already satisfied: aiohttp in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (3.8.4)
Requirement already satisfied: pygments>=2.12.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (2.15.1)
Requirement already satisfied: mdit-py-plugins<=0.3.3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (0.3.3)
Requirement already satisfied: orjson in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (3.8.12)
Requirement already satisfied: ffmpy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (0.3.0)
Requirement already satisfied: pydantic in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (1.10.7)
Requirement already satisfied: python-multipart in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (0.0.6)
Requirement already satisfied: matplotlib in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (3.7.1)
Requirement already satisfied: aiofiles in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (23.1.0)
Requirement already satisfied: uvicorn>=0.14.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (0.22.0)
Requirement already satisfied: pydub in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from gradio==3.31.0->-r requirements.txt (line 6)) (0.25.1)
Requirement already satisfied: filelock in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from transformers==4.29.2->-r requirements.txt (line 15)) (3.9.0)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from transformers==4.29.2->-r requirements.txt (line 15)) (0.13.3)
Requirement already satisfied: regex!=2019.12.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from transformers==4.29.2->-r requirements.txt (line 15)) (2023.5.5)
Requirement already satisfied: multiprocess in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.70.14)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.3.6)
Requirement already satisfied: xxhash in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (3.2.0)
Requirement already satisfied: pyarrow>=8.0.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (12.0.0)
Requirement already satisfied: responses<0.19 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from datasets->-r requirements.txt (line 3)) (0.18.0)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from pandas->-r requirements.txt (line 9)) (2.8.2)
Requirement already satisfied: tzdata>=2022.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from pandas->-r requirements.txt (line 9)) (2023.3)
Requirement already satisfied: pytz>=2020.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from pandas->-r requirements.txt (line 9)) (2023.3)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 12)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->-r requirements.txt (line 12)) (1.26.15)
Requirement already satisfied: toolz in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.31.0->-r requirements.txt (line 6)) (0.12.0)
Requirement already satisfied: jsonschema>=3.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from altair>=4.2.0->gradio==3.31.0->-r requirements.txt (line 6)) (4.17.3)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.31.0->-r requirements.txt (line 6)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.31.0->-r requirements.txt (line 6)) (1.3.1)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.31.0->-r requirements.txt (line 6)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.31.0->-r requirements.txt (line 6)) (1.9.2)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from aiohttp->gradio==3.31.0->-r requirements.txt (line 6)) (4.0.2)
Requirement already satisfied: mdurl~=0.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.31.0->-r requirements.txt (line 6)) (0.1.2)
Requirement already satisfied: linkify-it-py<3,>=1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.31.0->-r requirements.txt (line 6)) (2.0.2)
Requirement already satisfied: six>=1.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 9)) (1.16.0)
Requirement already satisfied: sympy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch>=1.6.0->accelerate==0.19.0->-r requirements.txt (line 1)) (1.11.1)
Requirement already satisfied: networkx in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch>=1.6.0->accelerate==0.19.0->-r requirements.txt (line 1)) (2.8.4)
Requirement already satisfied: click>=7.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from uvicorn>=0.14.0->gradio==3.31.0->-r requirements.txt (line 6)) (8.1.3)
Requirement already satisfied: h11>=0.8 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from uvicorn>=0.14.0->gradio==3.31.0->-r requirements.txt (line 6)) (0.14.0)
Requirement already satisfied: starlette<0.28.0,>=0.27.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from fastapi->gradio==3.31.0->-r requirements.txt (line 6)) (0.27.0)
Requirement already satisfied: httpcore<0.18.0,>=0.15.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from httpx->gradio_client==0.2.5->-r requirements.txt (line 5)) (0.17.1)
Requirement already satisfied: sniffio in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from httpx->gradio_client==0.2.5->-r requirements.txt (line 5)) (1.3.0)
Requirement already satisfied: fonttools>=4.22.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.31.0->-r requirements.txt (line 6)) (4.39.4)
Requirement already satisfied: cycler>=0.10 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.31.0->-r requirements.txt (line 6)) (0.11.0)
Requirement already satisfied: pyparsing>=2.3.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.31.0->-r requirements.txt (line 6)) (3.0.9)
Requirement already satisfied: contourpy>=1.0.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.31.0->-r requirements.txt (line 6)) (1.0.7)
Requirement already satisfied: kiwisolver>=1.0.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from matplotlib->gradio==3.31.0->-r requirements.txt (line 6)) (1.4.4)
Requirement already satisfied: anyio<5.0,>=3.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from httpcore<0.18.0,>=0.15.0->httpx->gradio_client==0.2.5->-r requirements.txt (line 5)) (3.6.2)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.31.0->-r requirements.txt (line 6)) (0.19.3)
Requirement already satisfied: uc-micro-py in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.31.0->-r requirements.txt (line 6)) (1.0.2)
Requirement already satisfied: mpmath>=0.19 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sympy->torch>=1.6.0->accelerate==0.19.0->-r requirements.txt (line 1)) (1.2.1)
Requirement already satisfied: flask_cloudflared==0.0.12 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: websockets==11.0.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\api\requirements.txt (line 2)) (11.0.2)
Requirement already satisfied: Flask>=0.8 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.3.2)
Requirement already satisfied: requests in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: itsdangerous>=2.1.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: blinker>=1.6.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.6.2)
Requirement already satisfied: Jinja2>=3.1.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: click>=8.1.3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: Werkzeug>=2.3.3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: colorama in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from click>=8.1.3->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\api\requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: elevenlabs==0.2.* in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.2.15)
Requirement already satisfied: ipython>=7.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (8.13.2)
Requirement already satisfied: requests>=2.20 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: pydantic>=1.10 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.10.7)
Requirement already satisfied: stack-data in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: jedi>=0.16 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: matplotlib-inline in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: colorama in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: pygments>=2.4.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.15.1)
Requirement already satisfied: pickleshare in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: decorator in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: backcall in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: traitlets>=5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: typing-extensions>=4.2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from pydantic>=1.10->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (4.5.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from jedi>=0.16->ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: wcwidth in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: pure-eval in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: executing>=1.2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: asttokens>=2.1.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: six in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions\elevenlabs_tts\requirements.txt (line 1)) (1.16.0)
Requirement already satisfied: deep-translator==1.9.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\google_translate\requirements.txt (line 1)) (1.9.2)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (4.12.2)
Requirement already satisfied: soupsieve>1.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions\google_translate\requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: flask_cloudflared==0.0.12 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\openai\requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: sentence-transformers in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\openai\requirements.txt (line 2)) (2.2.2)
Requirement already satisfied: Flask>=0.8 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2.3.2)
Requirement already satisfied: requests in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: transformers<5.0.0,>=4.6.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (4.29.2)
Requirement already satisfied: torch>=1.6.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: scikit-learn in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (1.2.2)
Requirement already satisfied: nltk in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (3.8.1)
Requirement already satisfied: torchvision in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (0.15.2)
Requirement already satisfied: huggingface-hub>=0.4.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (0.14.1)
Requirement already satisfied: tqdm in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: scipy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (1.10.1)
Requirement already satisfied: numpy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (1.24.3)
Requirement already satisfied: sentencepiece in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (0.1.99)
Requirement already satisfied: Werkzeug>=2.3.3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2.3.4)
Requirement already satisfied: Jinja2>=3.1.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: click>=8.1.3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (1.6.2)
Requirement already satisfied: itsdangerous>=2.1.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: pyyaml>=5.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (6.0)
Requirement already satisfied: fsspec in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (2023.5.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: packaging>=20.9 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (23.1)
Requirement already satisfied: filelock in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (3.9.0)
Requirement already satisfied: sympy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch>=1.6.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch>=1.6.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (2.8.4)
Requirement already satisfied: colorama in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from tqdm->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: regex!=2019.12.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (2023.5.5)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (0.13.3)
Requirement already satisfied: joblib in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from nltk->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (1.2.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: threadpoolctl>=2.0.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from scikit-learn->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (3.1.0)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torchvision->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (9.5.0)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions\openai\requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: mpmath>=0.19 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sympy->torch>=1.6.0->sentence-transformers->-r extensions\openai\requirements.txt (line 2)) (1.2.1)
Requirement already satisfied: ipython in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 1)) (8.13.2)
Requirement already satisfied: num2words in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 2)) (0.5.12)
Requirement already satisfied: omegaconf in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 3)) (2.3.0)
Requirement already satisfied: pydub in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\silero_tts\requirements.txt (line 5)) (6.0)
Requirement already satisfied: matplotlib-inline in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: decorator in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: traitlets>=5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: pygments>=2.4.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.15.1)
Requirement already satisfied: pickleshare in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: backcall in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: colorama in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: jedi>=0.16 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: stack-data in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ipython->-r extensions\silero_tts\requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: docopt>=0.6.2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from num2words->-r extensions\silero_tts\requirements.txt (line 2)) (0.6.2)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from omegaconf->-r extensions\silero_tts\requirements.txt (line 3)) (4.9.3)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from jedi>=0.16->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: wcwidth in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: executing>=1.2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: pure-eval in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: asttokens>=2.1.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: six in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions\silero_tts\requirements.txt (line 1)) (1.16.0)
Collecting git+https://github.com/Uberi/speech_recognition.git@010382b80267f0f7794169fccc8e875ee7da7c19 (from -r extensions\whisper_stt\requirements.txt (line 1))
Cloning https://github.com/Uberi/speech_recognition.git (to revision 010382b80267f0f7794169fccc8e875ee7da7c19) to c:\users\ajket\oobabooga_windows\installer_files\pip-req-build-lqdwqhhj
Running command git clone --filter=blob:none --quiet https://github.com/Uberi/speech_recognition.git 'C:\Users\ajket\oobabooga_windows\installer_files\pip-req-build-lqdwqhhj'
Running command git rev-parse -q --verify 'sha^010382b80267f0f7794169fccc8e875ee7da7c19'
Running command git fetch -q https://github.com/Uberi/speech_recognition.git 010382b80267f0f7794169fccc8e875ee7da7c19
Running command git checkout -q 010382b80267f0f7794169fccc8e875ee7da7c19
Resolved https://github.com/Uberi/speech_recognition.git to commit 010382b80267f0f7794169fccc8e875ee7da7c19
Preparing metadata (setup.py) ... done
Requirement already satisfied: openai-whisper in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 2)) (20230314)
Requirement already satisfied: soundfile in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 3)) (0.12.1)
Requirement already satisfied: ffmpeg in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from -r extensions\whisper_stt\requirements.txt (line 4)) (1.4)
Requirement already satisfied: requests>=2.26.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: tiktoken==0.3.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.3.1)
Requirement already satisfied: numpy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.24.3)
Requirement already satisfied: ffmpeg-python==0.2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.2.0)
Requirement already satisfied: torch in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: tqdm in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: numba in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.57.0)
Requirement already satisfied: more-itertools in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (9.1.0)
Requirement already satisfied: future in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.18.3)
Requirement already satisfied: regex>=2022.1.18 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2023.5.5)
Requirement already satisfied: cffi>=1.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from cffi>=1.0->soundfile->-r extensions\whisper_stt\requirements.txt (line 3)) (2.21)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: idna<4,>=2.5 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (2.0.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from requests>=2.26.0->SpeechRecognition==3.9.0->-r extensions\whisper_stt\requirements.txt (line 1)) (1.26.15)
Requirement already satisfied: llvmlite<0.41,>=0.40.0dev0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from numba->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.40.0)
Requirement already satisfied: filelock in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.9.0)
Requirement already satisfied: typing-extensions in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (4.5.0)
Requirement already satisfied: sympy in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.8.4)
Requirement already satisfied: jinja2 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: colorama in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from tqdm->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from jinja2->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (2.1.1)
Requirement already satisfied: mpmath>=0.19 in c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages (from sympy->torch->openai-whisper->-r extensions\whisper_stt\requirements.txt (line 2)) (1.2.1)
Already up to date.
Processing c:\users\ajket\oobabooga_windows\text-generation-webui\repositories\gptq-for-llama
Preparing metadata (setup.py) ... done
Building wheels for collected packages: quant-cuda
Building wheel for quant-cuda (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [9 lines of output]
running bdist_wheel
running build
running build_ext
C:\Users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] The system cannot find the file specified
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
C:\Users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:388: UserWarning: The detected CUDA version (11.7) has a minor version mismatch with the version that was used to compile PyTorch (11.8). Most likely this shouldn't be a problem.
warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
building 'quant_cuda' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for quant-cuda
Running setup.py clean for quant-cuda
Failed to build quant-cuda
Installing collected packages: quant-cuda
Attempting uninstall: quant-cuda
Found existing installation: quant-cuda 0.0.0
Uninstalling quant-cuda-0.0.0:
Successfully uninstalled quant-cuda-0.0.0
Running setup.py install for quant-cuda ... error
error: subprocess-exited-with-error
× Running setup.py install for quant-cuda did not run successfully.
│ exit code: 1
╰─> [11 lines of output]
running install
C:\Users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_ext
C:\Users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:359: UserWarning: Error checking compiler version for cl: [WinError 2] The system cannot find the file specified
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
C:\Users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\torch\utils\cpp_extension.py:388: UserWarning: The detected CUDA version (11.7) has a minor version mismatch with the version that was used to compile PyTorch (11.8). Most likely this shouldn't be a problem.
warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
building 'quant_cuda' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
Rolling back uninstall of quant-cuda
Moving to c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\quant_cuda-0.0.0.dist-info\
from C:\Users\ajket\oobabooga_windows\installer_files\env\Lib\site-packages\~uant_cuda-0.0.0.dist-info
Moving to c:\users\ajket\oobabooga_windows\installer_files\env\lib\site-packages\quant_cuda.cp310-win_amd64.pyd
from C:\Users\ajket\oobabooga_windows\installer_files\pip-uninstall-dihrzmvn\quant_cuda.cp310-win_amd64.pyd
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> quant-cuda
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
Done!
Press any key to continue . . .@Shark-Eater If you can load 4-bit quantized models and run them on a GPU then you can ignore the error. Otherwise, you would have to run the build for that repo manually as @jllllll explained above.
@jllllll The more I look at this, the more problem with build environment detection seems to lie with pytorch and cpp_extension.py.
For example:
if IS_WINDOWS:
compiler = os.environ.get('CXX', 'cl')
else:
compiler = os.environ.get('CXX', 'c++')Which doesn't even seem to be used later (I see cl hardcoded in ninja build script generation) and:
if IS_WINDOWS:
cl_paths = subprocess.check_output(['where',
'cl']).decode(*SUBPROCESS_DECODE_ARGS).split('\r\n')Which will of course fail if environment is not set beforehand using vcvarsall.bat.
metallewalin
commented
1 year ago @jllllll , @levicki hey people, I have the same issue with different circumstances: My trial to install tfx in miniconda3 and anaconda3 virtuell environments on Windows8.1 failed because the installation took way too long because of backtracking all the verisons of necessary packages. So in another issues in github, it was recommended to to install tfx on WSL on Windows10. I did upgrade my os to W10 and tried many combinations like Ubuntu 22.04 LTS with miniconda3 and python 3.9 and 3.8 Ubuntu 18.04 LTS with miniconda3 and python 3.6 and 3.5(3.5 is deprecated and failed automatically though) However the problem is still there, taking ages and i terminate the process after like at least one and half hours.
newly I tried Ubuntu 20.04 LTS with miniconda3 and python3.9 and I have now the following issue (this is just a snippet of the error part) :
Stored in directory: /home/linuxformlops/.cache/pip/wheels/6c/f8/60/b9e91899dbaf25b6314047d3daee379bdd8d61b1dc3fd5ec7f
Building wheel for crcmod (setup.py) ... done
Created wheel for crcmod: filename=crcmod-1.7-py3-none-any.whl size=18832 sha256=32b618001e7a3c5374c5eeef26e353368053e2fcef3dee527e66570873b2ddf8
Stored in directory: /home/linuxformlops/.cache/pip/wheels/4a/6c/a6/ffdd136310039bf226f2707a9a8e6857be7d70a3fc061f6b36
Building wheel for dill (setup.py) ... done
Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78542 sha256=4c11499a33751999ba67ecc5ed14e979f04159d6c9840e9390f7b05b73fc8cd4
Stored in directory: /home/linuxformlops/.cache/pip/wheels/4f/0b/ce/75d96dd714b15e51cb66db631183ea3844e0c4a6d19741a149
Building wheel for pyfarmhash (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [9 lines of output]
running bdist_wheel
running build
running build_ext
building 'farmhash' extension
creating build
creating build/temp.linux-x86_64-cpython-39
creating build/temp.linux-x86_64-cpython-39/src
gcc -pthread -B /home/linuxformlops/miniconda3/envs/env-MLOPs-39/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /home/linuxformlops/miniconda3/envs/env-MLOPs-39/include -I/home/linuxformlops/miniconda3/envs/env-MLOPs-39/include -fPIC -O2 -isystem /home/linuxformlops/miniconda3/envs/env-MLOPs-39/include -fPIC -I/home/linuxformlops/miniconda3/envs/env-MLOPs-39/include/python3.9 -c src/farmhash.cc -o build/temp.linux-x86_64-cpython-39/src/farmhash.o -O4
error: command 'gcc' failed: No such file or directory
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for pyfarmhash
Running setup.py clean for pyfarmhash
Building wheel for docopt (setup.py) ... done
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13705 sha256=7d43b12375f1aac8139f044a4998478a04db3ef1fad2033662945f329d6cef57
Stored in directory: /home/linuxformlops/.cache/pip/wheels/70/4a/46/1309fc853b8d395e60bafaf1b6df7845bdd82c95fd59dd8d2b
Successfully built google-apitools crcmod dill docopt
Failed to build pyfarmhash
ERROR: Could not build wheels for pyfarmhash, which is required to install pyproject.toml-based projectsI tried to install pyfarmhash but i am having the same error.
So would you please help me out here? or any recommendations with cleary working Python , Linux or Windows OS and TFX versions so that i can try them out? Thanks
levicki
commented
1 year ago @metallewalin You did not install gcc compiler in your Linux distribution, of course it is failing.
In wsl2 shell execute:
sudo apt-get update
sudo apt install build-essentialThen try again.
jllllll
commented
1 year ago @metallewalin Another option for faster operation is to use Mamba.
conda install mamba -c conda-forgeIt is a drop-in alternative to conda, so any command that would use conda can instead use mamba. Example:
mamba install package -c channelMamba is designed to be faster than Conda, though some systems are fast enough that you may not see a difference.
ZedOud
commented
1 year ago What is this:
~uant_cuda
I'm pretty sure that even if this is not the problem it still shouldn't be like that.
jllllll
commented
1 year ago What is this:
~uant_cudaI'm pretty sure that even if this is not the problem it still shouldn't be like that.
That is part of the backup and rollback process when updating a pip package. When uninstalling the existing package, it actually renames everything, in this case to ~uant_cuda, before installing the new version. This is so that the changes can be easily reversed should the new version not install properly.
There is no issue here. It failed to compile quant_cuda and performed a rollback when running the update script. Worst case scenario, quant_cuda was not changed at all. Given that there wasn't any updates to quant_cuda, this is entirely harmless.
metallewalin
commented
1 year ago @levicki Thank you alot. It worked for me.
github-actions[bot]
commented
1 year ago This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.
Describe the bug
It tells me I need Microsoft Visual C++ 14.0 or greater, but I do have the build tools installed. The thing is that the program does run, and I did have a lot of issues getting this to work. So, I want to fix this, so it doesn't become a problem. I'm not good at fixing things, especially when it's this advanced lol.
Is there an existing issue for this?
Reproduction
I click on update_windows.bat and once it gets to "Already up to date" it gives me an error afterwards.
Screenshot
Logs
System Info