search

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.52k stars 5.31k forks source link

CUDA extension not installed. #2924

Closed sra-tatata closed 1 year ago

sra-tatata commented 1 year ago

Describe the bug

Fresh install running only on CPU radically slow For example "write hello world in C" Output generated in 67.46 seconds (0.76 tokens/s, 51 tokens, context 35, seed 1601192190)

#include <stdio.h>

int main() {
  printf("Hello, World!\n"); // print "hello world" to console

  return 0; // indicate successful program execution 
}

Is there an existing issue for this?

Reproduction

Fresh installation

Screenshot

No response

Logs

PyTorch version: 2.0.1+cu117
Is debug build: False
CUDA used to build PyTorch: 11.7
ROCM used to build PyTorch: N/A

OS: Debian GNU/Linux 11 (bullseye) (x86_64)
GCC version: (Debian 10.2.1-6) 10.2.1 20210110
Clang version: Could not collect
CMake version: version 3.25.0
Libc version: glibc-2.31

Python version: 3.10.11 (main, May 16 2023, 00:28:57) [GCC 11.2.0] (64-bit runtime)
Python platform: Linux-5.10.0-21-amd64-x86_64-with-glibc2.31
Is CUDA available: True
CUDA runtime version: 11.7.64
CUDA_MODULE_LOADING set to: LAZY
GPU models and configuration: GPU 0: NVIDIA GeForce RTX 3060
Nvidia driver version: 530.30.02
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architektura:                    x86_64
Tryb(y) pracy CPU:               32-bit, 64-bit
Kolejność bajtów:                Little Endian
Rozmiary adresów:                39 bits physical, 48 bits virtual
CPU:                             16
Lista aktywnych CPU:             0-15
Wątków na rdzeń:                 2
Rdzeni na gniazdo:               8
Gniazd:                          1
Węzłów NUMA:                     1
ID producenta:                   GenuineIntel
Rodzina CPU:                     6
Model:                           167
Nazwa modelu:                    11th Gen Intel(R) Core(TM) i7-11700F @ 2.50GHz
Wersja:                          1
CPU MHz:                         4029.813
CPU max MHz:                     4900,0000
CPU min MHz:                     800,0000
BogoMIPS:                        4992.00
Wirtualizacja:                   VT-x
Cache L1d:                       384 KiB
Cache L1i:                       256 KiB
Cache L2:                        4 MiB
Cache L3:                        16 MiB
Procesory węzła NUMA 0:          0-15
Vulnerability Itlb multihit:     Not affected
Vulnerability L1tf:              Not affected
Vulnerability Mds:               Not affected
Vulnerability Meltdown:          Not affected
Vulnerability Mmio stale data:   Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable
Vulnerability Retbleed:          Mitigation; Enhanced IBRS
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Not affected
Flagi:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities

Versions of relevant libraries:
[pip3] numpy==1.24.4
[pip3] torch==2.0.1+cu117
[pip3] torchaudio==2.0.2+cu117
[pip3] torchvision==0.15.2+cu117
[conda] numpy                     1.24.4                   pypi_0    pypi
[conda] torch                     2.0.1+cu117              pypi_0    pypi
[conda] torchaudio                2.0.2+cu117              pypi_0    pypi
[conda] torchvision               0.15.2+cu117             pypi_0    pypi

System Info

Debian 11, NVIDIA GeForce RTX 3060
sra-tatata commented 1 year ago 
 ./update_linux.sh 
Już aktualne.
Found existing installation: peft 0.4.0.dev0
Uninstalling peft-0.4.0.dev0:
  Successfully uninstalled peft-0.4.0.dev0
Uninstalled peft
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/huggingface/peft@03eb378eb914fbee709ff7c86ba5b1d033b89524 (from -r requirements.txt (line 19))
  Cloning https://github.com/huggingface/peft (to revision 03eb378eb914fbee709ff7c86ba5b1d033b89524) to /tmp/pip-req-build-dluqdo4r
  Running command git clone --filter=blob:none --quiet https://github.com/huggingface/peft /tmp/pip-req-build-dluqdo4r
  Running command git rev-parse -q --verify 'sha^03eb378eb914fbee709ff7c86ba5b1d033b89524'
  Running command git fetch -q https://github.com/huggingface/peft 03eb378eb914fbee709ff7c86ba5b1d033b89524
  Running command git checkout -q 03eb378eb914fbee709ff7c86ba5b1d033b89524
  Resolved https://github.com/huggingface/peft to commit 03eb378eb914fbee709ff7c86ba5b1d033b89524
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Ignoring bitsandbytes: markers 'platform_system == "Windows"' don't match your environment
Ignoring llama-cpp-python: markers 'platform_system == "Windows"' don't match your environment
Ignoring auto-gptq: markers 'platform_system == "Windows"' don't match your environment
Collecting auto-gptq==0.2.2+cu117 (from -r requirements.txt (line 25))
  Downloading https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.2/auto_gptq-0.2.2+cu117-cp310-cp310-linux_x86_64.whl (661 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 661.8/661.8 kB 3.2 MB/s eta 0:00:00
Ignoring exllama: markers 'platform_system == "Windows"' don't match your environment
Collecting exllama==0.0.4+cu117 (from -r requirements.txt (line 27))
  Downloading https://github.com/jllllll/exllama/releases/download/0.0.4/exllama-0.0.4+cu117-cp310-cp310-linux_x86_64.whl (352 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 352.9/352.9 kB 3.1 MB/s eta 0:00:00
Requirement already satisfied: accelerate==0.20.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (0.20.3)
Requirement already satisfied: colorama in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (0.4.6)
Requirement already satisfied: datasets in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.13.1)
Requirement already satisfied: einops in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (0.6.1)
Requirement already satisfied: flexgen==0.1.7 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (0.1.7)
Requirement already satisfied: gradio_client==0.2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (0.2.5)
Requirement already satisfied: gradio==3.33.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.33.1)
Requirement already satisfied: markdown in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (3.4.3)
Requirement already satisfied: numpy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (1.24.4)
Collecting numpy (from -r requirements.txt (line 9))
  Downloading numpy-1.25.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.6/17.6 MB 10.1 MB/s eta 0:00:00
Requirement already satisfied: pandas in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.3)
Requirement already satisfied: Pillow>=9.5.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (9.5.0)
Requirement already satisfied: pyyaml in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (6.0)
Requirement already satisfied: requests in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (2.31.0)
Requirement already satisfied: safetensors==0.3.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 14)) (0.3.1)
Requirement already satisfied: sentencepiece in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 15)) (0.1.99)
Requirement already satisfied: tqdm in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 16)) (4.65.0)
Requirement already satisfied: scipy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 17)) (1.11.1)
Requirement already satisfied: transformers==4.30.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r requirements.txt (line 18)) (4.30.2)
Collecting bitsandbytes==0.39.1 (from -r requirements.txt (line 20))
  Downloading bitsandbytes-0.39.1-py3-none-any.whl (97.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.1/97.1 MB 10.2 MB/s eta 0:00:00
Collecting llama-cpp-python==0.1.66 (from -r requirements.txt (line 22))
  Downloading llama_cpp_python-0.1.66.tar.gz (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 10.6 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: packaging>=20.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from accelerate==0.20.3->-r requirements.txt (line 1)) (23.1)
Requirement already satisfied: psutil in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from accelerate==0.20.3->-r requirements.txt (line 1)) (5.9.5)
Requirement already satisfied: torch>=1.6.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from accelerate==0.20.3->-r requirements.txt (line 1)) (2.0.1+cu117)
Requirement already satisfied: pulp in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from flexgen==0.1.7->-r requirements.txt (line 5)) (2.7.0)
Requirement already satisfied: attrs in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from flexgen==0.1.7->-r requirements.txt (line 5)) (23.1.0)
Requirement already satisfied: fsspec in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio_client==0.2.5->-r requirements.txt (line 6)) (2023.6.0)
Requirement already satisfied: httpx in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio_client==0.2.5->-r requirements.txt (line 6)) (0.24.1)
Requirement already satisfied: huggingface-hub>=0.13.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio_client==0.2.5->-r requirements.txt (line 6)) (0.15.1)
Requirement already satisfied: typing-extensions in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio_client==0.2.5->-r requirements.txt (line 6)) (4.7.0)
Requirement already satisfied: websockets in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio_client==0.2.5->-r requirements.txt (line 6)) (11.0.2)
Requirement already satisfied: aiofiles in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (23.1.0)
Requirement already satisfied: aiohttp in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (3.8.4)
Requirement already satisfied: altair>=4.2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (5.0.1)
Requirement already satisfied: fastapi in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (0.98.0)
Requirement already satisfied: ffmpy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (0.3.0)
Requirement already satisfied: jinja2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (3.1.2)
Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (2.2.0)
Requirement already satisfied: markupsafe in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (2.1.2)
Requirement already satisfied: matplotlib in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (3.7.1)
Requirement already satisfied: mdit-py-plugins<=0.3.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (0.3.3)
Requirement already satisfied: orjson in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (3.9.1)
Requirement already satisfied: pydantic in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (1.10.9)
Requirement already satisfied: pydub in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (0.25.1)
Requirement already satisfied: pygments>=2.12.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (2.15.1)
Requirement already satisfied: python-multipart in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (0.0.6)
Requirement already satisfied: semantic-version in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (2.10.0)
Requirement already satisfied: uvicorn>=0.14.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from gradio==3.33.1->-r requirements.txt (line 7)) (0.22.0)
Requirement already satisfied: filelock in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from transformers==4.30.2->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: regex!=2019.12.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from transformers==4.30.2->-r requirements.txt (line 18)) (2023.6.3)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from transformers==4.30.2->-r requirements.txt (line 18)) (0.13.3)
Requirement already satisfied: diskcache>=5.6.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from llama-cpp-python==0.1.66->-r requirements.txt (line 22)) (5.6.1)
Requirement already satisfied: pyarrow>=8.0.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from datasets->-r requirements.txt (line 3)) (12.0.1)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from datasets->-r requirements.txt (line 3)) (0.3.6)
Requirement already satisfied: xxhash in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from datasets->-r requirements.txt (line 3)) (3.2.0)
Requirement already satisfied: multiprocess in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from datasets->-r requirements.txt (line 3)) (0.70.14)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from pandas->-r requirements.txt (line 10)) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from pandas->-r requirements.txt (line 10)) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from pandas->-r requirements.txt (line 10)) (2023.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 13)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 13)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 13)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 13)) (2022.12.7)
Requirement already satisfied: rouge in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from auto-gptq==0.2.2+cu117->-r requirements.txt (line 25)) (1.0.1)
Requirement already satisfied: jsonschema>=3.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from altair>=4.2.0->gradio==3.33.1->-r requirements.txt (line 7)) (4.17.3)
Requirement already satisfied: toolz in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from altair>=4.2.0->gradio==3.33.1->-r requirements.txt (line 7)) (0.12.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from aiohttp->gradio==3.33.1->-r requirements.txt (line 7)) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from aiohttp->gradio==3.33.1->-r requirements.txt (line 7)) (4.0.2)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from aiohttp->gradio==3.33.1->-r requirements.txt (line 7)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from aiohttp->gradio==3.33.1->-r requirements.txt (line 7)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from aiohttp->gradio==3.33.1->-r requirements.txt (line 7)) (1.3.1)
Requirement already satisfied: mdurl~=0.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.33.1->-r requirements.txt (line 7)) (0.1.2)
Requirement already satisfied: linkify-it-py<3,>=1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.33.1->-r requirements.txt (line 7)) (2.0.2)
Requirement already satisfied: six>=1.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 10)) (1.16.0)
Requirement already satisfied: sympy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate==0.20.3->-r requirements.txt (line 1)) (1.11.1)
Requirement already satisfied: networkx in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate==0.20.3->-r requirements.txt (line 1)) (3.0)
Requirement already satisfied: triton==2.0.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate==0.20.3->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: cmake in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate==0.20.3->-r requirements.txt (line 1)) (3.25.0)
Requirement already satisfied: lit in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate==0.20.3->-r requirements.txt (line 1)) (15.0.7)
Requirement already satisfied: click>=7.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from uvicorn>=0.14.0->gradio==3.33.1->-r requirements.txt (line 7)) (8.1.3)
Requirement already satisfied: h11>=0.8 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from uvicorn>=0.14.0->gradio==3.33.1->-r requirements.txt (line 7)) (0.14.0)
Requirement already satisfied: starlette<0.28.0,>=0.27.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from fastapi->gradio==3.33.1->-r requirements.txt (line 7)) (0.27.0)
Requirement already satisfied: httpcore<0.18.0,>=0.15.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from httpx->gradio_client==0.2.5->-r requirements.txt (line 6)) (0.17.2)
Requirement already satisfied: sniffio in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from httpx->gradio_client==0.2.5->-r requirements.txt (line 6)) (1.3.0)
Requirement already satisfied: contourpy>=1.0.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from matplotlib->gradio==3.33.1->-r requirements.txt (line 7)) (1.1.0)
Requirement already satisfied: cycler>=0.10 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from matplotlib->gradio==3.33.1->-r requirements.txt (line 7)) (0.11.0)
Requirement already satisfied: fonttools>=4.22.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from matplotlib->gradio==3.33.1->-r requirements.txt (line 7)) (4.40.0)
Requirement already satisfied: kiwisolver>=1.0.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from matplotlib->gradio==3.33.1->-r requirements.txt (line 7)) (1.4.4)
Requirement already satisfied: pyparsing>=2.3.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from matplotlib->gradio==3.33.1->-r requirements.txt (line 7)) (3.1.0)
Requirement already satisfied: anyio<5.0,>=3.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from httpcore<0.18.0,>=0.15.0->httpx->gradio_client==0.2.5->-r requirements.txt (line 6)) (3.7.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from jsonschema>=3.0->altair>=4.2.0->gradio==3.33.1->-r requirements.txt (line 7)) (0.19.3)
Requirement already satisfied: uc-micro-py in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.33.1->-r requirements.txt (line 7)) (1.0.2)
Requirement already satisfied: mpmath>=0.19 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->accelerate==0.20.3->-r requirements.txt (line 1)) (1.2.1)
Requirement already satisfied: exceptiongroup in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from anyio<5.0,>=3.0->httpcore<0.18.0,>=0.15.0->httpx->gradio_client==0.2.5->-r requirements.txt (line 6)) (1.1.1)
Building wheels for collected packages: llama-cpp-python, peft
  Building wheel for llama-cpp-python (pyproject.toml) ... done
  Created wheel for llama-cpp-python: filename=llama_cpp_python-0.1.66-cp310-cp310-linux_x86_64.whl size=271600 sha256=5fe1dc5b842fe45b6c1490000aebb507f6ea9b3f16d987a80800472b09c68403
  Stored in directory: /tmp/pip-ephem-wheel-cache-wdafetbz/wheels/9c/0e/e3/5c3b6fdb7a015cc1c18596fddf79d795b64347f18809c78fee
  Building wheel for peft (pyproject.toml) ... done
  Created wheel for peft: filename=peft-0.4.0.dev0-py3-none-any.whl size=61146 sha256=b59bf560a3f8775806d65262bb62ca6974b3f03b21818f1d759f1449a33b17fd
  Stored in directory: /tmp/pip-ephem-wheel-cache-wdafetbz/wheels/73/14/95/62d30d224b10f5601d4d015b8ff71bb9b8e23876f07086198c
Successfully built llama-cpp-python peft
Installing collected packages: bitsandbytes, numpy, llama-cpp-python, peft
  Attempting uninstall: bitsandbytes
    Found existing installation: bitsandbytes 0.38.1
    Uninstalling bitsandbytes-0.38.1:
      Successfully uninstalled bitsandbytes-0.38.1
  Attempting uninstall: numpy
    Found existing installation: numpy 1.24.4
    Uninstalling numpy-1.24.4:
      Successfully uninstalled numpy-1.24.4
  Attempting uninstall: llama-cpp-python
    Found existing installation: llama-cpp-python 0.1.67
    Uninstalling llama-cpp-python-0.1.67:
      Successfully uninstalled llama-cpp-python-0.1.67
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
numba 0.57.1 requires numpy<1.25,>=1.21, but you have numpy 1.25.0 which is incompatible.
Successfully installed bitsandbytes-0.39.1 llama-cpp-python-0.1.66 numpy-1.25.0 peft-0.4.0.dev0
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: ipython in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 1)) (8.14.0)
Requirement already satisfied: num2words in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 2)) (0.5.12)
Requirement already satisfied: omegaconf in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 3)) (2.3.0)
Requirement already satisfied: pydub in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: PyYAML in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/silero_tts/requirements.txt (line 5)) (6.0)
Requirement already satisfied: backcall in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: jedi>=0.16 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: matplotlib-inline in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: pickleshare in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: pygments>=2.4.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.15.1)
Requirement already satisfied: stack-data in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: traitlets>=5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: pexpect>4.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython->-r extensions/silero_tts/requirements.txt (line 1)) (4.8.0)
Requirement already satisfied: docopt>=0.6.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from num2words->-r extensions/silero_tts/requirements.txt (line 2)) (0.6.2)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from omegaconf->-r extensions/silero_tts/requirements.txt (line 3)) (4.9.3)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from jedi>=0.16->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: ptyprocess>=0.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from pexpect>4.3->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.7.0)
Requirement already satisfied: wcwidth in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: executing>=1.2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: asttokens>=2.1.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: pure-eval in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython->-r extensions/silero_tts/requirements.txt (line 1)) (1.16.0)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: deep-translator==1.9.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/google_translate/requirements.txt (line 1)) (1.9.2)
Requirement already satisfied: beautifulsoup4<5.0.0,>=4.9.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (4.12.2)
Requirement already satisfied: requests<3.0.0,>=2.23.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: soupsieve>1.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from beautifulsoup4<5.0.0,>=4.9.1->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.4.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests<3.0.0,>=2.23.0->deep-translator==1.9.2->-r extensions/google_translate/requirements.txt (line 1)) (2022.12.7)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: elevenlabs==0.2.* in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.2.18)
Requirement already satisfied: pydantic>=1.10 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (1.10.9)
Requirement already satisfied: ipython>=7.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (8.14.0)
Requirement already satisfied: requests>=2.20 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: backcall in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: decorator in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (5.1.1)
Requirement already satisfied: jedi>=0.16 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: matplotlib-inline in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.1.6)
Requirement already satisfied: pickleshare in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.0.38)
Requirement already satisfied: pygments>=2.4.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.15.1)
Requirement already satisfied: stack-data in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.6.2)
Requirement already satisfied: traitlets>=5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (5.9.0)
Requirement already satisfied: pexpect>4.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (4.8.0)
Requirement already satisfied: typing-extensions>=4.2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from pydantic>=1.10->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (4.7.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.20->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from jedi>=0.16->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.8.3)
Requirement already satisfied: ptyprocess>=0.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from pexpect>4.3->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.7.0)
Requirement already satisfied: wcwidth in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: executing>=1.2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (1.2.0)
Requirement already satisfied: asttokens>=2.1.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (2.2.1)
Requirement already satisfied: pure-eval in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (0.2.2)
Requirement already satisfied: six in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython>=7.0->elevenlabs==0.2.*->-r extensions/elevenlabs_tts/requirements.txt (line 1)) (1.16.0)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: SpeechRecognition==3.10.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/whisper_stt/requirements.txt (line 1)) (3.10.0)
Requirement already satisfied: openai-whisper in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/whisper_stt/requirements.txt (line 2)) (20230314)
Requirement already satisfied: soundfile in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/whisper_stt/requirements.txt (line 3)) (0.12.1)
Requirement already satisfied: ffmpeg in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/whisper_stt/requirements.txt (line 4)) (1.4)
Requirement already satisfied: requests>=2.26.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: triton==2.0.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: numba in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (0.57.1)
Requirement already satisfied: numpy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (1.25.0)
Requirement already satisfied: torch in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (2.0.1+cu117)
Requirement already satisfied: tqdm in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: more-itertools in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (9.1.0)
Requirement already satisfied: tiktoken==0.3.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (0.3.1)
Requirement already satisfied: ffmpeg-python==0.2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (0.2.0)
Requirement already satisfied: future in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from ffmpeg-python==0.2.0->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (0.18.3)
Requirement already satisfied: regex>=2022.1.18 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from tiktoken==0.3.1->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (2023.6.3)
Requirement already satisfied: cmake in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (3.25.0)
Requirement already satisfied: filelock in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (3.9.0)
Requirement already satisfied: lit in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (15.0.7)
Requirement already satisfied: cffi>=1.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from soundfile->-r extensions/whisper_stt/requirements.txt (line 3)) (1.15.1)
Requirement already satisfied: pycparser in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from cffi>=1.0->soundfile->-r extensions/whisper_stt/requirements.txt (line 3)) (2.21)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests>=2.26.0->SpeechRecognition==3.10.0->-r extensions/whisper_stt/requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: llvmlite<0.41,>=0.40.0dev0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from numba->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (0.40.1)
Collecting numpy (from openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2))
  Downloading numpy-1.24.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 9.8 MB/s eta 0:00:00
Requirement already satisfied: typing-extensions in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (4.7.0)
Requirement already satisfied: sympy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (3.0)
Requirement already satisfied: jinja2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: MarkupSafe>=2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from jinja2->torch->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sympy->torch->openai-whisper->-r extensions/whisper_stt/requirements.txt (line 2)) (1.2.1)
Installing collected packages: numpy
  Attempting uninstall: numpy
    Found existing installation: numpy 1.25.0
    Uninstalling numpy-1.25.0:
      Successfully uninstalled numpy-1.25.0
Successfully installed numpy-1.24.4
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: flask_cloudflared==0.0.12 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/api/requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: websockets==11.0.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/api/requirements.txt (line 2)) (11.0.2)
Requirement already satisfied: Flask>=0.8 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2.3.2)
Requirement already satisfied: requests in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: Werkzeug>=2.3.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (1.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: MarkupSafe>=2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/api/requirements.txt (line 1)) (2.1.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: ngrok==0.* in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/ngrok/requirements.txt (line 1)) (0.8.1)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: flask_cloudflared==0.0.12 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/openai/requirements.txt (line 1)) (0.0.12)
Requirement already satisfied: sentence-transformers in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from -r extensions/openai/requirements.txt (line 2)) (2.2.2)
Requirement already satisfied: Flask>=0.8 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2.3.2)
Requirement already satisfied: requests in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: transformers<5.0.0,>=4.6.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (4.30.2)
Requirement already satisfied: tqdm in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (4.65.0)
Requirement already satisfied: torch>=1.6.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (2.0.1+cu117)
Requirement already satisfied: torchvision in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (0.15.2+cu117)
Requirement already satisfied: numpy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (1.24.4)
Requirement already satisfied: scikit-learn in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (1.2.2)
Requirement already satisfied: scipy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: nltk in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (3.8.1)
Requirement already satisfied: sentencepiece in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (0.1.99)
Requirement already satisfied: huggingface-hub>=0.4.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (0.15.1)
Requirement already satisfied: Werkzeug>=2.3.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (1.6.2)
Requirement already satisfied: filelock in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (3.9.0)
Requirement already satisfied: fsspec in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (2023.6.0)
Requirement already satisfied: pyyaml>=5.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (6.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (4.7.0)
Requirement already satisfied: packaging>=20.9 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from huggingface-hub>=0.4.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (23.1)
Requirement already satisfied: sympy in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: networkx in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (3.0)
Requirement already satisfied: triton==2.0.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: cmake in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (3.25.0)
Requirement already satisfied: lit in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (15.0.7)
Requirement already satisfied: regex!=2019.12.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (2023.6.3)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (0.13.3)
Requirement already satisfied: safetensors>=0.3.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (0.3.1)
Requirement already satisfied: joblib in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from nltk->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (1.3.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from requests->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2022.12.7)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from scikit-learn->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (3.1.0)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from torchvision->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (9.5.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from Jinja2>=3.1.2->Flask>=0.8->flask_cloudflared==0.0.12->-r extensions/openai/requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->sentence-transformers->-r extensions/openai/requirements.txt (line 2)) (1.2.1)
Już aktualne.
Już aktualne.
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Processing /home/user/oobabooga_linux/text-generation-webui/repositories/GPTQ-for-LLaMa
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: quant-cuda
  Building wheel for quant-cuda (setup.py) ... done
  Created wheel for quant-cuda: filename=quant_cuda-0.0.0-cp310-cp310-linux_x86_64.whl size=232200 sha256=aaf158f03359586d0361b933eece67a6f6ddb0a98e1ab115ec31f1fdede9d6c8
  Stored in directory: /tmp/pip-ephem-wheel-cache-59q5j_qn/wheels/38/9e/66/97437eae283bda0ad9a054575abfc1fce14b2a271cbb513455
Successfully built quant-cuda
Installing collected packages: quant-cuda
  Attempting uninstall: quant-cuda
    Found existing installation: quant-cuda 0.0.0
    Uninstalling quant-cuda-0.0.0:
      Successfully uninstalled quant-cuda-0.0.0
Successfully installed quant-cuda-0.0.0

Done!
sra-tatata commented 1 year ago 
./start_linux.sh 
bin /home/user/oobabooga_linux/installer_files/env/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda117.so
2023-06-29 11:38:46 INFO:Loading TheBloke_WizardCoder-15B-1.0-GPTQ...
2023-06-29 11:38:46 INFO:The AutoGPTQ params are: {'model_basename': 'gptq_model-4bit-128g', 'device': 'cuda:0', 'use_triton': False, 'inject_fused_attention': True, 'inject_fused_mlp': True, 'use_safetensors': True, 'trust_remote_code': False, 'max_memory': None, 'quantize_config': None, 'use_cuda_fp16': True}
2023-06-29 11:38:46 WARNING:CUDA extension not installed.
2023-06-29 11:38:47 WARNING:The safetensors archive passed at models/TheBloke_WizardCoder-15B-1.0-GPTQ/gptq_model-4bit-128g.safetensors does not contain metadata. Make sure to save your model with the `save_pretrained` method. Defaulting to 'pt' metadata.
2023-06-29 11:38:49 WARNING:GPTBigCodeGPTQForCausalLM hasn't fused attention module yet, will skip inject fused attention.
2023-06-29 11:38:49 WARNING:GPTBigCodeGPTQForCausalLM hasn't fused mlp module yet, will skip inject fused mlp.
2023-06-29 11:38:49 INFO:Loaded the model in 3.31 seconds.

2023-06-29 11:38:49 INFO:Loading the extension "gallery"...
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Hans2004 commented 1 year ago

I have exactly the same problem with OpenSuse Leap 15.5

github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.

Ram-Chandalada commented 1 year ago

I have the same problem with TheBlokes model