ctransformers Could not find module

[hts2008]

Expected Behavior

Selected model after downloading it.

Current Behavior

It looks like you we couldn't load the model. Here is the error message: Could not find module 'D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax.

Steps to Reproduce

Please provide detailed steps to reproduce the issue.

1. Install c_transformers
2. Restart LoLLMS
3. Download a model like https://huggingface.co/vilm/Quyen-Pro-v0.1-GGUF
4. Click on the model to enable it and error.

Additional information:

1. I try re-install lollms so many times (about 10 times, maybe)
2. System info: Windows 11, RTX 3090, 64GB RAM, AMD R5 3500G.
3. No error or cancel press occur during install lollms and c_transformers
4. Using the newest install bat file (v9.5)

Console log

Starting LOLLMS Web UI... " " " /_\ /\ \ /_\ /_\ /_\ /\ \ " " /:/ / /::\ \ /:/ / /:/ / /::| | /::\ \ " " /:/ / /:/\:\ \ /:/ / /:/ / /:|:| | /:/\ \ \ " " /:/ / /:/ \:\ \ /:/ / /:/ / /:/|:|| \:\~\ \ \ " "/:// /:// \:_\ /:// /:// /:/ |::::_\ /\ \:\ \ _\ " "\:\ \ \:\ \ /:/ / \:\ \ \:\ \ \//~~/:/ / \:\ \:\ \// " " \:\ \ \:\ /:/ / \:\ \ \:\ \ /:/ / \:\ \:_\ " " \:\ \ \:\/:/ / \:\ \ \:\ \ /:/ / \:\/:/ / " " \:_\ \::/ / \:_\ \:_\ /:/ / \::/ / " " \// \// \// \// \// \// " By ParisNeo Trying to use Configuration at :global_paths_cfg.yaml global_paths_cfg.yaml not found! Searching in your home folder. Welcome! It seems this is your first use of the new lollms app. To make it clear where your data are stored, we now give the user the choice where to put its data. This allows you to mutualize models which are heavy, between multiple lollms compatible apps. You can change this at any time using the lollms-settings script or by simply change the content of the global_paths_cfg.yaml file. Please provide a folder to store your configurations files, your models and your personal data (database, custom personalities etc). Folder path: (..\personal_data):D:\lollms-webui\personal_data Selected: D:\lollms-webui\personal_data Execution path : D:\lollms-webui\lollms-webui Local zoos folder found ----------------------Paths information----------------------- personal_path:D:\lollms-webui\personal_data personal_configuration_path:D:\lollms-webui\personal_data\configs personal_discussions_path:D:\lollms-webui\personal_data\discussion_databases personal_skills_path:D:\lollms-webui\personal_data\skill_databases personal_models_path:D:\lollms-webui\personal_data\models personal_user_infos_path:D:\lollms-webui\personal_data\user_infos personal_trainers_path:D:\lollms-webui\personal_data\trainers personal_trainers_path:D:\lollms-webui\personal_data\trainers\gptqlora personal_data_path:D:\lollms-webui\personal_data\data custom_personalities_path:D:\lollms-webui\personal_data\custom_personalities custom_voices_path:D:\lollms-webui\personal_data\custom_voices

----------------------Zoo information----------------------- bindings_zoo_path:D:\lollms-webui\lollms-webui\zoos\bindings_zoo personalities_zoo_path:D:\lollms-webui\lollms-webui\zoos\personalities_zoo extensions_zoo_path:D:\lollms-webui\lollms-webui\zoos\extensions_zoo models_zoo_path:D:\lollms-webui\lollms-webui\zoos\models_zoo

Lollms_core found in the app space. Pulling last lollms_core fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/lollms_core' 'D:/lollms-webui/lollms-webui/lollms_core' is owned by: 'S-1-5-32-544' but the current user is: 'S-1-5-21-1606981802-1035122992-1208744641-1001' To add an exception for this directory, call:

    git config --global --add safe.directory D:/lollms-webui/lollms-webui/lollms_core

safe_store_path found in the app space. Pulling last safe_store_path fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/utilities/safe_store' 'D:/lollms-webui/lollms-webui/utilities/safe_store' is owned by: 'S-1-5-32-544' but the current user is: 'S-1-5-21-1606981802-1035122992-1208744641-1001' To add an exception for this directory, call:

    git config --global --add safe.directory D:/lollms-webui/lollms-webui/utilities/safe_store

Bindings zoo found in your personal space. Pulling last bindings zoo fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/bindings_zoo' 'D:/lollms-webui/lollms-webui/zoos/bindings_zoo' is owned by: 'S-1-5-32-544' but the current user is: 'S-1-5-21-1606981802-1035122992-1208744641-1001' To add an exception for this directory, call:

    git config --global --add safe.directory D:/lollms-webui/lollms-webui/zoos/bindings_zoo

Personalities zoo found in your personal space. Pulling last personalities zoo fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/personalities_zoo' 'D:/lollms-webui/lollms-webui/zoos/personalities_zoo' is owned by: 'S-1-5-32-544' but the current user is: 'S-1-5-21-1606981802-1035122992-1208744641-1001' To add an exception for this directory, call:

    git config --global --add safe.directory D:/lollms-webui/lollms-webui/zoos/personalities_zoo

Extensions zoo found in your personal space. Pulling last Extensions zoo fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/extensions_zoo' 'D:/lollms-webui/lollms-webui/zoos/extensions_zoo' is owned by: 'S-1-5-32-544' but the current user is: 'S-1-5-21-1606981802-1035122992-1208744641-1001' To add an exception for this directory, call:

    git config --global --add safe.directory D:/lollms-webui/lollms-webui/zoos/extensions_zoo

Models zoo found in your personal space. Pulling last Models zoo fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/models_zoo' 'D:/lollms-webui/lollms-webui/zoos/models_zoo' is owned by: 'S-1-5-32-544' but the current user is: 'S-1-5-21-1606981802-1035122992-1208744641-1001' To add an exception for this directory, call:

    git config --global --add safe.directory D:/lollms-webui/lollms-webui/zoos/models_zoo

No binding selected Personality lollms mounted successfully but no model is selected Checking for updates from D:\lollms-webui\lollms-webui Checking for updates from D:\lollms-webui\lollms-webui\lollms_core Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store Checking discussions database... ok Your personal data is stored here :D:\lollms-webui\personal_data D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\pydantic_internal_fields.py:151: UserWarning: Field "modelname" has conflict with protected namespace "model".

You may be able to resolve this warning by setting model_config['protected_namespaces'] = (). warnings.warn( INFO: Started server process [12148] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://localhost:9600 (Press CTRL+C to quit) INFO: ::1:54552 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LN7 HTTP/1.1" 200 OK INFO: ::1:54553 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LN7 HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /get_lollms_webui_version HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /get_versionID HTTP/1.1" 200 OK Client U9zz13XR8kkNFHGuAAAC connected INFO: ::1:54552 - "POST /socket.io/?EIO=4&transport=polling&t=Owe8LO7&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK INFO: ('::1', 54557) - "WebSocket /socket.io/?EIO=4&transport=websocket&sid=GBwpCgKIkIkvgjFBAAAA" [accepted] INFO: ::1:54556 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LO8&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK INFO: ::1:54553 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LO8&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK INFO: ::1:54556 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LP2&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /get_config HTTP/1.1" 200 OK INFO: ::1:54553 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LP2&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /list_databases HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /list_bindings HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /disk_usage HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /ram_usage HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /vram_usage HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /list_extensions HTTP/1.1" 200 OK Listing all personalities OK INFO: ::1:54552 - "GET /get_all_personalities HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /get_available_models HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /list_models HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /get_active_model HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /get_model_status HTTP/1.1" 200 OK INFO: ::1:54552 - "GET /list_discussions HTTP/1.1" 200 OK Loading discussion for client U9zz13XR8kkNFHGuAAAC ... ok INFO: ::1:54552 - "GET /get_current_personality_files_list HTTP/1.1" 200 OK OK ╔══════════════════════════════════════════════════╗ ║ Building mounted Personalities ║ ╚══════════════════════════════════════════════════╝

• generic/lollms selected model : generic/lollms ╔══════════════════════════════════════════════════╗ ║ Done ║ ╚══════════════════════════════════════════════════╝ INFO: ::1:54563 - "POST /apply_settings HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui INFO: ::1:54564 - "GET /get_config HTTP/1.1" 200 OK Listing voices INFO: ::1:54564 - "GET /user_infos/default_user.svg HTTP/1.1" 400 Bad Request INFO: ::1:54566 - "GET /list_voices HTTP/1.1" 200 OK INFO: ::1:54565 - "GET /list_personalities_categories HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui\lollms_core INFO: ::1:54564 - "GET /list_personalities?category=generic HTTP/1.1" 200 OK INFO: ::1:54566 - "GET /list_extensions_categories HTTP/1.1" 200 OK INFO: ::1:54565 - "GET /list_personalities_categories HTTP/1.1" 200 OK INFO: ::1:54564 - "GET /list_extensions_categories HTTP/1.1" 200 OK INFO: ::1:54564 - "GET /list_extensions?category=bound_extensions HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store INFO: ::1:54563 - "GET /check_update HTTP/1.1" 200 OK
• Reinstalling binding c_transformers... Unmounting binding and model Installing binding Collecting pyopencl Using cached pyopencl-2024.1-cp311-cp311-win_amd64.whl.metadata (4.6 kB) Requirement already satisfied: numpy in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pyopencl) (1.26.4) Collecting pytools>=2021.2.7 (from pyopencl) Using cached pytools-2024.1.1-py2.py3-none-any.whl.metadata (2.6 kB) Requirement already satisfied: platformdirs>=2.2.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pyopencl) (3.10.0) Using cached pyopencl-2024.1-cp311-cp311-win_amd64.whl (562 kB) Using cached pytools-2024.1.1-py2.py3-none-any.whl (85 kB) Installing collected packages: pytools, pyopencl Successfully installed pyopencl-2024.1 pytools-2024.1.1 Installing Binding freeing memory The variable 'AutoModelForCausalLM' does not exist in the local or global namespace. freed memory ---------------------- Installing c_transformers ---------------------- Installing requirements for hardware configuration nvidia-tensorcores Ignoring aqlm: markers 'platform_system == "Linux"' don't match your environment Collecting ctransformers==0.2.27+cu121 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 35)) Downloading https://github.com/jllllll/ctransformers-cuBLAS-wheels/releases/download/AVX2/ctransformers-0.2.27+cu121-py3-none-any.whl (15.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.5/15.5 MB 24.2 MB/s eta 0:00:00 Collecting accelerate==0.27. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) Using cached accelerate-0.27.2-py3-none-any.whl.metadata (18 kB) Collecting bitsandbytes==0.43. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 3)) Using cached bitsandbytes-0.43.0-py3-none-win_amd64.whl.metadata (1.9 kB) Requirement already satisfied: colorama in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 4)) (0.4.6) Collecting datasets (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) Using cached datasets-2.18.0-py3-none-any.whl.metadata (20 kB) Collecting einops (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 6)) Using cached einops-0.7.0-py3-none-any.whl.metadata (13 kB) Collecting gradio==3.50. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached gradio-3.50.2-py3-none-any.whl.metadata (17 kB) Collecting hqq==0.1.5 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8)) Using cached hqq-0.1.5-py3-none-any.whl Collecting jinja2==3.1.2 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 9)) Using cached Jinja2-3.1.2-py3-none-any.whl.metadata (3.5 kB) Collecting lm_eval==0.3.0 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached lm_eval-0.3.0-py3-none-any.whl.metadata (6.8 kB) Collecting markdown (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 11)) Using cached Markdown-3.6-py3-none-any.whl.metadata (7.0 kB) Collecting numba==0.59. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 12)) Using cached numba-0.59.1-cp311-cp311-win_amd64.whl.metadata (2.8 kB) Requirement already satisfied: numpy==1.26. in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 13)) (1.26.4) Collecting optimum==1.17. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14)) Using cached optimum-1.17.1-py3-none-any.whl.metadata (18 kB) Requirement already satisfied: pandas in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2.2.1) Collecting peft==0.8. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 16)) Using cached peft-0.8.2-py3-none-any.whl.metadata (25 kB) Requirement already satisfied: Pillow>=9.5.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 17)) (10.3.0) Requirement already satisfied: pyyaml in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 18)) (6.0.1) Requirement already satisfied: requests in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2.31.0) Requirement already satisfied: rich in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (13.7.1) Requirement already satisfied: safetensors==0.4. in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 21)) (0.4.2) Requirement already satisfied: scipy in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 22)) (1.13.0) Collecting sentencepiece (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 23)) Using cached sentencepiece-0.2.0-cp311-cp311-win_amd64.whl.metadata (8.3 kB) Collecting tensorboard (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached tensorboard-2.16.2-py3-none-any.whl.metadata (1.6 kB) Collecting transformers==4.38. (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) Using cached transformers-4.38.2-py3-none-any.whl.metadata (130 kB) Requirement already satisfied: tqdm in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 26)) (4.65.0) Collecting tqdm (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 26)) Using cached tqdm-4.66.2-py3-none-any.whl.metadata (57 kB) Collecting wandb (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) Using cached wandb-0.16.6-py3-none-any.whl.metadata (10 kB) Collecting SpeechRecognition==3.10.0 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 30)) Using cached SpeechRecognition-3.10.0-py2.py3-none-any.whl.metadata (28 kB) Collecting flask_cloudflared==0.0.14 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31)) Using cached flask_cloudflared-0.0.14-py3-none-any.whl.metadata (4.6 kB) Collecting sse-starlette==1.6.5 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 32)) Using cached sse_starlette-1.6.5-py3-none-any.whl.metadata (6.7 kB) Requirement already satisfied: tiktoken in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 33)) (0.6.0) Requirement already satisfied: packaging>=20.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) (23.2) Requirement already satisfied: psutil in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) (5.9.8) Collecting torch>=1.10.0 (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) Using cached torch-2.2.2-cp311-cp311-win_amd64.whl.metadata (26 kB) Requirement already satisfied: huggingface-hub in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) (0.22.2) Collecting aiofiles<24.0,>=22.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached aiofiles-23.2.1-py3-none-any.whl.metadata (9.7 kB) Collecting altair<6.0,>=4.2.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached altair-5.3.0-py3-none-any.whl.metadata (9.2 kB) Requirement already satisfied: fastapi in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.110.1) Collecting ffmpy (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached ffmpy-0.3.2-py3-none-any.whl Collecting gradio-client==0.6.1 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached gradio_client-0.6.1-py3-none-any.whl.metadata (7.1 kB) Collecting httpx (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached httpx-0.27.0-py3-none-any.whl.metadata (7.2 kB) Collecting importlib-resources<7.0,>=1.3 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached importlib_resources-6.4.0-py3-none-any.whl.metadata (3.9 kB) Collecting markupsafe~=2.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached MarkupSafe-2.1.5-cp311-cp311-win_amd64.whl.metadata (3.1 kB) Requirement already satisfied: matplotlib~=3.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (3.8.4) Collecting orjson~=3.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached orjson-3.10.0-cp311-none-win_amd64.whl.metadata (50 kB) Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (2.6.4) Collecting pydub (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached pydub-0.25.1-py2.py3-none-any.whl.metadata (1.4 kB) Requirement already satisfied: python-multipart in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.0.9) Collecting semantic-version~=2.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached semantic_version-2.10.0-py2.py3-none-any.whl.metadata (9.7 kB) Requirement already satisfied: typing-extensions~=4.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (4.10.0) Requirement already satisfied: uvicorn>=0.14.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.29.0) Collecting websockets<12.0,>=10.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached websockets-11.0.3-cp311-cp311-win_amd64.whl.metadata (6.8 kB) Collecting timm (from hqq==0.1.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8)) Using cached timm-0.9.16-py3-none-any.whl.metadata (38 kB) Collecting termcolor (from hqq==0.1.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8)) Using cached termcolor-2.4.0-py3-none-any.whl.metadata (6.1 kB) Collecting jsonlines (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached jsonlines-4.0.0-py3-none-any.whl.metadata (1.6 kB) Collecting numexpr (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached numexpr-2.10.0-cp311-cp311-win_amd64.whl.metadata (8.1 kB) Collecting openai>=0.6.4 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached openai-1.16.1-py3-none-any.whl.metadata (21 kB) Collecting pybind11>=2.6.2 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached pybind11-2.12.0-py3-none-any.whl.metadata (9.5 kB) Collecting pycountry (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached pycountry-23.12.11-py3-none-any.whl.metadata (12 kB) Collecting pytablewriter (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached pytablewriter-1.2.0-py3-none-any.whl.metadata (37 kB) Collecting rouge-score>=0.0.4 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached rouge_score-0.1.2-py3-none-any.whl Collecting sacrebleu==1.5.0 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached sacrebleu-1.5.0-py3-none-any.whl.metadata (1.3 kB) Requirement already satisfied: scikit-learn>=0.24.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.4.1.post1) Collecting sqlitedict (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached sqlitedict-2.1.0-py3-none-any.whl Collecting tqdm-multiprocess (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached tqdm_multiprocess-0.0.11-py3-none-any.whl.metadata (5.7 kB) Requirement already satisfied: zstandard in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (0.19.0) Collecting llvmlite<0.43,>=0.42.0dev0 (from numba==0.59.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 12)) Using cached llvmlite-0.42.0-cp311-cp311-win_amd64.whl.metadata (4.9 kB) Collecting coloredlogs (from optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14)) Using cached coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB) Collecting sympy (from optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14)) Using cached sympy-1.12-py3-none-any.whl.metadata (12 kB) Requirement already satisfied: filelock in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from transformers==4.38.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) (3.13.3) Requirement already satisfied: regex!=2019.12.17 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from transformers==4.38.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) (2023.12.25) Requirement already satisfied: tokenizers<0.19,>=0.14 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from transformers==4.38.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) (0.15.2) Collecting Flask>=0.8 (from flask_cloudflared==0.0.14->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31)) Using cached flask-3.0.2-py3-none-any.whl.metadata (3.6 kB) Requirement already satisfied: starlette in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from sse-starlette==1.6.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 32)) (0.37.2) Requirement already satisfied: fsspec in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio-client==0.6.1->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (2024.3.1) Collecting portalocker (from sacrebleu==1.5.0->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB) Collecting pyarrow>=12.0.0 (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) Using cached pyarrow-15.0.2-cp311-cp311-win_amd64.whl.metadata (3.1 kB) Collecting pyarrow-hotfix (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) Using cached pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB) Collecting dill<0.3.9,>=0.3.0 (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) Using cached dill-0.3.8-py3-none-any.whl.metadata (10 kB) Collecting xxhash (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) Using cached xxhash-3.4.1-cp311-cp311-win_amd64.whl.metadata (12 kB) Collecting multiprocess (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) Using cached multiprocess-0.70.16-py311-none-any.whl.metadata (7.2 kB) Collecting fsspec (from gradio-client==0.6.1->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached fsspec-2024.2.0-py3-none-any.whl.metadata (6.8 kB) Requirement already satisfied: aiohttp in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (3.9.3) Requirement already satisfied: python-dateutil>=2.8.2 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pandas->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pandas->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2024.1) Requirement already satisfied: tzdata>=2022.7 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pandas->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2024.1) Requirement already satisfied: charset-normalizer<4,>=2 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2024.2.2) Requirement already satisfied: markdown-it-py>=2.2.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from rich->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (3.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from rich->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (2.17.2) Collecting absl-py>=0.4 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached absl_py-2.1.0-py3-none-any.whl.metadata (2.3 kB) Collecting grpcio>=1.48.2 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached grpcio-1.62.1-cp311-cp311-win_amd64.whl.metadata (4.2 kB) Collecting protobuf!=4.24.0,>=3.19.6 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached protobuf-5.26.1-cp310-abi3-win_amd64.whl.metadata (592 bytes) Requirement already satisfied: setuptools>=41.0.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) (68.2.2) Requirement already satisfied: six>1.9 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) (1.16.0) Collecting tensorboard-data-server<0.8.0,>=0.7.0 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached tensorboard_data_server-0.7.2-py3-none-any.whl.metadata (1.1 kB) Collecting werkzeug>=1.0.1 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached werkzeug-3.0.2-py3-none-any.whl.metadata (4.1 kB) Requirement already satisfied: Click!=8.0.0,>=7.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (8.1.7) Requirement already satisfied: GitPython!=3.1.29,>=1.0.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (3.1.43) Collecting sentry-sdk>=1.0.0 (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) Using cached sentry_sdk-1.44.1-py2.py3-none-any.whl.metadata (9.9 kB) Collecting docker-pycreds>=0.4.0 (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) Using cached docker_pycreds-0.4.0-py2.py3-none-any.whl.metadata (1.8 kB) Collecting setproctitle (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) Using cached setproctitle-1.3.3-cp311-cp311-win_amd64.whl.metadata (10 kB) Collecting appdirs>=1.4.3 (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) Using cached appdirs-1.4.4-py2.py3-none-any.whl.metadata (9.0 kB) Collecting protobuf!=4.24.0,>=3.19.6 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) Using cached protobuf-4.25.3-cp310-abi3-win_amd64.whl.metadata (541 bytes) Collecting py-cpuinfo<10.0.0,>=9.0.0 (from ctransformers==0.2.27+cu121->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 35)) Using cached py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes) Collecting jsonschema>=3.0 (from altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached jsonschema-4.21.1-py3-none-any.whl.metadata (7.8 kB) Collecting toolz (from altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached toolz-0.12.1-py3-none-any.whl.metadata (5.1 kB) Collecting itsdangerous>=2.1.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31)) Using cached itsdangerous-2.1.2-py3-none-any.whl.metadata (2.9 kB) Collecting blinker>=1.6.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31)) Using cached blinker-1.7.0-py3-none-any.whl.metadata (1.9 kB) Requirement already satisfied: aiosignal>=1.1.2 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (23.2.0) Requirement already satisfied: frozenlist>=1.1.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (1.4.1) Requirement already satisfied: multidict<7.0,>=4.5 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (6.0.5) Requirement already satisfied: yarl<2.0,>=1.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (1.9.4) Requirement already satisfied: gitdb<5,>=4.0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from GitPython!=3.1.29,>=1.0.0->wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (4.0.11) Requirement already satisfied: mdurl~=0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from markdown-it-py>=2.2.0->rich->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (0.1.2) Requirement already satisfied: contourpy>=1.0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (1.2.1) Requirement already satisfied: cycler>=0.10 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.12.1) Requirement already satisfied: fonttools>=4.22.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (4.50.0) Requirement already satisfied: kiwisolver>=1.3.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (1.4.5) Requirement already satisfied: pyparsing>=2.3.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (3.1.2) Requirement already satisfied: anyio<5,>=3.5.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from openai>=0.6.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (4.3.0) Requirement already satisfied: distro<2,>=1.7.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from openai>=0.6.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.8.0) Requirement already satisfied: sniffio in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from openai>=0.6.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.3.1) Collecting httpcore==1. (from httpx->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached httpcore-1.0.5-py3-none-any.whl.metadata (20 kB) Requirement already satisfied: h11<0.15,>=0.13 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from httpcore==1.->httpx->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.14.0) Requirement already satisfied: annotated-types>=0.4.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.6.0) Requirement already satisfied: pydantic-core==2.16.3 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (2.16.3) Collecting nltk (from rouge-score>=0.0.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached nltk-3.8.1-py3-none-any.whl.metadata (2.8 kB) Requirement already satisfied: joblib>=1.2.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from scikit-learn>=0.24.1->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.3.2) Requirement already satisfied: threadpoolctl>=2.0.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from scikit-learn>=0.24.1->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (3.4.0) Collecting networkx (from torch>=1.10.0->accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) Using cached networkx-3.2.1-py3-none-any.whl.metadata (5.2 kB) Collecting humanfriendly>=9.1 (from coloredlogs->optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14)) Using cached humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB) Collecting DataProperty<2,>=1.0.1 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached DataProperty-1.0.1-py3-none-any.whl.metadata (11 kB) Collecting mbstrdecoder<2,>=1.0.0 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached mbstrdecoder-1.1.3-py3-none-any.whl.metadata (4.0 kB) Collecting pathvalidate<4,>=2.3.0 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached pathvalidate-3.2.0-py3-none-any.whl.metadata (11 kB) Collecting tabledata<2,>=1.3.1 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached tabledata-1.3.3-py3-none-any.whl.metadata (3.7 kB) Collecting tcolorpy<1,>=0.0.5 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached tcolorpy-0.1.4-py3-none-any.whl.metadata (5.7 kB) Collecting typepy<2,>=1.3.2 (from typepy[datetime]<2,>=1.3.2->pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached typepy-1.3.2-py3-none-any.whl.metadata (9.3 kB) Collecting mpmath>=0.19 (from sympy->optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14)) Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB) Collecting torchvision (from timm->hqq==0.1.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8)) Using cached torchvision-0.17.2-cp311-cp311-win_amd64.whl.metadata (6.6 kB) Requirement already satisfied: smmap<6,>=3.0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gitdb<5,>=4.0.1->GitPython!=3.1.29,>=1.0.0->wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (5.0.1) Collecting pyreadline3 (from humanfriendly>=9.1->coloredlogs->optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14)) Using cached pyreadline3-3.4.1-py3-none-any.whl.metadata (2.0 kB) Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl.metadata (3.0 kB) Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached referencing-0.34.0-py3-none-any.whl.metadata (2.8 kB) Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) Using cached rpds_py-0.18.0-cp311-none-win_amd64.whl.metadata (4.2 kB) Collecting chardet<6,>=3.0.4 (from mbstrdecoder<2,>=1.0.0->pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached chardet-5.2.0-py3-none-any.whl.metadata (3.4 kB) Collecting pywin32>=226 (from portalocker->sacrebleu==1.5.0->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) Using cached pywin32-306-cp311-cp311-win_amd64.whl.metadata (6.5 kB) Using cached accelerate-0.27.2-py3-none-any.whl (279 kB) Using cached bitsandbytes-0.43.0-py3-none-win_amd64.whl (101.6 MB) Using cached gradio-3.50.2-py3-none-any.whl (20.3 MB) Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB) Using cached lm_eval-0.3.0-py3-none-any.whl (178 kB) Using cached numba-0.59.1-cp311-cp311-win_amd64.whl (2.6 MB) Using cached optimum-1.17.1-py3-none-any.whl (407 kB) Using cached peft-0.8.2-py3-none-any.whl (183 kB) Using cached transformers-4.38.2-py3-none-any.whl (8.5 MB) Using cached SpeechRecognition-3.10.0-py2.py3-none-any.whl (32.8 MB) Using cached flask_cloudflared-0.0.14-py3-none-any.whl (6.4 kB) Using cached sse_starlette-1.6.5-py3-none-any.whl (9.6 kB) Using cached gradio_client-0.6.1-py3-none-any.whl (299 kB) Using cached sacrebleu-1.5.0-py3-none-any.whl (65 kB) Using cached datasets-2.18.0-py3-none-any.whl (510 kB) Using cached einops-0.7.0-py3-none-any.whl (44 kB) Using cached Markdown-3.6-py3-none-any.whl (105 kB) Using cached sentencepiece-0.2.0-cp311-cp311-win_amd64.whl (991 kB) Using cached tensorboard-2.16.2-py3-none-any.whl (5.5 MB) Using cached tqdm-4.66.2-py3-none-any.whl (78 kB) Using cached wandb-0.16.6-py3-none-any.whl (2.2 MB) Using cached absl_py-2.1.0-py3-none-any.whl (133 kB) Using cached aiofiles-23.2.1-py3-none-any.whl (15 kB) Using cached altair-5.3.0-py3-none-any.whl (857 kB) Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Using cached dill-0.3.8-py3-none-any.whl (116 kB) Using cached docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Using cached flask-3.0.2-py3-none-any.whl (101 kB) Using cached fsspec-2024.2.0-py3-none-any.whl (170 kB) Using cached grpcio-1.62.1-cp311-cp311-win_amd64.whl (3.8 MB) Using cached importlib_resources-6.4.0-py3-none-any.whl (38 kB) Using cached llvmlite-0.42.0-cp311-cp311-win_amd64.whl (28.1 MB) Using cached MarkupSafe-2.1.5-cp311-cp311-win_amd64.whl (17 kB) Using cached openai-1.16.1-py3-none-any.whl (266 kB) Using cached httpx-0.27.0-py3-none-any.whl (75 kB) Using cached httpcore-1.0.5-py3-none-any.whl (77 kB) Using cached orjson-3.10.0-cp311-none-win_amd64.whl (139 kB) Using cached protobuf-4.25.3-cp310-abi3-win_amd64.whl (413 kB) Using cached py_cpuinfo-9.0.0-py3-none-any.whl (22 kB) Using cached pyarrow-15.0.2-cp311-cp311-win_amd64.whl (24.8 MB) Using cached pybind11-2.12.0-py3-none-any.whl (234 kB) Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB) Using cached sentry_sdk-1.44.1-py2.py3-none-any.whl (266 kB) Using cached tensorboard_data_server-0.7.2-py3-none-any.whl (2.4 kB) Using cached torch-2.2.2-cp311-cp311-win_amd64.whl (198.6 MB) Using cached websockets-11.0.3-cp311-cp311-win_amd64.whl (124 kB) Using cached werkzeug-3.0.2-py3-none-any.whl (226 kB) Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) Using cached jsonlines-4.0.0-py3-none-any.whl (8.7 kB) Using cached multiprocess-0.70.16-py311-none-any.whl (143 kB) Using cached numexpr-2.10.0-cp311-cp311-win_amd64.whl (97 kB) Using cached pyarrow_hotfix-0.6-py3-none-any.whl (7.9 kB) Using cached pycountry-23.12.11-py3-none-any.whl (6.2 MB) Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB) Using cached pytablewriter-1.2.0-py3-none-any.whl (111 kB) Using cached setproctitle-1.3.3-cp311-cp311-win_amd64.whl (11 kB) Using cached sympy-1.12-py3-none-any.whl (5.7 MB) Using cached termcolor-2.4.0-py3-none-any.whl (7.7 kB) Using cached timm-0.9.16-py3-none-any.whl (2.2 MB) Using cached tqdm_multiprocess-0.0.11-py3-none-any.whl (9.8 kB) Using cached xxhash-3.4.1-cp311-cp311-win_amd64.whl (29 kB) Using cached blinker-1.7.0-py3-none-any.whl (13 kB) Using cached DataProperty-1.0.1-py3-none-any.whl (27 kB) Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB) Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB) Using cached jsonschema-4.21.1-py3-none-any.whl (85 kB) Using cached mbstrdecoder-1.1.3-py3-none-any.whl (7.8 kB) Using cached mpmath-1.3.0-py3-none-any.whl (536 kB) Using cached pathvalidate-3.2.0-py3-none-any.whl (23 kB) Using cached tabledata-1.3.3-py3-none-any.whl (11 kB) Using cached tcolorpy-0.1.4-py3-none-any.whl (7.9 kB) Using cached typepy-1.3.2-py3-none-any.whl (31 kB) Using cached networkx-3.2.1-py3-none-any.whl (1.6 MB) Using cached nltk-3.8.1-py3-none-any.whl (1.5 MB) Using cached portalocker-2.8.2-py3-none-any.whl (17 kB) Using cached toolz-0.12.1-py3-none-any.whl (56 kB) Using cached torchvision-0.17.2-cp311-cp311-win_amd64.whl (1.2 MB) Using cached chardet-5.2.0-py3-none-any.whl (199 kB) Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB) Using cached pywin32-306-cp311-cp311-win_amd64.whl (9.2 MB) Using cached referencing-0.34.0-py3-none-any.whl (26 kB) Using cached rpds_py-0.18.0-cp311-none-win_amd64.whl (206 kB) Using cached pyreadline3-3.4.1-py3-none-any.whl (95 kB) Installing collected packages: sqlitedict, sentencepiece, pywin32, pyreadline3, pydub, py-cpuinfo, mpmath, ffmpy, appdirs, xxhash, websockets, tqdm, toolz, termcolor, tensorboard-data-server, tcolorpy, sympy, setproctitle, sentry-sdk, semantic-version, rpds-py, pycountry, pybind11, pyarrow-hotfix, pyarrow, protobuf, portalocker, pathvalidate, orjson, numexpr, networkx, markupsafe, markdown, llvmlite, jsonlines, itsdangerous, importlib-resources, humanfriendly, httpcore, grpcio, fsspec, einops, docker-pycreds, dill, chardet, blinker, aiofiles, absl-py, werkzeug, tqdm-multiprocess, SpeechRecognition, sacrebleu, referencing, numba, nltk, multiprocess, mbstrdecoder, jinja2, httpx, coloredlogs, wandb, typepy, torch, tensorboard, sse-starlette, rouge-score, openai, jsonschema-specifications, gradio-client, Flask, ctransformers, transformers, torchvision, jsonschema, flask_cloudflared, datasets, bitsandbytes, accelerate, timm, peft, DataProperty, altair, tabledata, optimum, hqq, gradio, pytablewriter, lm_eval Attempting uninstall: tqdm Found existing installation: tqdm 4.65.0 Uninstalling tqdm-4.65.0: Successfully uninstalled tqdm-4.65.0 Attempting uninstall: fsspec Found existing installation: fsspec 2024.3.1 Uninstalling fsspec-2024.3.1: Successfully uninstalled fsspec-2024.3.1 Attempting uninstall: transformers Found existing installation: transformers 4.39.3 Uninstalling transformers-4.39.3: Successfully uninstalled transformers-4.39.3 Successfully installed DataProperty-1.0.1 Flask-3.0.2 SpeechRecognition-3.10.0 absl-py-2.1.0 accelerate-0.27.2 aiofiles-23.2.1 altair-5.3.0 appdirs-1.4.4 bitsandbytes-0.43.0 blinker-1.7.0 chardet-5.2.0 coloredlogs-15.0.1 ctransformers-0.2.27+cu121 datasets-2.18.0 dill-0.3.8 docker-pycreds-0.4.0 einops-0.7.0 ffmpy-0.3.2 flask_cloudflared-0.0.14 fsspec-2024.2.0 gradio-3.50.2 gradio-client-0.6.1 grpcio-1.62.1 hqq-0.1.5 httpcore-1.0.5 httpx-0.27.0 humanfriendly-10.0 importlib-resources-6.4.0 itsdangerous-2.1.2 jinja2-3.1.2 jsonlines-4.0.0 jsonschema-4.21.1 jsonschema-specifications-2023.12.1 llvmlite-0.42.0 lm_eval-0.3.0 markdown-3.6 markupsafe-2.1.5 mbstrdecoder-1.1.3 mpmath-1.3.0 multiprocess-0.70.16 networkx-3.2.1 nltk-3.8.1 numba-0.59.1 numexpr-2.10.0 openai-1.16.1 optimum-1.17.1 orjson-3.10.0 pathvalidate-3.2.0 peft-0.8.2 portalocker-2.8.2 protobuf-4.25.3 py-cpuinfo-9.0.0 pyarrow-15.0.2 pyarrow-hotfix-0.6 pybind11-2.12.0 pycountry-23.12.11 pydub-0.25.1 pyreadline3-3.4.1 pytablewriter-1.2.0 pywin32-306 referencing-0.34.0 rouge-score-0.1.2 rpds-py-0.18.0 sacrebleu-1.5.0 semantic-version-2.10.0 sentencepiece-0.2.0 sentry-sdk-1.44.1 setproctitle-1.3.3 sqlitedict-2.1.0 sse-starlette-1.6.5 sympy-1.12 tabledata-1.3.3 tcolorpy-0.1.4 tensorboard-2.16.2 tensorboard-data-server-0.7.2 termcolor-2.4.0 timm-0.9.16 toolz-0.12.1 torch-2.2.2 torchvision-0.17.2 tqdm-4.66.2 tqdm-multiprocess-0.0.11 transformers-4.38.2 typepy-1.3.2 wandb-0.16.6 websockets-11.0.3 werkzeug-3.0.2 xxhash-3.4.1 Installed successfully

Binding installed successfully INFO: ::1:54567 - "POST /install_binding HTTP/1.1" 200 OK Disconnected: U9zz13XR8kkNFHGuAAAC INFO: ::1:54603 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hgf HTTP/1.1" 200 OK INFO: ::1:54604 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hgf HTTP/1.1" 200 OK INFO: ::1:54603 - "GET /get_lollms_webui_version HTTP/1.1" 200 OK INFO: ::1:54603 - "GET /get_versionID HTTP/1.1" 200 OK Client SYgi3aAFbaKNpz1LAAAF connected INFO: ::1:54603 - "POST /socket.io/?EIO=4&transport=polling&t=Owe9Hhb&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK INFO: ('::1', 54606) - "WebSocket /socket.io/?EIO=4&transport=websocket&sid=S_zo7Z6wuxLSuo7ZAAAD" [accepted] INFO: ::1:54605 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hhe&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK INFO: ::1:54604 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hhe&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /get_config HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9HiV&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /list_databases HTTP/1.1" 200 OK INFO: ::1:54604 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9HiV&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /list_bindings HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /disk_usage HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /ram_usage HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /vram_usage HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /list_extensions HTTP/1.1" 200 OK Listing all personalities OK INFO: ::1:54605 - "GET /get_all_personalities HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /get_available_models HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /list_models HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /get_active_model HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /get_model_status HTTP/1.1" 200 OK INFO: ::1:54605 - "GET /list_discussions HTTP/1.1" 200 OK Loading discussion for client SYgi3aAFbaKNpz1LAAAF ... ok INFO: ::1:54605 - "GET /get_current_personality_files_list HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui INFO: ::1:54662 - "GET /get_config HTTP/1.1" 200 OK Listing voices INFO: ::1:54664 - "GET /list_voices HTTP/1.1" 200 OK INFO: ::1:54662 - "GET /user_infos/default_user.svg HTTP/1.1" 400 Bad Request INFO: ::1:54663 - "GET /list_personalities_categories HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui\lollms_core Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store INFO: ::1:54662 - "GET /list_extensions_categories HTTP/1.1" 200 OK INFO: ::1:54663 - "GET /list_personalities_categories HTTP/1.1" 200 OK INFO: ::1:54663 - "GET /list_personalities?category=generic HTTP/1.1" 200 OK INFO: ::1:54661 - "GET /check_update HTTP/1.1" 200 OK INFO: ::1:54663 - "GET /list_extensions_categories HTTP/1.1" 200 OK INFO: ::1:54663 - "GET /list_extensions?category=bound_extensions HTTP/1.1" 200 OK Requested updating of setting binding_name to c_transformers New binding selected : c_transformers Building model Model type : llama Binding loaded successfully Configuration binding_name updated INFO: ::1:54668 - "POST /update_setting HTTP/1.1" 200 OK INFO: ::1:54669 - "GET /get_model_status HTTP/1.1" 200 OK INFO: ::1:54669 - "GET /get_config HTTP/1.1" 200 OK Requested updating of setting model_name to None Changing model to: None Building model No model is selected Configuration model_name updated INFO: ::1:54669 - "POST /update_setting HTTP/1.1" 200 OK

• Retreiving binding settings INFO: ::1:54669 - "GET /get_active_binding_settings HTTP/1.1" 200 OK
• Setting binding settings Saving configuration INFO: ::1:54671 - "POST /set_active_binding_settings HTTP/1.1" 200 OK Binding setting updated successfully INFO: ::1:54671 - "GET /update_bindingsettings HTTP/1.1" 200 OK Disconnected: SYgi3aAFbaKNpz1LAAAF INFO: ::1:54671 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9M HTTP/1.1" 200 OK INFO: ::1:54672 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9M_ HTTP/1.1" 200 OK INFO: ::1:54671 - "GET /get_lollms_webui_version HTTP/1.1" 200 OK INFO: ::1:54671 - "GET /get_versionID HTTP/1.1" 200 OK Client xa9lGlmIu2kszQN6AAAI connected INFO: ::1:54671 - "POST /socket.io/?EIO=4&transport=polling&t=OweD9Nx&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK INFO: ('::1', 54674) - "WebSocket /socket.io/?EIO=4&transport=websocket&sid=_jWOs4-_Hr6EvhNvAAAG" [accepted] INFO: ::1:54673 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Ny&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK INFO: ::1:54672 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Ny&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /get_config HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Os&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /list_databases HTTP/1.1" 200 OK INFO: ::1:54672 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Os&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /list_bindings HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /disk_usage HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /ram_usage HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /vram_usage HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /list_extensions HTTP/1.1" 200 OK Listing all personalities OK INFO: ::1:54673 - "GET /get_all_personalities HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /get_available_models HTTP/1.1" 200 OK Listing models ok INFO: ::1:54673 - "GET /list_models HTTP/1.1" 200 OK Getting active model INFO: ::1:54673 - "GET /get_active_model HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /get_model_status HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /list_discussions HTTP/1.1" 200 OK Loading discussion for client xa9lGlmIu2kszQN6AAAI ... ok INFO: ::1:54673 - "GET /get_current_personality_files_list HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui INFO: ::1:54675 - "GET /get_config HTTP/1.1" 200 OK Listing voices INFO: ::1:54677 - "GET /list_voices HTTP/1.1" 200 OK INFO: ::1:54675 - "GET /user_infos/default_user.svg HTTP/1.1" 400 Bad Request INFO: ::1:54676 - "GET /list_personalities_categories HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui\lollms_core INFO: ::1:54675 - "GET /list_extensions_categories HTTP/1.1" 200 OK Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store INFO: ::1:54675 - "GET /list_personalities?category=generic HTTP/1.1" 200 OK INFO: ::1:54676 - "GET /list_personalities_categories HTTP/1.1" 200 OK INFO: ::1:54675 - "GET /list_extensions_categories HTTP/1.1" 200 OK INFO: ::1:54675 - "GET /list_extensions?category=bound_extensions HTTP/1.1" 200 OK INFO: ::1:54673 - "GET /check_update HTTP/1.1" 200 OK Install model triggered Hugging face model detected Model install requested Model path : https://huggingface.co/vilm/Quyen-Pro-v0.1-GGUF/resolve/main/Quyen-Pro-v0.1_Q8_0.gguf Installation Path : D:\lollms-webui\personal_data\models\gguf\Quyen-Pro-v0.1-GGUF\Quyen-Pro-v0.1_Q8_0.gguf File downloaded successfully! INFO: ::1:54823 - "GET /disk_usage HTTP/1.1" 200 OK Requested updating of setting model_name to Quyen-Pro-v0.1-GGUF Changing model to: Quyen-Pro-v0.1-GGUF Building model Model type : llama Traceback (most recent call last): File "d:\lollms-webui\lollms-webui\lollms_core\lollms\server\endpoints\lollms_configuration_infos.py", line 105, in update_setting lollmsElfServer.model = lollmsElfServer.binding.build_model() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers__init__.py", line 152, in build_model self.model = AutoModelForCausalLM.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\hub.py", line 175, in from_pretrained llm = LLM( ^^^^ File "D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\llm.py", line 246, in init self._lib = load_library(lib, gpu=config.gpu_layers > 0) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\llm.py", line 126, in load_library lib = CDLL(path) ^^^^^^^^^^ File "D:\lollms-webui\installer_files\lollms_env\Lib\ctypes__init.py", line 376, in init__ self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: Could not find module 'D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax.

It looks like you we couldn't load the model. Here is the error message: Could not find module 'D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax. Configuration model_name updated INFO: ::1:54831 - "POST /update_setting HTTP/1.1" 200 OK INFO: ::1:54831 - "GET /get_model_status HTTP/1.1" 200 OK

Screenshots

[saintwolf]

I get this too when I try to load any models. I've tried reinstalling the c_transformer bindings but it didn't work. I've also tried deleting anything related to it in the personal_data folder, which reinstalled the binding and reported that it was loaded, but when I try to load a model I get the below error:

Requested updating of setting model_name to Starling-LM-7B-beta-GGUF
Changing model to: Starling-LM-7B-beta-GGUF
Building model
Model type : llama
Traceback (most recent call last):
  File "/root/lollms-webui/lollms-webui/lollms_core/lollms/server/endpoints/lollms_configuration_infos.py", line 105, in update_setting
    lollmsElfServer.model = lollmsElfServer.binding.build_model()
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/lollms-webui/lollms-webui/zoos/bindings_zoo/c_transformers/__init__.py", line 149, in build_model
    from ctransformers import AutoModelForCausalLM
ModuleNotFoundError: No module named 'ctransformers'

[boneylizardwizard]

I'm getting this same error. No GGUF models are loading whatsoever:

INFO: ::1:49848 - "POST /update_setting HTTP/1.1" 200 OK INFO: ::1:49848 - "GET /get_model_status HTTP/1.1" 200 OK Requested updating of setting model_name to randomggufmodelbyTheBloke Changing model to: randomggufmodelbyTheBloke Building model Model type : llama Traceback (most recent call last): File "c:\users\randomusername\onedrive\documents\lollms\lollms-webui\lollms_core\lollms\server\endpoints\lollms_configuration_infos.py", line 105, in update_setting lollmsElfServer.model = lollmsElfServer.binding.build_model() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\randomusername\OneDrive\Documents\lollms\lollms-webui\zoos\bindings_zoo\c_transformers__init__.py", line 152, in build_model self.model = AutoModelForCausalLM.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\randomusername\OneDrive\Documents\lollms\installer_files\lollms_env\Lib\site-packages\ctransformers\hub.py", line 175, in from_pretrained llm = LLM( ^^^^ File "C:\Users\randomusername\OneDrive\Documents\lollms\installer_files\lollms_env\Lib\site-packages\ctransformers\llm.py", line 246, in init self._lib = load_library(lib, gpu=config.gpu_layers > 0) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\randomusername\OneDrive\Documents\lollms\installer_files\lollms_env\Lib\site-packages\ctransformers\llm.py", line 126, in load_library lib = CDLL(path) ^^^^^^^^^^ File "C:\Users\randomusername\OneDrive\Documents\lollms\installer_files\lollms_env\Lib\ctypes__init.py", line 376, in init__ self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: Could not find module 'C:\Users\randomusername\OneDrive\Documents\lollms\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax.

It looks like you we couldn't load the model. Here is the error message: Could not find module 'C:\Users\randomusername\OneDrive\Documents\lollms\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax. Configuration model_name updated INFO: ::1:49856 - "POST /update_setting HTTP/1.1" 200 OK INFO: ::1:49856 - "GET /get_model_status HTTP/1.1" 200 OK

[ParisNeo]

Hi. Pllease consider using llama_cpp_python binding for the time being. I'll take a look at the ctransformers and try to fix it. I did not use it for ages.