bitsandbytes-foundation / bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.
https://huggingface.co/docs/bitsandbytes/main/en/index
MIT License
6.27k stars 627 forks source link

A dynamic link library (DLL) initialization routine failed error message #320

Closed mynewopportunities closed 10 months ago

mynewopportunities commented 1 year ago

Traceback (most recent call last): File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\lib\site-packages\llama_cpp\llama_cpp.py”, line 54, in _load_shared_library return ctypes.CDLL(str(lib_path)) File "C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\lib\ctypes_init.py", line 374, in init self._handle = _dlopen(self._name, mode) OSError: [WinError 1114] A dynamic link library (DLL) initialization routine failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\text-generation-webui[server.py](http://server.py/)”, line 84, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name) File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\text-generation-webui\modules[models.py](http://models.py/)”, line 107, in load_model from modules.llamacpp_model_alternative import LlamaCppModel File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\text-generation-webui\modules\llamacpp_model_alternative.py”, line 9, in from llama_cpp import Llama File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\lib\site-packages\llama_cppinit.py”, line 1, in from .llama_cpp import * File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\lib\site-packages\llama_cpp\llama_cpp.py”, line 67, in _lib = _load_shared_library(_lib_base_name) File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\lib\site-packages\llama_cpp\llama_cpp.py”, line 56, in _load_shared_library raise RuntimeError(f"Failed to load shared library ‘{_lib_path}’: {e}") RuntimeError: Failed to load shared library ‘C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\Lib\site-packages\llama_cpp\llama.dll’: [WinError 1114] A dynamic link library (DLL) initialization routine failed

github-actions[bot] commented 10 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.