LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.36k stars 312 forks source link

[WinError 1114] A dynamic link library (DLL) initialization routine failed #785

Open jm18499 opened 2 months ago

jm18499 commented 2 months ago

D:\AI>koboldcpp.exe --threads 2 --blasthreads 2 --nommap --usecublas --gpulayers 50 --highpriority --blasbatchsize 512 --contextsize 8192

Welcome to KoboldCpp - Version 1.62.2 For command line arguments, please refer to --help

Setting process to Higher Priority - Use Caution High Priority for Windows Set: Priority.NORMAL_PRIORITY_CLASS to Priority.HIGH_PRIORITY_CLASS Attempting to use CuBLAS library for faster prompt ingestion. A compatible CuBLAS will be required. Initializing dynamic library: koboldcpp_cublas.dll Traceback (most recent call last): File "PyInstaller\loader\pyimod03_ctypes.py", line 53, in init File "ctypes__init.py", line 373, in init__ OSError: [WinError 1114] A dynamic link library (DLL) initialization routine failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "koboldcpp.py", line 3195, in File "koboldcpp.py", line 2878, in main File "koboldcpp.py", line 270, in init_library File "PyInstaller\loader\pyimod03_ctypes.py", line 55, in init pyimod03_ctypes.PyInstallerImportError: Failed to load dynlib/dll 'C:\Temp\_MEI127722\koboldcpp_cublas.dll'. Most likely this dynlib/dll was not found when the application was frozen. [14344] Failed to execute script 'koboldcpp' due to unhandled exception!


I read through issue #778 and used the DependencyGUI tool and found these two are missing .dlls: oobe-query-11-1-0.dll ext-ms-win-core-winrt-remote-11-1-0.dll

I don't know where to download them or what they are exactly.

LostRuins commented 2 months ago

Kindly share your System specs and OS version.

Also are you sure those dlls are required? That seems quite unlikely.

MEuterpe commented 2 months ago

I got the exactly same error, and the same missing dlls, have you fixed this problem?

LostRuins commented 2 months ago

I need to know some system info before I'm able to figure out where the missing dlls are from.

MEuterpe commented 2 months ago

I need to know some system info before I'm able to figure out where the missing dlls are from.

win10 professional with version 22H2, X64 operating system

MEuterpe commented 2 months ago

Enabling the AVX2 can solve the issue.