LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.35k stars 312 forks source link

OSError: dlopen failed: library "/data/data/com.termux/files/home/koboldcpp/koboldcpp_default.so" not found #871

Open NIEMONARCH opened 1 month ago

NIEMONARCH commented 1 month ago

When I put command ~/koboldcpp $ python koboldcpp.py --model KobbleTiny-Q4_K.gguf

I get an error *** Welcome to KoboldCpp - Version 1.66.1 Warning: OpenBLAS library file not found. Non-BLAS library will be used. Initializing dynamic library: koboldcpp_default.so Traceback (most recent call last): File "/data/data/com.termux/files/home/koboldcpp/koboldcpp.py", line 3540, in main(parser.parse_args(),start_server=True) File "/data/data/com.termux/files/home/koboldcpp/koboldcpp.py", line 3164, in main init_library() # Note: if blas does not exist and is enabled, program will crash. ^^^^^^^^^^^^^^ File "/data/data/com.termux/files/home/koboldcpp/koboldcpp.py", line 282, in init_library handle = ctypes.CDLL(os.path.join(dir_path, libname)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/data/data/com.termux/files/usr/lib/python3.11/ctypes/init.py", line 376, in init self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: dlopen failed: library "/data/data/com.termux/files/home/koboldcpp/koboldcpp_default.so" not found

To run an AI ~/koboldcpp $ python koboldcpp.py --model KobbleTiny-Q4_K.gguf **

LostRuins commented 1 month ago

sounds like you're running koboldcpp from a directory that doesnt have sufficient permissions to read/execute from, or you did not perform the build steps correctly. Are you following the termux guide on the readme?.

NIEMONARCH commented 1 month ago

I retyped make Waited and it loaded fine

NIEMONARCH commented 1 month ago

I retype make, Waited and it works