Open Autumnlight02 opened 11 months ago
Following up on discord with Henky.
I had this problem today.
For me the issue was the order of my paths in the PATH env picking up libstdc++.so.6 from an anaconda install.
I solved this error by setting the PATH env before running koboldcpp.py:
cd koboldcpp
PATH=/usr/bin ./koboldcpp.py --model models/dolphin-2.5-mixtral-8x7b.Q5_K_M.gguf --contextsize 8192 --launch
Running on Fedora 39
Prerequisites
Please answer the following questions for yourself before submitting an issue.
Expected Behavior
The software should run
Current Behavior
When i try to load a Model I get:
`Welcome to KoboldCpp - Version 1.44.2 For command line arguments, please refer to --help
Attempting to use OpenBLAS library for faster prompt ingestion. A compatible libopenblas will be required. Initializing dynamic library: koboldcpp_openblas.so Traceback (most recent call last): File "/home/autumnlight/Documents/ai/koboldcpp/./koboldcpp.py", line 1914, in
main(parser.parse_args(),start_server=True)
File "/home/autumnlight/Documents/ai/koboldcpp/./koboldcpp.py", line 1781, in main
init_library() # Note: if blas does not exist and is enabled, program will crash.
^^^^^^^^^^^^^^
File "/home/autumnlight/Documents/ai/koboldcpp/./koboldcpp.py", line 184, in init_library
handle = ctypes.CDLL(os.path.join(dir_path, libname))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/autumnlight/.distrobox/archo/miniconda3/lib/python3.11/ctypes/init.py", line 376, in init
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: /home/autumnlight/.distrobox/archo/miniconda3/bin/../lib/libstdc++.so.6: version
GLIBCXX_3.4.32' not found (required by /home/autumnlight/Documents/ai/koboldcpp/koboldcpp_openblas.so)
Environment and Context
Inside of an arch distrobox, strings /usr/lib/libstdc++.so.6 | grep GLIBCXX =>
... GLIBCXX_3.4.27 GLIBCXX_3.4.28 GLIBCXX_3.4.29 GLIBCXX_3.4.30 GLIBCXX_3.4.31 GLIBCXX_3.4.32 ...
$ lscpu
Linux archo.fedora 6.3.12-100.fc37.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 5 20:09:58 UTC 2023 x86_64 GNU/Linux Basically host is fedora Inside of an isolated arch distrobox.
Failure Information (for bugs)
BUG
Steps to Reproduce
Please provide detailed steps for reproducing the issue. We are not sitting in front of your screen, so the more detail the better.