-
### Describe what should be investigated or refactored
The LeapfrogAI llama-cpp-python backend has not been updated in a long time, dependencies wise and code-wise. It lacks the necessary code and …
-
# llama_get_logits_ith: invalid logits id -1 error when embedding=True
## Expected Behavior
When using llama-cpp-python with Qwen2 model, the chat completion should work normally regardless of w…
-
### Describe the bug
webui crashes after sending prompt
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
1) `./start_linux.sh`
2) load a model
…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [Y] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Traceback (most recent call last):
File "/data/zhy/models/llama_cpp_python/model_test.py", line 1, in
from llama_cpp import Llama
File "/data/zhy/models/llama_cpp_python/llama_cpp/__init__…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ ] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Right now we call llama.cpp directly, long-term we should go with either llama.cpp directly or llama-cpp-python. Because maintaining two different llama.cpp backends isn't ideal, they will never be in…
-
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (llama-cpp-python)
I have updated the gcc version but still the error.
Working for ubuntu verison 24.04 LT…
-
(base) C:\Users\m>pip install llama-cpp-python
Collecting llama-cpp-python
Using cached llama_cpp_python-0.2.85.tar.gz (49.3 MB)
Installing build dependencies ... done
Getting requirements t…