-
![rust00](https://user-images.githubusercontent.com/67513038/146173748-cbfea7c9-3af7-49cb-8a22-1eebebe41ff6.jpg)
![python00](https://user-images.githubusercontent.com/67513038/146173763-af249b79-1838…
-
# Prerequisites
pip install llama-cpp-python --verbose
# Environment and Context
```
$ python3 --version
Python 3.12.3
$ make --version
GNU Make 3.82
$ g++ --version
gcc (GCC) 11.2.0
```…
-
C:\Windows\System32>pip install llama-cpp-python
WARNING: Ignoring invalid distribution ~ip (C:\Python312\Lib\site-packages)
Collecting llama-cpp-python
Using cached llama_cpp_python-0.2.87.tar.g…
-
(base) C:\Users\m>pip install llama-cpp-python
Collecting llama-cpp-python
Using cached llama_cpp_python-0.2.85.tar.gz (49.3 MB)
Installing build dependencies ... done
Getting requirements t…
-
### Issue Kind
Brand new capability
### Description
Based on the llama-cpp-python installation documentation, if we want to install the lib with CUDA support (for example) we have 2 options :
P…
-
# Current Behavior
I run the following:
CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python --verbose
an error occured:
ERROR: Failed building wheel for llama-cpp-python
# Environment …
-
**Describe the package you'd like added**
`llama.cpp` has become a popular inference server for LLMs. Additionally, `llama-cpp-python` is commonly used to connect from Python to `llama.cpp`.
- `l…
-
Building wheels for collected packages: llama-cpp-python
Building wheel for llama-cpp-python (pyproject.toml) ... error: subprocess-exited-with-error
× Building wheel for llama-cpp-python (p…
-
Hi,
Thanks for creating this wonderful package!
The [save_to_gguf](https://github.com/unslothai/unsloth/blob/2f2b478868f63b66aaaa93db66ab3d811cddc95e/unsloth/save.py#L867) currently fails because …
knc6 updated
2 months ago
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…