-
义父，安装依赖的时候，其中llama-cpp-python==0.2.89这个安装错误啊！这个依赖有什么作用的，能不能不用安装啊
-
For the latest version `v0.2.81`:
1. If I install it via prebuilt channel:
```
pip install -U llama-cpp-python --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cpu
```
Import er…
-
### Describe the problem
I would like if the collections class had a built-in function for using a local model and llamacpp to embed the documents
### Describe the proposed solution
Since I have no…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
Hi There, I am observing a difference in output between llama factory inference and llama.cpp.
I am…
anidh updated
9 hours ago
-
### System Info
HW
- EC2: g6e.12x
- GPU: L40S
- CUDA: 550.127.05
- Branch: commit 201135e58aa525af7e523d091d4c9584229524bc (HEAD, tag: v0.13.0)
Data
- Model: Llama-2-7b-hf
### Who can help?
@bys…
-
# Expected Behavior
destructor llama normally
# Current Behavior
# source code:
import bs4
from langchain import hub
from langchain_community.document_loaders import WebBaseLoader
from langch…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
eli6 updated
3 months ago
-
Hi,
I am running llama-cpp-python on surface book 2 having i7 with nvidea geforce gtx 1060.
I installed vc++, cuda drivers 12.4
Running on Python 3.11.3
Compiled llama using below command on Min…
-
how to fix it?
PLEASE HELP ME :)
# ComfyUI Error Report
## Error Details
- **Node Type:** LLavaSamplerSimple
- **Exception Type:** OSError
- **Exception Message:** exception: access violatio…
-
```
`Building wheels for collected packages: llama-cpp-python
Building wheel for llama-cpp-python (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for llama-…