-
环境：操作系统win10，python版本v3.10.14，llama_cpp_python库的版本v3.1.0
直接跑项目里的自带的llama1.py或llama2.py文件都会报错（gguf模型文件已下载且路径正确）
比如执行python llama2.py后的错误信息如下：
 for questions
- [X] I'm not able to find an [open issue](ht…
-
I'm trying to install llama-cpp-python through `CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python` but met this error. Any suggestion?
```
× Building wheel for llama-cpp-python (pyproject.…
-
**Describe the bug**
Installation from HACS worked fine, however when initializing the integration I get a "Failed to set up" error in HA UI
**Expected behavior**
Integration would instal…
-
means a single model handles multiple requests simultaneously
-
Hi,
I'm trying to compile a llama-3.2. I have followed the setup instructions but before I can get to running the `mlc_llm compile` command, I am running `./web/prep_emcc_deps.sh` which fails with …
-
**描述一下Bug**
自动填充的主语存在问题
**复现步骤**
原文是：
い、いや・・・
よろしければ、もう少し閉じ込めて
用ds跑出来的翻译结果是：
呃，不……
如果可以的话，再多关一会儿
也是可以的……
sakura的翻译结果是：
不、不是……
如果你愿意的话，我可以再把你关在这里一段时间……
个人修正后的翻译结果是：如果你愿意的话，你可以再…
-
## install
pip install llama-cpp-python \
--extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu121 --no-cache-dir
## code
from llama_cpp import Llama
model_path="/root/mode…
-
```
note-taker on main via 🐍 v3.10.1 (.venv)
❯ pip install -r requirements.txt
Collecting huggingface_hub (from -r requirements.txt (line 1))
Downloading huggingface_hub-0.26.2-py3-none-any.wh…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- I am running the latest code. Development is very rapid so there are no tagged versions as of now.
…