-
**描述一下Bug**
例如“無理無理無理無理”的输出可能会是“不行不行不行不行不行不行不行……”,即重复输出的语气词的次数超过了原文的次数。
**版本与参数(重要)**
- OS: Win 11
- Python版本 3.10
- 是否使用GPU,使用什么GPU. 4070 Ti Super
- 你使用的llama.cpp/llama-cpp-python/autogpt…
-
I bought a new virtual server and I'm trying to install it. but I get the errors in the images. what could be the problem?
I added the error log below
command used: "npm install -g humanifyjs"
…
-
I have cloned Llama.cpp and compiled it using the following command:
```
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake .. -DBUILD_SHARED_LIBS=ON -DLLAMA_BLAS=ON -DLLA…
-
i am installing llama-cpp-python for privategpt, after following the instructions i was getting few errors one of the error was privategpt requires llama-cpp-python at several process
so I started i…
-
Requesting a little help here. Trying to test out copilot functionality with `llama-cpp-python` with this extension. Below is my configuration setting.
```bash
{
"[python]": {
"edit…
-
Any advice for an older 6600XT card that seems to want "gfx1032" for llama.cpp? I've tried with Ubuntu 24 and 23.10 and get this crash:
```
rocBLAS error: Cannot read /opt/rocm/lib/rocblas/libra…
-
### Environment
🪟 Windows
### System
Windows 10
### Version
1.12.3
### Desktop Information
* Generation API - llama-cpp
### Describe the problem
Very recently, issue [#8402](https://github.co…
-
**Describe the bug**
Can get work on tabby 0.13.1 or 0.14.0 follow by the quick-start guide, it's just start process with the a embed model
/opt/tabby/bin/llama-server -m /data/models/TabbyML/Nom…
-
Models generated recently don't work, for example anything llama 3.1 based.
-
Hi, I am having an issue with running the sample example in the [quickstart guide](https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md#3-example-runnin…