-
Hi! :)
I'm using `llama-cpp-python==0.2.60`, installed using this command `CMAKE_ARGS="-DLLAMA_METAL=on" pip install llama-cpp-python`.
I'm able to load a model using `type_k=8` and `type_v=8` …
ddh0 updated
7 months ago
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ ] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
### 提交前必须检查以下项目
- [X] 请确保使用的是仓库最新代码（git pull），一些问题已被解决和修复。
- [X] 我已阅读[项目文档](https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/wiki)和[FAQ章节](https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/wiki/常见问题)并且已…
-
**LocalAI version:**
v2.15.0 (f69de3be0d274a676f1d1cd302dc4699f1b5aaf0)
Downloaded CLI local-ai-git-Darwin-arm64
Also tried docker image
**Environment, CPU architecture, OS, and Version:**…
-
not a bug, but the question: are there plans to support chatglm in the future ?
i was tying to use this model: https://huggingface.co/bartowski/codegeex4-all-9b-GGUF
thanks!
-
### Error Description
I am encountering the error, `Native API returns: -30 (PI_ERROR_INVALID_VALUE)`, when trying to run llama.cpp with the latest IPEX-LLM, following the official quickstart guide o…
-
### 🚀 The feature, motivation and pitch
Add support for control vectors
See https://github.com/vgel/repeng and https://github.com/ggerganov/llama.cpp/pull/5970
### Alternatives
_No response_
##…
-
**Describe the Issue**
Since Control Vectors were implemented in [llama.cpp](https://github.com/ggerganov/llama.cpp/pull/5970) a few months ago there still doesn't seem to be any way to actually use …
-
### What happened?
I have the following code (roughly) executed at some point for prompt processing:
Afterw…
-
## Describe the bug
When i add a new offline ,odel and start the chat with any input., i can see that khoj starts to download the model in the console. but after it finished downloading the model, kh…