-
I am using an M1, on commit 928e0b70.
When I run
`./llava-cli -m ./models/llava-v1.6-mistral-7b/ggml-mistral-7b-q_5_k.gguf --mmproj ./models/llava-v1.6-mistral-7b/mmproj-mistral7b-f16-q6_k.gguf …
-
Hi,
First and foremost, I want to express my gratitude for the idea behind this project and the way you keep up with the development.
3 days ago I created a small issue regarding [PHI-3 demo her…
-
Hi.
I am executing this code to merge Phi-3 models:
https://github.com/Leeroo-AI/mergoo/blob/main/notebooks/integrate_phi3_experts.ipynb
The result looks like this:
```text
ll integrate_phi3_…
-
**Describe the bug**
The interactive mode (`-i`) does not understand EOF. In interactive CLIs, `ctrl-d` is usually used to exit them, which emits an EOF into the stream. This just causes `mistral.r…
-
This is a regression.
* building new container July 16 2024
* The image built 4 days before this worked fine. Now all searches fail when the vector database is enabled.
##. Problem Report
I…
-
### System Info
```
docker pull ghcr.io/huggingface/text-generation-inference:latest
latest: Pulling from huggingface/text-generation-inference
Digest: sha256:00d7f1cf3c6fce0a48ff9f2e0451cfa60a0…
-
### Bug Report
When one enters a certain prompts (the text from https://users.ece.cmu.edu/~gamvrosi/thelastq.html for instance), the chat gets stuck: there is apparently some processing going on, b…
-
I tried running .NET 6 app (C#) using nuget package Microsoft.ML.OnnxRuntimeGenAI.Cuda v0.2.0
Visual Studio 2022 gives this error when running in Debug mode X64 target.
System.DllNotFoundException…
-
When I modified “run_example.sh” and changed backend to vllm,
I got the error message down below, I will do some some check whether the error comes from server side or client side.
I notice t…
-
![QQ截图20240611082851](https://github.com/heshengtao/comfyui_LLM_party/assets/130342241/899689dc-9b08-4ca6-9ed9-7d1152917738)