-
### What is the issue?
As I served my VL models, It can not work correctly.
Here. I tried the Minicpm-llama3-V-2.5, and convert it to GGUF format under the instruction from the official repository:…
-
# Bug Report
## Installation Method
I installed open-webui using docker compose via the `run-compose.sh` script.
## Environment
- **Open WebUI Version:** 0.3.31
- **Ollama (if applicable)…
-
Hi,
when running ollama, it hangs up after a few times calling "generate".
It shows no error or something, justt hangs up for hours until it is killed manually.
Stopping and then restarting ollama…
-
### What happened?
We expected to see similar performance in llama.cpp when compared to ipex-llm. But llama.cpp was almost two times slower than ipex-llm given all the parameters were the same.
…
-
Now that OpenAI is adding voice and image to ChatGPT and will probably be the new norm, wouldn't it be a good idea for llama.cpp to also please add this to the roadmap? if possible?
-
Hello, I tried to access 'llama 2' and 'mistral' model to build a local open-source LLM chatbot. However, maybe I access your website too ofter during debugging, I met this error : 'ConnectionError: H…
-
I have no idea, I am just going to put it here ;p
I have executed pip install -r requirements.txt and pip install -r faster_whisper_requirements.txt [because I want everything to run locally].
Pla…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
```bash
(lmdeploy042) yuzail…
-
### What is the issue?
I have already downloaded qwen:7b, but when i run `ollama run qwen:7b`,got this error `Error: timed out waiting for llama runner to start:`, in the server.log have this msg `g…
-
### What is the issue?
The ollama.ai certificate has expired today, ollama now can't download models:
```
ollama run mistral
pulling manifest
Error: pull model manifest: Get "https://registry.…
psy-q updated
4 months ago