-
### Feature request / 功能建议
None
### Motivation / 动机
None
### Your contribution / 您的贡献
None
-
Hi,
I'm probably missing something about how ollama works or am I facing a kind of side effect.
I use a super simple code to get 3 outputs given a simple input `Why is the sky blue?` (in order t…
-
Really new to this but i got a few error. I mention the bot than it try to reply but didnt reply. Here is the error
- Nvidia A100
- Mistral-7B-Instruct-v0.2
- Using the CPP runner
- Installed with `pip install tensorrt_llm==0.8.0 --extra-index-ur…
iibw updated
2 months ago
-
Hi, wanna ask ,does mantis used image separator between images sending to LLM? From i can tell, llava doesn't have it and the data used in Mantis doesn't provide a str for separator too.
Also, do u…
-
Noticing a `Error: unmarshal: invalid character 'p' after top-level value` on `ollama run llava`
`client version is 0.1.22`
-
# Bug Report
## Description
**Bug Summary:**
The system prompt set at Settings -> General -> System prompt is being totally ignored lately (it has correctly worked in my setup previously). Also…
-
### What is the issue?
As I served my VL models, It can not work correctly.
Here. I tried the Minicpm-llama3-V-2.5, and convert it to GGUF format under the instruction from the official repository:…