-
- [ ] I checked to make sure that this is not a duplicate issue
### Describe the solution you'd like
目前部署不支持ollama ，部署难点比较大
-
### Pre-check
- [X] I have searched the existing issues and none cover this bug.
### Description
When running the docker instance of privategpt with Ollama, I get an error saying: TypeError: missin…
-
It seems that `async` functions on https://docs.rs/langchain-rust/latest/langchain_rust/output_parsers/struct.MarkdownParser.html are in the expanded form (`impl Future`, etc.).
However, on other c…
-
Hey thanks for putting this project together. I just got a new laptop with an Arc integrated gpu, and went searching for a way to get ollama to use it. It's nice to see `intel_gpu_top` showing activit…
-
so has anyone got shell_gpt to work with a remote ollama Server ?
I have a ollama server on a remote machine in my local network, and try to use shell_gpt on my local pc.
But sgpt still trying to co…
-
### 你是否已经阅读并同意《Datawhale开源项目指南》？
- [X] 我已阅读并同意[《Datawhale开源项目指南》](https://github.com/datawhalechina/DOPMC/blob/main/GUIDE.md)
### 你是否已经阅读并同意《Datawhale开源项目行为准则》？
- [X] 我已阅读并同意[《Datawhale开源项目行为…
-
without AVX runner the performance is going to be crippled as discussed in https://github.com/ollama/ollama/issues/2821
-
CPU: i5-1335U
RAM: 16GB
OS: Ubuntu 22.04.10
Kernel: 6.8.0-45
logs:
```txt
2024/09/30 15:34:06 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBL…
-
The ollama api should be callable using the OpenAIApi and just changing the API Host to point to the ollama serv location, but ollama streams by default and i think this is causing it to fail with Gla…
-
### Model Series
Qwen2.5
### What are the models used?
Qwen2.5-7B-Instruct
### What is the scenario where the problem happened?
deployment with vllm, tool calling with ollama
### Is this a known…