-
can ollama URL be configured to point to remote box?
or try use ssh tunnel to make remote ollama appear to be local
-
### Do you need to file an issue?
- [ ] I have searched the existing issues and this bug is not already filed.
- [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers…
-
### What happened?
# environment
* autogen 0.4
* litellm 1.53.1
* ollama version is 0.3.14
* ollama model is qwen2.5:14b-instruct-q4_K_M.
# Infomation
I use autogen+litellm+ollama for my lo…
-
I am consistently seeing this error when I try to invoke my LangChain chain which includes `RunnableRails` inside of an MLflow run:
```
LLMCallException: LLM Call Exception: Connection error.
```
It …
-
用以下方式验证glm4-9b-chat模型的输出，serving端报错
curl --request POST \
--url http://127.0.0.1:8000/v1/chat/completions \
--header 'content-type: application/json' \
--data '{
"model": "glm-4-9…
-
**Describe the bug**
I followed the example on LLama3 and run into below issues on GPT-J
```
2024-11-05T15:58:25.267390+0000 | _check_compile_recipe | INFO - Recipe compiled and 1 modifiers cre…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I don't use huggingface because of proxy issue. So, I tried to make local embeddin…
-
**Describe the bug**
Hi, all. Working on a blog article, following a mix of local documentation + Intelligent app workshop, but instead of going Falcon, I've gone with the Mistral 7b model. and at …
-
I only modified t6 instead of t4, t4 t5 both work well for this model，but if we set the thread=6，will always trigger the problem on my XIAOMI14Pro(SM8650 8Gen3)
please check it for resolve
thanks~
…
-
### System Info
TEI Image v1.4.0
AWS Sagemaker Deployment
1 x ml.g5.xlarge instance Asynchronous Deployment
Link to prior discussion: https://discuss.huggingface.co/t/async-tei-deployment-c…