-
### System Info / 系統信息
- vllm 0.5.3
- transformer 4.44.0
- torch 2.3.1
### Who can help? / 谁可以帮助到您？
@sixsixcoder @zr
### Information / 问题信息
- [X] The official example scripts / 官方的示例脚…
-
I use the latest code, in main,dev；i find use api in api/main.py, the web result is error, no voice and server has：lzma.LZMAError: Corrupt input data
1.i try check model,code and pip package,it's r…
-
I tried to run some models with Toolio in server mode. I'm running the server in DEBUG to see all the logs. When prompting a model in both TypingMind and big-AGI, I get "Load failed" instead of the ou…
-
### System Info
cpu intel 14700k
gpu rtx 4090
tensorrt_llm 0.13
docker tritonserver:24.09-trtllm-python-py3
### Who can help?
@ncomly-nvidia
### Information
- [X] The official example scripts…
-
### What happened?
When using litellm to interact with Ollama models and fallbacks are configured, the fallback mechanism does not function correctly when the stream=True option is used.
**Steps t…
-
I installed spar and onboarded spar as an oidc client for esignet.
I loaded some mock user data on esignet and able to login with those uin id. However after logging in i am just getting blank page
…
-
### Checklist
- [X] There are no similar issues or pull requests for this yet.
### Is your feature related to a problem? Please describe.
Hi, was working on a task and ran into an issue where…
-
### First Check
- [X] This is not a feature request.
- [X] I added a very descriptive title to this issue (title field is above this).
- [X] I used the GitHub search to find a similar issue and d…
-
Привіт розробникам!
Message in talk: @assistant What sounds do cats make?
docker logs -f nc_app_talk_bot_ai
```
TRACE: 127.0.0.1:39434 - HTTP connection made
TRACE: 127.0.0.1:39434 - …
-
### First Check
- [X] I used the GitHub search to find a similar issue and didn't find it.
- [X] I have verified that this issue _is not_ related to the underlying library
[hhyrsev/recipe-scrapers](h…