-
chatbot will be implemented using google gemini api
-
Hello There,
This may not be specifically a bug, but there seems to be some issue.
For a single chat request sent from bot UI, metrics report that 3 or 3x Open AI requests were made. Also the toke…
-
### Your current environment
2*A100 配置 启动项
python -m vllm.entrypoints.openai.api_server --host 0.0.0.0 --port 7864 --max-model-len 8000 --served-model-name chat-v2.0 --model /workspace/sdata/checkpo…
-
### Your current environment
vllm 0.6.0
### 🐛 Describe the bug
when I try this
vllm serve neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8 --host 0.0.0.0 --port 8000 --tensor-parallel-size 8 --se…
-
- [x] Document API Tools API & in chatbot sessions under "Develop AI Apps"
- Provide a trivial example of an OpenAPI schema (https://github.com/helixml/example-helix-app/blob/main/openapi/jobvacancie…
-
The chatbot instance should throw, or at least, not "ignore" while failed attempt on api-platform authentication.
-
I wanted to bring to your attention a couple of issues I've encountered while using your service:
The other model service providers I use have their own API base URLs.
When I input my API base URL,…
-
The iterative prompting process takes a lot of time, maybe better to implement a similar stream to openAI api
```python
for resp in chatbot.query(
"Hello",
stream=True
):
print(resp…
-
Sometimes for Twitch it can be useful that the bot does not react to every user but only to users with a certain role (streamer, mod, subscriber, vip, follower etc.). This would also help to limit the…
-
Dear All,
I have integrated the Anthropic API key into the chatbot-ui, but I encountered an error message on the console. The error message reads: "Error calling Anthropic API: [TypeError: Cannot r…