-
## Description
Our chat API routes located in the `src/app/api/chat/[provider]/route.ts` files are currently experiencing a critical error when processing large prompts. Specifically, we're encounter…
-
Reproducible on the version `24.10` when run against a NIM server serving `meta/llama-3.1-8b-instruct`.
# Steps to reproduce:
## Perform two profiling runs:
```
genai-perf profile \
-m meta/ll…
-
hello. When I use perplexity the call is sending to the wrong model type.
[Service Issue] Perplexity: Bad Request (400): "error": { "message": "Invalid model 'llama-3-sonar-large-32k-chat'. Permitt…
-
[https://console.groq.com/docs/text-chat#json-mode-object-object](https://console.groq.com/docs/text-chat#json-mode-object-object)
How can I use "response_format": {"type": "json_object"} with Groq…
-
### Issue
Aider is one one of the (if not the) best coding tools around. But beside aider there are lots of other VS Code, Intellij IDEA etc plugins which try to do the same and are not so good. Peop…
-
**Is your feature request related to a problem? Please describe.**
The python html sample and the javascript html sample are create for desktop use but when shrinking the screen the avatar goes out o…
-
Hi,
After running across the documentation of the Azure CLI and more specifically the Bot Services part I noticed that the create and delete commands were not available for the Web Chat channels.
…
-
Have you considered integration with RocketChat ?
https://www.rocket.chat/
In a corporate environment it is more correct to use corporate tools independent of external services (such as telegram…
-
如果查询问题经过chatgpt web版联网处理后好像会有一些格式和符合显示问题。
使用的最新版本地部署[3298ebf](https://github.com/lanqian528/chat2api/commit/3298ebf3b06a51701289cafdcd9110d71dd097c5)
```
from openai import OpenAI
client = Ope…
-
**Is your feature request related to a problem? Please describe.**
Add support for new parameter service_tier in OpenAI completions API
https://platform.openai.com/docs/api-reference/chat/object#c…