-
### Bug Description
想使用groq的llama3模型,docker-compose配置了
```
- "BASE_URL=https://api.groq.com/openai/v1"
- "OPENAI_API_KEY=xxxxx"
```
使用模型后,返回错误:
{
"error": {
"message": "Unknown reques…
-
# User Description
_User did not enter any detailed information._
# Stack Trace
```
java.lang.Throwable: psiElement is not instance of requiredClass.
psiElement=PARAMETER_DECLARATION, psiElemen…
-
### What happened?
I re-deployed the latest version of docker image at [main-v1.22.10](https://github.com/berriai/litellm/pkgs/container/litellm/175766005?tag=main-v1.22.10).
It works when the `"st…
-
One cool feature that Google offers with Gemini (formerly Bard) is that you get to see three "drafts" of the response to every input. My understanding is that LLM inference servers are able to massive…
-
### Description
The following code works on local (dev + build), but fails on Vercel. I don't know why and it is super hard to debug vercel. I'm actually facing another bug, but I simplified into t…
-
I was trying out the SDK and got everything looking GTG, but was unable to get past the error in the title. I then pulled down the sample project and I'm seeing the same error when running the summari…
-
**Is your feature request related to a problem? Please describe.**
Yes, according to @AbdulTheActivePiecer, your servers are in Europe so Google Gemini won't work.
**Describe the solution you'd li…
-
Tokio tracing, and how to use it w/ open telemetry (using tcp-api-server and r3bl_terminal_async)
useful links & background info:
- overview: https://tokio.rs/tokio/topics/tracing
- difference betwe…
-
### First, confirm
- [X] I have read the [instruction](https://github.com/Gourieff/comfyui-reactor-node/blob/main/README.md) carefully
- [X] I have searched the existing issues
- [X] I have updated t…
-
### Description
In local the streaming seems to be working but when deployed it's in loading state and once loaded all the data is coming at once. ( using app router only )
### Code example
#…