Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
12.55k
stars
1.46k
forks
source link
[Bug]: model list api_key leak #5762
Closed
langgg0511 closed 1 week ago
What happened?
When an error occurs here, it will return the api_key and api_base information for all models in the model list.
https://github.com/BerriAI/litellm/blob/main/litellm/router.py#L5033
Relevant log output
No response
Twitter / LinkedIn details
No response