[Feature]: Add Auto-discovery of "*" models when calling /models and /v1/model/info

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

12.34k stars 1.43k forks source link

[Feature]: Add Auto-discovery of "*" models when calling /models and /v1/model/info #5818

Closed ishaan-jaff closed 4 hours ago

ishaan-jaff commented 4 hours ago

The Feature

Motivation, pitch

Twitter / LinkedIn details

No response

ishaan-jaff commented 4 hours ago

looks like we already should be doing this

ishaan-jaff commented 4 hours ago

closing - it worked for me, user had a bad config.yaml