BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
14.31k stars 1.69k forks source link

[Bug]: Have mock responses return a pydantic object #938

Open krrishdholakia opened 1 year ago

krrishdholakia commented 1 year ago

What happened?

Mock responses returns a dict (old openai format).

Update it to return a pydantic object.

Relevant log output

N/A

Twitter / LinkedIn details

No response

krrishdholakia commented 1 year ago

Relevant code - https://github.com/BerriAI/litellm/blob/main/litellm/main.py#L208