search

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
14.5k stars 1.7k forks source link

add retries w/ exponential backoff #39

Closed krrishdholakia closed 1 year ago

krrishdholakia commented 1 year ago

https://github.com/reworkd/AgentGPT/pull/1146/files/ff3d52d4a7abd848b6691af75e115f477db3d4f9#r1276947112

Screenshot 2023-08-03 at 9 22 56 AM
krrishdholakia commented 1 year ago

tried adding but then faced issues with raising exceptions - commented out for now. Will need to investigate and re-implement.

ishaan-jaff commented 1 year ago

we have completion with retries now