allow setting Customer credits

BerriAI / litellm

Python SDK, Proxy Server to call 100+ LLM APIs using the OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

12.28k stars 1.43k forks source link

allow setting Customer credits #3515

Open krrishdholakia opened 4 months ago

krrishdholakia commented 4 months ago

Customer credits don't expire

customer should be able to top them up
this should be deducted before we compare spend/budget

rawwerks commented 2 weeks ago

lago wallet can achieve this, see discussion in their slack: https://lago-community.slack.com/archives/C03MCH55EL8/p1725297923407369

but gated by https://github.com/BerriAI/litellm/issues/5477