I added support for setting api budgets across all the providers we support (OpenAI, Anthropic, AI21, Cohere, Replicate, etc.) using our BudgetManager - https://docs.litellm.ai/docs/budget_manager.
Would love to know if this helps.
Happy to add additional documentation + testing if the initial PR looks good.
Hi @timconnorz,
Noticed you're using agents. I'm working on litellm (https://github.com/BerriAI/litellm) and wanted to see how i could be helpful.
I added support for setting api budgets across all the providers we support (OpenAI, Anthropic, AI21, Cohere, Replicate, etc.) using our BudgetManager - https://docs.litellm.ai/docs/budget_manager.
Would love to know if this helps.
Happy to add additional documentation + testing if the initial PR looks good.