feat(dynamic_rate_limiter.py): Dynamic tpm quota (multiple projects)

[krrishdholakia]

Title

Dynamic tpm quota (multiple projects)

Relevant issues

Closes https://github.com/BerriAI/litellm/issues/4124

Type

🆕 New Feature

Changes

• new call hook - dynamic_rate_limiter.py
• updates get_model_group_info() in router, to return total tpm/rpm for a given model group (if set)

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

• new test_dynamic_rate_limiter.py

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 23, 2024 2:15am