[Feat] Add proxy level prometheus metrics

[ishaan-jaff]

Title

litellm_proxy_failed_requests_metric_total {
    api_key_alias: "None",
    end_user: "None",
    hashed_api_key: "88dc28d0f030c55ed4ab77ed8faf098196cb1c05df778539800c9f1243fe6b4b",
    requested_model: "fake-azure-endpoint",
    team: "None",
    team_alias: "None",
    user: "default_user_id"
} 1.0

litellm_proxy_total_requests_metric_total {
    api_key_alias: "None",
    end_user: "None",
    hashed_api_key: "88dc28d0f030c55ed4ab77ed8faf098196cb1c05df778539800c9f1243fe6b4b",
    requested_model: "gemini-vision",
    team: "None",
    team_alias: "None",
    user: "default_user_id"
} 1.0

Relevant issues

Type

🆕 New Feature 🐛 Bug Fix 🧹 Refactoring 📖 Documentation 🚄 Infrastructure ✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 19, 2024 11:33pm