LiteLLM Minor Fixes & Improvements (09/19/2024)

[krrishdholakia]

Title

• fix(model_prices_and_context_window.json): add cost tracking for more vertex llama3.1 model (8b + 70b)
• fix(proxy/utils.py): handle data being none on pre-call hooks
• fix(proxy/): create views on initial proxy startup
• feat(ui/): support enabling/disabling slack alerting
• feat(rerank/main.py): support langfuse logging

Relevant issues

Fix vertex ai context caching pass-through Fixes https://github.com/BerriAI/litellm/issues/5756

Type

🆕 New Feature 🐛 Bug Fix 🧹 Refactoring 📖 Documentation 🚄 Infrastructure ✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 20, 2024 2:00pm