[05/02/2024 - 12/02/2024] New Models/Endpoints/Providers/Improvements

Spend Tracking

[ ] Expose /user/delete endpoint [Feature]: Expose /user/delete endpoint #1711
[ ] End User Emails when a key is near its budget
[ ] Azure cost tracking: Set Base model on config.yaml https://github.com/BerriAI/litellm/issues/1810
[ ] add Region-specific amazon text embedding pricing - https://github.com/BerriAI/litellm/issues/1566
[ ] log image count in spend logs https://github.com/BerriAI/litellm/issues/1731
[ ] Fix spend logs cost tracking bug - https://github.com/BerriAI/litellm/issues/1806
[ ] Batch failed spend logs calls - https://github.com/BerriAI/litellm/issues/1714
[ ] [Feature]: Azure, OpenAI - Log Response Headers https://github.com/BerriAI/litellm/issues/1724
[x] Increase prisma db connection limit - https://github.com/BerriAI/litellm/issues/1714
[ ] Control Models Based on Team ID: https://github.com/BerriAI/litellm/issues/1866
[x] Cache key + user on create - https://github.com/BerriAI/litellm/issues/1862
[ ] Support redis caching for user api key auth - https://github.com/BerriAI/litellm/issues/1863
[ ] Allow setting spend logs to false - https://github.com/BerriAI/litellm/issues/1714
[ ] batch update db cost tracking calls - https://github.com/BerriAI/litellm/issues/1867

[ ] keys without alias don’t show up - https://github.com/BerriAI/litellm/issues/1812
[x] allow Proxy admin to set upperbounds for budgets, durations https://github.com/BerriAI/litellm/issues/1835
[x] allow proxy admin to view and delete all keys on proxy - https://github.com/BerriAI/litellm/issues/1822
[x] [Feature-UI]: Show users the available models for a Key - https://github.com/BerriAI/litellm/issues/1887
[x] [Feature-UI]: Show the User ID, User Spend attributes on UI v2 https://github.com/BerriAI/litellm/issues/1695
[x] Have admin role defined by sub in oath token - https://github.com/BerriAI/litellm/issues/1808
[ ] Show global spend on time-series - https://github.com/BerriAI/litellm/issues/1909
[ ] show cost per provider (global) - https://github.com/BerriAI/litellm/issues/1911
[ ] show keys driving spend per provider (global) - https://github.com/BerriAI/litellm/issues/1912
[ ] show key related metadata (user email, id, etc.) - https://github.com/BerriAI/litellm/issues/1913

[ ] Improve proxy cold start time - https://github.com/BerriAI/litellm/issues/1769
[x] together ai function calling support - https://github.com/BerriAI/litellm/issues/1827
[x] fix gemini pro langfuse logging bug - https://github.com/BerriAI/litellm/issues/1811
[x] Log llm api call failures to langfuse - https://github.com/BerriAI/litellm/issues/1820
[ ] Gemini Pro - VertexAI function calling when streaming support - https://github.com/BerriAI/litellm/issues/1263
[ ] Add vertex ai imagen support - https://github.com/BerriAI/litellm/issues/1707
[ ] Setting span id on langfuse - https://github.com/BerriAI/litellm/issues/1832
[ ] deepcopy kwargs before sending to custom callback - https://github.com/BerriAI/litellm/issues/1833
[x] proxy shouldn't be ready if db connected but not working - https://github.com/BerriAI/litellm/issues/1814
[ ] Enable custom ssl certificates