[Feature]: openai dev day updates

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

12.68k stars 1.48k forks source link

[Feature]: openai dev day updates #6043

Open krrishdholakia opened 2 days ago

krrishdholakia commented 2 days ago

The Feature

[x] Support new /v1/realtime api endpoints - test gpt-4o-realtime preview (openai + azure) - https://github.com/BerriAI/litellm/issues/6045
[x] add prompt caching for streaming on OpenAI - https://github.com/BerriAI/litellm/issues/6038
[x] #6069

Motivation, pitch

day 1 openai update support

Twitter / LinkedIn details

No response

krrishdholakia commented 2 days ago

looks like we'll need to support the new /v1/realtime api endpoint.

We should create a separate ticket for that