Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
13.85k
stars
1.63k
forks
source link
[Bug]: azure streaming returning delta + message chunk at the end of stream (and beginning of stream in v.11.1) #1081
Closed
krrishdholakia closed 11 months ago
What happened?
Code for repro:
Relevant log output
Twitter / LinkedIn details
No response