Streaming claude-3 bedrock support

BerriAI / litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

https://docs.litellm.ai/docs/

Other

10.16k stars 1.13k forks source link

Open krrishdholakia opened 3 months ago

quan2005 commented 3 months ago

mark，I need it

quan2005 commented 3 months ago

The streaming has been verified, but the function call and image input still fail