BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
14.07k stars 1.66k forks source link

[Feature]: support langfuse Multi-Modality and Attachments #6853

Open krrishdholakia opened 16 hours ago

krrishdholakia commented 16 hours ago

The Feature

https://langfuse.com/docs/tracing-features/multi-modality#api

It looks like langfuse saves the data from base64 uri to s3 (compatible) and then references the attachment link in the trace to make this work. This would be awesome if LiteLLM proxy automatically did the work with Langfuse API to upload the image and trace sent to langfuse to get these multimodal traces working with base64 data.

Motivation, pitch

user request

Twitter / LinkedIn details

No response