[Bug]: logprobs missing from langfuse

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

14.57k stars 1.71k forks source link

[Bug]: logprobs missing from langfuse #3254

Open Manouchehri opened 7 months ago

Manouchehri commented 7 months ago

What happened?

Doesn't seem like logprobs are being logged or sent to Langfuse.

Relevant log output

No response

Twitter / LinkedIn details

https://www.linkedin.com/in/davidmanouchehri/

Manouchehri commented 7 months ago

Related to #3243, and sorta related to #3230.