[Docs]: passing metadata openai.py, openai js, langchain py, langchain js

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

12.66k stars 1.47k forks source link

[Docs]: passing metadata openai.py, openai js, langchain py, langchain js #1287

Closed krrishdholakia closed 9 months ago

krrishdholakia commented 9 months ago

The Feature

clear docs on how to pass additional metadata via openai/langchain. We have a version of this already - https://docs.litellm.ai/docs/proxy/user_keys

Motivation, pitch

we've heard this ask couple different times - "how do i pass additional params/metadata via openai/langchain"

Twitter / LinkedIn details

No response

krrishdholakia commented 9 months ago

User feedback - "I think the biggest thing is docs/suppoet for metadata passthrough in langchain. Both with LCEL chains and via a model directly"

krrishdholakia commented 9 months ago

cc: @ishaan-jaff

ishaan-jaff commented 9 months ago

docs on how to do this are here: https://docs.litellm.ai/docs/proxy/user_keys#pass-user-llm-api-keys