danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
18.94k stars 3.15k forks source link

Enhancement: Add Custom Headers to Endpoints #3354

Open darkBuddha opened 3 months ago

darkBuddha commented 3 months ago

What features would you like to see added?

Hi, it seems that there was an update: https://x.com/alexalbert__/status/1812921642143900036

More details

Adding a custom header is not possible currently AFAIK

Which components are impacted by your request?

No response

Pictures

Screenshot 2024-07-16 at 15 58 15

Code of Conduct

danny-avila commented 3 months ago

renamed this issue to Enhancement: Add Custom Headers to Endpoints

darkBuddha commented 3 months ago

Any ETA on this? I use only 3.5 Sonnet since it came out, really missing the context window. Don't want to look for LibreChat alternative

danny-avila commented 3 months ago

Handling the concern that opened this issue here: https://github.com/danny-avila/LibreChat/pull/3407

Adding custom headers is possible for azure/custom endpoints but not the other endpoints so will keep this open until then.

darkBuddha commented 3 months ago

Thank you so much 🎉

darkBuddha commented 2 months ago

https://x.com/alexalbert__/status/1825920737326281184

FYI

danny-avila commented 2 months ago

https://x.com/alexalbert__/status/1825920737326281184

FYI

For your information, I'm already using that header as the default behavior for Anthropic, as well as prompt caching. The ability to customize headers for non-custom/non-openai endpoints remains.

darkBuddha commented 2 months ago

They said the header is not needed any more :D Thought you can clean up the code ...

danny-avila commented 2 months ago

They said the header is not needed any more :D Thought you can clean up the code ...

it's still needed, it's just an abstraction for it