danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
19.44k stars 3.24k forks source link

šŸ“˜ docs: Portkey AI custom endpoint in `librechat.example.yaml` #4625

Closed siddharthsambharia-portkey closed 1 week ago

siddharthsambharia-portkey commented 3 weeks ago

Summary

Portkey AI Custom Endpoint Integration

Added configuration for the Portkey AI custom endpoint in librechat.example.yaml. This enables LibreChat users to connect directly to the Portkey API and utilize its specialized models with settings for headers, model display, and title conversations.

Key additions:

Change Type

Testing

Tested the Portkey endpoint configuration by setting up the API connection with provided keys and verifying model fetching, header configurations, and response outputs. Validated model retrieval and display settings align with expected Portkey model responses.

Test Configuration:

  1. Set PORTKEY_API_KEY and PORTKEY_OPENAI_VIRTUAL_KEY in environment variables.
  2. Enabled caching and verified the model display label.
  3. Tested response latency and accuracy for models specified in the configuration.

Checklist

siddharthsambharia-portkey commented 3 weeks ago

Hey @danny-avila can you take a look at this? Thanks!