search

danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
19.33k stars 3.23k forks source link

[Question]: Unbale to connect to Portkey #4719

Closed s-sajid-ali closed 1 week ago

s-sajid-ali commented 1 week ago

What is your question?

Using the same configuration as mentioned in both the LibreChat/Portkey docs, we're unable to see PortKey as a provider in librechat.

The Librechat-API container logs show:

2024-11-13 21:16:21 info: Connected to MongoDB
2024-11-13 21:16:21 info: Custom config file loaded:
2024-11-13 21:16:21 info: {
  "version": "1.1.7",
  "cache": true,
  "endpoints": {
    "custom": [
      {
        "name": "Portkey",
        "apikey": "dummy",
        "baseURL": "https://api.portkey.ai/v1",
        "headers": {
          "x-portkey-api-key": "...",
          "x-portkey-virtual-key": "..."
        },
        "models": {
          "default": [
            "gemini-1.5-pro"
          ],
          "fetch": true
        },
        "titleConvo": true,
        "titleModel": "current_model",
        "summarize": false,
        "summaryModel": "current_model",
        "forcePrompt": false,
        "modelDisplayLabel": "Portkey:OpenAI"
      }
    ]
  }
}
2024-11-13 21:16:21 info: [deleteNullOrEmptyConversations] Deleted 0 conversations and 0 messages
2024-11-13 21:16:21 info: RAG API is running and reachable at http://rag_api:8000.
2024-11-13 21:16:21 info: No changes needed for 'USER' role permissions
2024-11-13 21:16:21 info: No changes needed for 'ADMIN' role permissions

More Details

The command used to start the deployment is: 

sudo /usr/local/bin/docker-compose -f ./deploy-compose.yml -f ./deploy-compose.override.yml up -d

The contents of deploy-compose.override.yml are as follows:

ss19980_nyu_edu@librechatdemo ~/LibreChat (main)> bat deploy-compose.override.yml
───────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
       │ File: deploy-compose.override.yml
───────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
   1   │ services:
   2   │   api:
   3   │     volumes:
   4   │     - type: bind
   5   │       source: ./librechat.yaml
   6   │       target: /app/librechat.yaml
   7   │ 
───────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
ss19980_nyu_edu@librechatdemo ~/LibreChat (main)>

What is the main subject of your question?

Endpoints

Screenshots

List of providers on LibreChat: image

Code of Conduct