kuwaai / genai-os

Kuwa GenAI OS: An open, free, secure, and privacy-focused Generative-AI Orchestrating System.
https://kuwaai.tw/os/intro
MIT License
89 stars 21 forks source link

Feature request: support for third-Party API providers #42

Closed ifTNT closed 1 week ago

ifTNT commented 1 week ago

Problem: While we currently support OpenAI and Google Gemini APIs, user requests indicate a need for integration with additional third-party providers like Groq and Cerebras.

Proposed Solution: Adding a dedicated API key field will enable users to leverage these external services.

Alternatives Considered: A more comprehensive solution would allow administrators to customize the number and type of API keys per user. However, this approach requires significant development effort. To prioritize a solution with minimal impact, we're focusing on adding a single third-party API key field, which will address a majority of user needs.

Implementation Steps: