apocas / restai

RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precise embeddings usage and tuning. Image generation (Dall-E, SD, Flux).
https://apocas.github.io/restai/
Apache License 2.0
383 stars 73 forks source link

Feature Request: Custom API Key Support for Inference and Embedding #76

Open mhsabu opened 6 months ago

mhsabu commented 6 months ago

As a user of the project, I would like the ability to integrate my own API keys for inference and embedding services such as OpenAI, Cohere, and Anthropic, allowing for greater flexibility and customization in utilizing these services within the project.