substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
96 stars 6 forks source link

Support OpenAI API key based authentication #101

Open samos123 opened 2 months ago

samos123 commented 2 months ago

Ability to issue or configure an API key inside Lingo. Users should be able to secure Lingo by requiring an OpenAI API key. This should be compatible with using OpenAI client like this:

import os
from openai import OpenAI

client = OpenAI(
    # This is the default and can be omitted
    api_key=os.environ.get("OPENAI_API_KEY"),
)