search

InftyAI / Llmaz

⚒ A building block for users to build/serve their own LLM from A to Z on Kubernetes.
https://InftyAI.com
Apache License 2.0
3 stars 4 forks source link

Configuration file support #13

Open kerthcet opened 7 months ago

kerthcet commented 7 months ago

We should have a configuration file, this could be a values.yaml for rendering helm chart. E.g. if we want to support ChatGPT, then we need the OPENAI_KEY, but the risk is security, people may abuse the key.