search

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
25 stars 10 forks source link

Support Secret in Playground #22

Closed kerthcet closed 3 months ago

kerthcet commented 3 months ago

We support env & vars right now in Playground, however, sometimes, some parameters should be protected and now show directly in Pod yaml, just like the huggingface_token or something like that, we should support secret and plumbed into pod spec.

kerthcet commented 3 months ago

/kind feature /milestone v0.1.0

kerthcet commented 3 months ago

Maybe we should support llmazctl to create secret, this is more convenient and native to Kubernetes since we usually create a secret and refer to the secret in the pod yaml.

kerthcet commented 3 months ago

In the future, we'll provide cli tool to create secrets.