search

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
30 stars 10 forks source link

Support Secrets to store HF_TOKEN #71

Closed kerthcet closed 3 months ago

kerthcet commented 3 months ago

What this PR does / why we need it

Loading models from HF sometimes requires the secret, now we support it.

Which issue(s) this PR fixes

Fixes https://github.com/InftyAI/llmaz/issues/22

Special notes for your reviewer

Does this PR introduce a user-facing change?

Support loading models with huggingface token
kerthcet commented 3 months ago

/lgtm /approve

kerthcet commented 3 months ago

/kind feature

kerthcet commented 3 months ago

/lgtm

kerthcet commented 3 months ago

/lgtm