search

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
31 stars 10 forks source link

Support loading models from Image volume source #47

Closed kerthcet closed 3 months ago

kerthcet commented 3 months ago

fix: https://github.com/InftyAI/llmaz/issues/20 and https://github.com/InftyAI/llmaz/issues/35

kerthcet commented 3 months ago

/kind wip feature enhancement

kerthcet commented 3 months ago

/kind enhancement

kerthcet commented 3 months ago

/wip

kerthcet commented 3 months ago

Needs upstream support, like containerd.