InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
25 stars 10 forks source link

Support DataSource of docker image #20

Closed kerthcet closed 2 months ago

kerthcet commented 3 months ago

The ability to serve model from docker image(contains the model weight), whether we can integrate with ollama?

kerthcet commented 3 months ago

/kind feature /milestone v0.1.0

kerthcet commented 3 months ago

We should still support image since kubernetes v1.31 as OCI support for volumeSource

kerthcet commented 3 months ago

/assign

kerthcet commented 2 months ago

/milestone v0.2.0

kerthcet commented 2 months ago

close as not necessary since we"ll support OCI in the future. /close