InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
13 stars 5 forks source link

Model version management #58

Open kerthcet opened 1 month ago

kerthcet commented 1 month ago

What would you like to be added:

Right now, we only have one model version for common deployment, however, if we take a higher level view of the model lifecycle, version management is necessary.

Why is this needed:

Support the full lifecycle of models.

Completion requirements:

This enhancement requires the following artifacts:

The artifacts should be linked in subsequent comments.

kerthcet commented 1 month ago

/kind enhancement

kerthcet commented 1 month ago

However, we should wait for real feedbacks from our users in the future. /priority important-longterm