[1/N] Add support for per model deployment

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes

Apache License 2.0

15 stars 6 forks source link

Closed kerthcet closed 2 months ago

kerthcet commented 2 months ago

What we do in this PR:

Add e2e test framework: fix https://github.com/InftyAI/llmaz/issues/12
Add client-go codes
Add support for per model deployment, most of the part is implemented
Rename api/v1alpha1 to api/core/v1alpha1 to avoid code-generator bug, will revisit this part later

Already big enough, merge as the first step.

kerthcet commented 2 months ago

/kind feature

kerthcet commented 2 months ago

/lgtm /approve