search

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
30 stars 10 forks source link

[1/N] Add backendRuntime CRD #138

Closed kerthcet closed 2 months ago

kerthcet commented 2 months ago

What this PR does / why we need it

For expandability and easy integration, right now, people can add a new backend without modifying the controller logcis.

Which issue(s) this PR fixes

Part of https://github.com/InftyAI/llmaz/issues/134

Special notes for your reviewer

Does this PR introduce a user-facing change?

Add BackendRuntime CRD for expandability
kerthcet commented 2 months ago

/kind feature /kind api-change /lgtm /approve

kerthcet commented 2 months ago

/retest

kerthcet commented 2 months ago

/lgtm