InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
13 stars 5 forks source link

Playground will not reconcile once model created #92

Closed kerthcet closed 1 week ago

kerthcet commented 3 weeks ago

What happened:

Let's image there's no Model in the cluster, I created a Playground, because no Model exists, inference Pods will not be created. However, if I created the corresponding Model, the Playground should be triggered to create Services and then Pods. Right now, this is not true.

The solution is quite simple, make Playground watch for model creation events.

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?:

Environment:

kerthcet commented 3 weeks ago

/help /milestone v0.1.0

carlory commented 2 weeks ago

/assign