Open kerthcet opened 1 month ago
/kind question /remove-kind cleanup
Right now, people can deploy a more advanced inference workload via Service
, this is supported. But with playground, this is not workable.
However, especially for multi-host scenarios, topology is important, this is a key problem I think.
The general ides would be:
What would you like to be cleaned:
For example, people want to deploy the model with different scheduling primitives, colocated or exclusive?
Why is this needed:
Expressing deploy primitives.