Closed kerthcet closed 2 months ago
Stop sharing models in the same node because right now, we have no model weights lifecycle management policies, which may lead to the model size growing all the time.
This can be handled by fluid somehow.
Fixes https://github.com/InftyAI/llmaz/issues/88
None
/kind bug /lgtm /approve
kerthcet
commented
2 months ago
What this PR does / why we need it
Stop sharing models in the same node because right now, we have no model weights lifecycle management policies, which may lead to the model size growing all the time.
This can be handled by fluid somehow.
Which issue(s) this PR fixes
Fixes https://github.com/InftyAI/llmaz/issues/88
Special notes for your reviewer
Does this PR introduce a user-facing change?