InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
23 stars 10 forks source link

Bump LWS version to v0.4.0 #161

Closed kerthcet closed 1 month ago

kerthcet commented 1 month ago

What would you like to be cleaned:

lws just released to v0.4.0, which has a significant improvement for single-host deployment, see https://github.com/kubernetes-sigs/lws/pull/190. Why is this needed:

No overhead of lws.

kerthcet commented 1 month ago

/help /good-first-issue

@googs1025 would you like to have a try!

googs1025 commented 1 month ago

/assign