Lora multiplexing support

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes

Apache License 2.0

13 stars 5 forks source link

Open kerthcet opened 1 month ago

kerthcet commented 1 month ago

/kind feature /kind enhancement

kerthcet commented 1 month ago

/milestone v0.2.0

kerthcet commented 1 month ago

/kind api-change

kerthcet commented 1 month ago