Lora multiplexing support

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes

Apache License 2.0

26 stars 10 forks source link

Open kerthcet opened 3 months ago

kerthcet commented 3 months ago

/kind feature /kind enhancement

kerthcet commented 3 months ago

/milestone v0.2.0

kerthcet commented 3 months ago

/kind api-change

kerthcet commented 3 months ago