search

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
31 stars 10 forks source link

Support SGLang as another backend #39

Closed kerthcet closed 3 months ago

kerthcet commented 4 months ago

SGLang see https://github.com/sgl-project/sglang

kerthcet commented 4 months ago

/kind feature /milestone 0.2.0

kerthcet commented 3 months ago

/milestone v0.1.0