search

LLMServe / DistServe

Disaggregated serving system for Large Language Models (LLMs).
Apache License 2.0
293 stars 29 forks source link

Camera ready simulator #2

Closed GindaChen closed 5 months ago