search

LLMServe / DistServe

Disaggregated serving system for Large Language Models (LLMs).
Apache License 2.0
122 stars 9 forks source link

[FIX] Remove scheduling parameters related to SJ-MLFQ to avoid confusion #14

Closed interestingLSY closed 2 weeks ago