issues
search
WukLab
/
preble
Stateful LLM Serving
Apache License 2.0
32
stars
4
forks
source link
Feature/basic mem scheduler
#41
Closed
vikranth22446
closed
6 months ago
vikranth22446
commented
6 months ago
Add memory/load balanced scheduler + greedy lp heuristic
Add memory/load balanced scheduler + greedy lp heuristic