search

WukLab / preble

Stateful LLM Serving
Apache License 2.0
32 stars 4 forks source link

Refactor/rebase #70

Closed jiange91 closed 5 months ago

jiange91 commented 5 months ago
  1. Resolving merge conflict from SGLang upstream.
  2. Partial eviction need to be disabled for now.