search

WukLab / preble

Stateful LLM Serving
Apache License 2.0
32 stars 4 forks source link

Feat/hc disagg #62

Closed jiange91 closed 5 months ago

jiange91 commented 5 months ago

Merge iterative eviction feedback to new cost model