Feat/hc disagg - Githubissues

WukLab / preble

Stateful LLM Serving

Apache License 2.0

32 stars 4 forks source link

Closed jiange91 closed 6 months ago

jiange91 commented 6 months ago

Add chunk-prefill to sglang. Tested on small examples.

vikranth22446 commented 6 months ago

LGTM. ship it