search

WukLab / preble

Stateful LLM Serving
Apache License 2.0
32 stars 4 forks source link

Update benchmarking utilities with more plotting #35

Closed vikranth22446 closed 6 months ago

vikranth22446 commented 6 months ago

p50,p90,p99 might be more representative