search

openppl-public / ppl.llm.serving

Apache License 2.0
122 stars 13 forks source link

[feature] add simple flag, add request rate for benchmark #32

Closed Vincent-syr closed 9 months ago

Vincent-syr commented 9 months ago

[feature] add simple flag, add request rate for benchmark