search

mlc-ai / llm-perf-bench

Apache License 2.0
109 stars 12 forks source link

[MultiGPU] Add vLLM Benchmark Docker Script and Instructions #27

Closed zxybazh closed 11 months ago

zxybazh commented 11 months ago

Add the script & intro for vllm benchmarking.