mlc-ai / llm-perf-bench

Apache License 2.0
109 stars 12 forks source link

[MultiGPU] Enable Exllama MultiGPU benchmarking #16

Closed zxybazh closed 11 months ago

zxybazh commented 11 months ago

Docker scripts added.