search

mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.24k stars 1.58k forks source link

[Fix] Deepcopy reqeust when sampling dataset #2945

Closed cyx-6 closed 1 month ago

cyx-6 commented 1 month ago

This PR fixes the sampling of dataset in benchmark. Otherwise the sampled requests may refer to the same object and cause issues.