search

QwenLM / Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
Apache License 2.0
13.59k stars 1.11k forks source link

Qwen/eval中的评测CEval和CMMLU，开大推理的batchsize评测指标会显著降低 #1223

Closed ntz2000 closed 4 months ago

ntz2000 commented 5 months ago

Qwen/eval中的评测脚本CEval和CMMLU，开大推理的batchsize能够加快推理速度，但是评测指标会显著降低，只有开1才能得到最高的指标，这是为啥？

github-actions[bot] commented 4 months ago

This issue has been automatically marked as inactive due to lack of recent activity. Should you believe it remains unresolved and warrants attention, kindly leave a comment on this thread. 此问题由于长期未有新进展而被系统自动标记为不活跃。如果您认为它仍有待解决，请在此帖下方留言以补充信息。