hkust-nlp / ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]
https://cevalbenchmark.com/
MIT License
1.64k stars 78 forks source link

测试结果提交报错,点击process时,提示:Any subject must contain at least 50 questions to be calculated #79

Closed hailing2024 closed 5 months ago

hailing2024 commented 5 months ago

把从官网下载的sample直接提交也是报这个错,是每个科目最少需要50条数据吗? 奇怪的是,把数据加到了每个科目50条数据,有时候报错,有时候能成功 然后,让别的小伙伴试了下,提交sample没有报错

HYZ17 commented 5 months ago

我们设置的是至少提交50条数据