hkust-nlp / ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]
https://cevalbenchmark.com/
MIT License
1.6k stars 74 forks source link

how to evaluate models trained by bloom serires base model? #48

Closed Modas-Li closed 10 months ago

Modas-Li commented 1 year ago

please update and support this~

jxhe commented 10 months ago

maybe you can try evaluating through lm-evaluation-harness?

https://github.com/hkust-nlp/ceval#use-through-evaluation-harness