search

01-ai / Yi-1.5

Yi-1.5 is an upgraded version of Yi, delivering stronger performance in coding, math, reasoning, and instruction-following capability.
Apache License 2.0
497 stars 28 forks source link

Inquiries about the AGIEval setup #13

Closed cabbagecabbage closed 4 months ago

cabbagecabbage commented 4 months ago

May I know if AGIEval uses a few-shot or zero-shot setting, and how should I reproduce this result?

Yimi81 commented 4 months ago

agi_eval_multichoice is zero-shot, please refer to https://github.com/ruixiangcui/AGIEval