search

open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
https://opencompass.org.cn/
Apache License 2.0
4.18k stars 446 forks source link

update first_option_postprocess #1699

Closed MaiziXiao closed 1 week ago

MaiziXiao commented 1 week ago
  1. Update first_option_postprocess, for case when match.group(1) = 0, use match.group(0) instead