[Feature] Evaluation efficiency optimization(SciCode)

open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

https://opencompass.org.cn/

Apache License 2.0

4.01k stars 423 forks source link

[Feature] Evaluation efficiency optimization(SciCode) #1442

Open tonysy opened 2 months ago

tonysy commented 2 months ago

Describe the feature

Improve the evaluation efficiency for SciCode
Reduce the cost for h5 data loading

Will you implement it?

[ ] I would like to implement this feature and create a PR!

tonysy commented 2 months ago

@HariSeldon0 Please resolve this issue