[Feature] Support MMMLU

open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

https://opencompass.org.cn/

Apache License 2.0

3.93k stars 416 forks source link

[Feature] Support MMMLU #1560

Open tonysy opened 3 weeks ago

tonysy commented 3 weeks ago

Describe the feature

https://huggingface.co/datasets/openai/MMMLU

Will you implement it?

[ ] I would like to implement this feature and create a PR!

shan23chen commented 2 weeks ago

Is this available now? thanks!