[Feature] dataset for humaneval-multipl

open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

https://opencompass.org.cn/

Apache License 2.0

4.18k stars 446 forks source link

[Feature] dataset for humaneval-multipl #1673

Open jyshee opened 2 weeks ago

jyshee commented 2 weeks ago

Describe the feature

where could I find the data of humaneval-multipl?

No valid url for ./data/multi-data/humaneval_multipl-e/

Will you implement it?

[ ] I would like to implement this feature and create a PR!

tonysy commented 1 week ago

Thanks for the report. We will support the automatic download for this dataset in next version.