open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
https://opencompass.org.cn/
Apache License 2.0
3.98k stars 422 forks source link

[Bug] The mmengine does not support python3.11 or above #1420

Open wangxingjun778 opened 2 months ago

wangxingjun778 commented 2 months ago

Prerequisite

Type

I'm evaluating with the officially supported tasks/models/datasets.

Environment

For python3.11 or above, the mmengine cannot work and report runtime error when loading config file

Reproduces the problem - code/configuration sample

none

Reproduces the problem - command or script

none

Reproduces the problem - error message

none

Other information

No response

wangxingjun778 commented 2 months ago

Same error when using pyext dependency

hrdxwandg commented 2 months ago

参考 https://github.com/refi64/PyExt/pull/3

wangxingjun778 commented 1 month ago

ok thx !