OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
错误原因:turbomind_with_tf_above_v4_33.py文件第54到61行。如果tokenizer_only为True。导致tm_model无法被初始化,但是self.generators = [tm_model.create_instance() for i in range(concurrency)]调用了tm_model,导致报错。刚好prompt_viewer.py满足该条件。
Prerequisite
Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
python tools/prompt_viewer.py gsm8k_llama3_8b_ins.py
Reproduces the problem - code/configuration sample
gsm8k_llama3_8b_ins.py
Reproduces the problem - command or script
在主目录执行命令:
python tools/prompt_viewer.py gsm8k_llama3_8b_ins.py
就会报错Reproduces the problem - error message
Other information
错误原因:turbomind_with_tf_above_v4_33.py文件第54到61行。如果tokenizer_only为True。导致tm_model无法被初始化,但是self.generators = [tm_model.create_instance() for i in range(concurrency)]调用了tm_model,导致报错。刚好prompt_viewer.py满足该条件。