modelscope / eval-scope

A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
Apache License 2.0
101 stars 12 forks source link

运行run.py出错,说没有eval_config #67

Open aoligei178 opened 5 days ago

aoligei178 commented 5 days ago

python llmuses/run.py --model /media/ama/data1/wzh/Model_Param/LLM/Yi_6B/pretrain --template-type chatglm3 --datasets arc --dataset-hub Local --dataset-dir /home/wzh/DianWang/RAG_project/Data/LLM/qa1000.json --limit 10 我想用自己的数据集测试本地模型,配置这些参数后报错如下: assert eval_config is not None, 'Please provide eval_config for specific evaluation backend.' AssertionError: Please provide eval_config for specific evaluation backend. 找不到eval_config,请问这个从哪找

aoligei178 commented 5 days ago

有没有大佬帮帮我

Noyiz commented 3 days ago

把run.py的382、383行注释掉

屏幕截图 2024-07-04 163706