meta-llama / llama

Inference code for Llama models
Other
54.12k stars 9.32k forks source link

evaluation #1085

Open ZHANGJINKUI opened 3 months ago

ZHANGJINKUI commented 3 months ago

python eval.py --model hf --model_args pretrained=/mnt/sdb/zjk/llama2/llama-recipes/Llama-2-7b-hf,dtype="float",peft=/mnt/sdb/zjk/llama2/llama2-lora --tasks hellaswag --num_fewshot 10 --device cuda:0 --batch_size 8

error: 2024-04-02:06:58:12,156 ERROR [eval.py:226] An error occurred during evaluation: module 'lm_eval.tasks' has no attribute 'initialize_tasks'