Error while testing Qwen on POPE

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

https://lmms-lab.github.io/

Other

1.02k stars 52 forks source link

Error while testing Qwen on POPE #82

Closed hxhcreate closed 4 weeks ago

hxhcreate commented 1 month ago

accelerate launch --num_machines 1 --num_processes=$NUMSGPU -m lmms_eval --model qwen_vl --model_args pretrained=Qwen-VL --tasks $TASK --batch_size 1 --log_samples --log_samples_suffix qwen-vl-chat_$TASK --output_path ./logs/

结果

kcz358 commented 1 month ago

Have you check the log of Qwen? It might possibly because it output some answers that can not be parsed correctly