search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.08k stars 154 forks source link

Input length of input_ids is 0, but max_length is set to -2009. #455

Open wangli68 opened 2 weeks ago

wangli68 commented 2 weeks ago

When I run the latest code with the following command "python run.py --data MMBench_TEST_EN_V11 MMBench_TEST_CN_V11 --model InternVL2-76B --verbose"

Error： ValueError: Input length of input_ids is 0, but max_length is set to -2009. This can lead to unexpected behavior. You should consider increasing max_length or, better yet, setting max_new_tokens.

python package: transformers 4.40.0 typing_extensions 4.9.0 torch 2.2.1+cu121 torchaudio 2.2.1+cu121 torchvision 0.17.1+cu121

In this environment, I can run the original InternVL2-76B without any errors.