search

AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
276 stars 8 forks source link

[bugs] LLaVA-Evaluation : line81, '[img]' is supposed to be '<img>'? #23

Closed LeoWootsi closed 3 months ago

LeoWootsi commented 4 months ago

Should line 81 in llava_v2_interface.py 

        if "[img]" in question:
            question = question.replace("<img>", IMAGE_PLACEHOLDER)

be 

        if "<img>" in question:
            question = question.replace("<img>", IMAGE_PLACEHOLDER)

?

Bohao-Lee commented 4 months ago

Thank you for your feedback, I have modified it.