search

AILab-CVC / SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
Other
315 stars 12 forks source link

[bugs] LLaVA-Evaluation : line81, '[img]' is supposed to be '<img>'? #23

Closed LeoWootsi closed 7 months ago

LeoWootsi commented 8 months ago

Should line 81 in llava_v2_interface.py 

        if "[img]" in question:
            question = question.replace("<img>", IMAGE_PLACEHOLDER)

be 

        if "<img>" in question:
            question = question.replace("<img>", IMAGE_PLACEHOLDER)

?

Bohao-Lee commented 8 months ago

Thank you for your feedback, I have modified it.