search

OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
https://vchat.opengvlab.com/
MIT License
2.86k stars 230 forks source link

some answers not correct, any ways to check it out? #96

Open MarStarck opened 6 months ago

MarStarck commented 6 months ago

this one for example, is "rag" in video "video": "video_7982.mp4", "question": "What is the order of the letters at the end?", "candidates": [ "gra", "arg", "rag" ], "answer": "gra"

Andy1621 commented 6 months ago

Since the question is about the letter order, the answer is randomly generated. By the way, the answer is directly copied from Perception Test.