Evaluation on PointQA, VQAv2, OK-VQA and Captioning

shikras / shikra

Other

734 stars 46 forks source link

Evaluation on PointQA, VQAv2, OK-VQA and Captioning #36

Open ShramanPramanick opened 1 year ago

ShramanPramanick commented 1 year ago

Hi, The current codebase does not contain the configs for evaluation of the mentioned tasks. It only contain shikra_eval_multi_pope.py and shikra_eval_multi_rec.py. Will you please explain the evaluation processes for PointQA, VQAv2, OK-VQA and Captioning? Thanks. [I tried PointQA myself, but results on Visual-7W are not reproduced. Hence, it will be great to have the configs which you used. Thanks.]

Glupapa commented 10 months ago

I encountered the same question. Any news?

NicholasCG commented 6 months ago

Any update on this?

AbdulrahmanAlsumaih commented 6 months ago

any update on this ?