search

HyperGAI / HPT

HPT - Open Multimodal LLMs from HyperGAI
https://www.hypergai.com/
Apache License 2.0
301 stars 14 forks source link

Clarification of ScienceQA score #6

Closed Isaachhh closed 1 month ago

Isaachhh commented 1 month ago

I notice that your model achieve 82.7 on ScienceQA. I wonder whether you report total accuracy other than image accuracy, because LLaVA reports only image accuracy (71.6 for 13B and 73.6 for next-13B). Thanks!

QuangHyperGAI commented 1 month ago

Hi, we reported the image accuracy, which should be same as LLaVA.