search

TinyLLaVA / TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models
https://arxiv.org/abs/2402.14289
Apache License 2.0
658 stars 68 forks source link

Can you reproduce the Llava results in this project? #97

Open Yangr116 opened 4 months ago

Yangr116 commented 4 months ago

Hi! a very nice work! Do you reproduce the Llava results in your project?

Yangr116 commented 4 months ago

Wrong GQA eval path. https://github.com/TinyLLaVA/TinyLLaVA_Factory/blob/a9d37c1ffb09f9ace12ca0f8844f1a769b6fb80a/scripts/eval/gqa.sh#L42

image
ZhangXJ199 commented 3 months ago

Hello, the GQA data organization is fine, 'testdev_balanced' is just the name of the dataset, not the name of a folder.