CERC-AAI / Robin

Apache License 2.0
62 stars 8 forks source link

Added eval scripts for VQA on the Clevr and Qlevr datasets #44

Closed jonathanlimsc closed 8 months ago

jonathanlimsc commented 8 months ago

Implemented eval scripts for VQA on the Clevr and Qlevr datasets, and tested to be working with model-path agi-collective/mistral-7b-oh-siglip-so400m-finetune-lora and model-base teknium/OpenHermes-2.5-Mistral-7B

Note that I assume the question file to be in the same format as found in the downloaded datasets.

Clevr

Qlevr

Alexis-BX commented 8 months ago

Amazing thanks! Can you please remove unused imports please?