Evaluating VQA in open-ended setting

OFA-Sys / OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

Apache License 2.0

2.41k stars 248 forks source link

Evaluating VQA in open-ended setting #370

Open simplelifetime opened 1 year ago

simplelifetime commented 1 year ago

Hello, I wonder how to evaluate VQA in the open-ended setting. Can I use the zero-shot evaluation script to evaluate a fine-tuned checkpoint?