CERC-AAI / Robin

Apache License 2.0
62 stars 8 forks source link

Add eval scripts for Clevr and Qlevr benchmarks #46

Closed jonathanlimsc closed 9 months ago

jonathanlimsc commented 9 months ago
  1. Added eval scripts for calculating prediction accuracy for Clevr and Qlevr benchmarks

    • robin/eval/eval_vqa_clevr.py
    • robin/eval/eval_vqa_qlevr.py
  2. Modified the inference scripts for Clevr and Qlevr to support question sampling during eval with a given seed

    • robin/eval/model_vqa_clevr.py
    • robin/eval/model_vqa_qlevr.py