This PR finalizes support for evaluating on VL-Checklist evaluation suite. The following are completed:
[x] All images are downloaded using scripts in the download_image folder. Also, some bug fixes.
[x] Added configs in the configs folder that has configure for evaluating "attribute", "object" and "relation".
[x] A simple script to run all the tests from one single point can be found our_clip_test.py
[x] Successfully tested and manually checked output files.
IMPORTANT! The current data loader might be buggy and have very ugly codes. My intention is to get things moving, so I didn't care much for now. I will handle this issue in another PR.
This PR finalizes support for evaluating on VL-Checklist evaluation suite. The following are completed:
download_imagefolder. Also, some bug fixes.configsfolder that has configure for evaluating "attribute", "object" and "relation".our_clip_test.pyIMPORTANT! The current data loader might be buggy and have very ugly codes. My intention is to get things moving, so I didn't care much for now. I will handle this issue in another PR.