search

ajd12342 / why-winoground-hard

Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
MIT License
30 stars 2 forks source link

The winoground_caption.txt #3

Closed TeleeMa closed 1 year ago

TeleeMa commented 1 year ago

Hi,

I found there were no winoground_caption.txt in folder "dataset" and https://huggingface.co/datasets/facebook/winoground. Therefore, how to get the txt file which is needed in https://github.com/ajd12342/why-winoground-hard/blob/1020ac36595eb142d0348c50ee399ade4f2f1942/get_clip_scores.py#L17

Thank you.

vlb9ae commented 1 year ago

Apologies, we generated that file from command line when we first got the WinoGround data to help make it easier to explore, and forgot it isn't shipped with WinoGround! I just modified get_lxmert_scores.py and get_clip_scores.py so that they read from examples.jsonl instead, so hopefully this should be resolved now :)