search

microsoft / Oscar

Oscar and VinVL
MIT License
1.03k stars 248 forks source link

Can you share the full NoCaps results on the test data? #199

Open YovaKem opened 1 year ago

YovaKem commented 1 year ago

The OSCAR paper reports a CIDEr score of 78.8 and 80.9 for OSCAR base and large, resp. Since it's not clarified, I assume these are scores on the NoCaps test split, for NoCaps-entire. Can you share the scores for the in-, near- and out-domain subsplits? And can you confirm if the 78.8/80.9 scores are on the test data? Thanks!

RitaRamo commented 1 year ago

Congrats for your amazing work on OSCAR.

I was wondering the same