Can you share the full NoCaps results on the test data?

microsoft / Oscar

Oscar and VinVL

MIT License

1.04k stars 252 forks source link

Can you share the full NoCaps results on the test data? #199

Open YovaKem opened 2 years ago

YovaKem commented 2 years ago

The OSCAR paper reports a CIDEr score of 78.8 and 80.9 for OSCAR base and large, resp. Since it's not clarified, I assume these are scores on the NoCaps test split, for NoCaps-entire. Can you share the scores for the in-, near- and out-domain subsplits? And can you confirm if the 78.8/80.9 scores are on the test data? Thanks!

RitaRamo commented 2 years ago

Congrats for your amazing work on OSCAR.

I was wondering the same