microsoft / Oscar

Oscar and VinVL
MIT License
1.04k stars 251 forks source link

Clarification of results #135

Open alfred100p opened 3 years ago

alfred100p commented 3 years ago

Hi in both the table in the readme and paper you mention a column for image captioning as C could someone verify if it's CIDER or CIDER-D.

xiaoweihu commented 3 years ago

The caption evaluation scores are calculated by the official COCO evaluation code, which is a submodule in this repo. You may check the evaluation code for details of CIDEr.

alfred100p commented 3 years ago

Thank you so based on the last lines of:

I assume it was CIDEr. But I assume it would be better if an official author could comment on what was intended in the paper.

alfred100p commented 3 years ago

Based on the table 1 from the paper it mentions AoANet (citation 11) and in its official paper (https://arxiv.org/pdf/2002.12204.pdf) in table 1 the score can be concluded as CIDEr-D. I have made a PR to add the score names to the README file(#137).