search

xingyizhou / StarMap

StarMap for Category-Agnostic Keypoint and Viewpoint Estimation
GNU General Public License v3.0
104 stars 19 forks source link

Evaluation image number #9

Closed YoungXIAO13 closed 5 years ago

YoungXIAO13 commented 5 years ago

Hi,

I noticed that you have tested the viewpoint estimation on the non-occluded and non-truncated subset of the validation set in Pascal3D+. However, I got 2136 images for all the 12 categories while you evaluated on 2113 images in the paper. So I'm wondering why you got 23 images less than mine.

xingyizhou commented 5 years ago

Hi, Our script for converting the raw data is here https://github.com/xingyizhou/StarMap/blob/master/tools/getPascal3DDataset.py. I remembered I have met similar issues but finally I got consistent with keypointsAndViewpoint, you can check this line https://github.com/xingyizhou/StarMap/blob/master/tools/getPascal3DDataset.py#L112 . Actually I didn't remembered exactly if I include or not include the missing images. But the code should fully reflect our evaluation protocol.

YoungXIAO13 commented 5 years ago

Thx, I'll look into that.