zhiqiangdon / CU-Net

Code for "Quantized Densely Connected U-Nets for Efficient Landmark Localization" (ECCV 2018) and "CU-Net: Coupled U-Nets" (BMVC 2018 oral)
Apache License 2.0
227 stars 40 forks source link

Error in table 8 of the paper with the 300W NME? #7

Open jmbuena opened 5 years ago

jmbuena commented 5 years ago

Hi,

I have looked into table 8 in your paper and all the measures you put there from the literature computes the NME dividing by the interpupil distance. On the other hand, I'm not sure if instead you are dividing by the outer eyes corners distance to compute your own results on table 8. In fact I'm not sure if the stacked hourglass results of reference [23] in your paper has the same normalization (dividing by outer eyes corners distance). Take into account that this is not comparable (see our ECCV 2018 paper as both results differ in more than 1% for the same method.

I ask it because at function per_image_rmse, you divide the error by the distance between landmarks 37 and 46 (36 y 45 in python indexes). And in 300W those are the outer eye corners landmarks.

Am I missing something?

Thanks a lot for any clarification about it.

Sierkinhane commented 4 years ago

@jmbuena I agree with you. I think the author took the inter-ocular results to compare with other's inter-pupil results.