gulvarol / bodynet

BodyNet: Volumetric Inference of 3D Human Body Shapes, ECCV 2018
http://www.di.ens.fr/willow/research/bodynet
MIT License
261 stars 42 forks source link

PCKh/head size calculation #14

Closed fleinen closed 4 years ago

fleinen commented 4 years ago

Hi Gül,

according to your BodyNet paper, you're using PCKh@0.5 metric for evaluating the performance of the 2D pose estimation. Newell et al. refer to PCKh as a "distance [that] is normalized by a fraction of the head size." Is the calculation of PCKh included in this repo? The only PCK related calculations I found are in eval.lua L14 and L93. While L14 seems to be a generic implementation, the call in L93 seems to calculate the PCK@0.05 metric assuming that the image/heatmap fits the person. How did you calculate the head size/PCKh for the evaluation in your paper? Thanks in advance.

Best, Fabian

gulvarol commented 4 years ago

Hi Fabian,

Thanks for reporting this issue. You are right, the calculation in this repo is not PCKh. These functions were taken from the official repository and I hadn't realized their note before:

https://github.com/princeton-vl/pose-hg-train#training-accuracy-metric https://github.com/princeton-vl/pose-hg-train/issues/41

So the numbers in the Table A.1 of the supplemental material correspond directly to the output of our released code.

Best, Gul