search

lmb-freiburg / freihand

A dataset for estimation of hand pose and shape from single color images.
https://lmb.informatik.uni-freiburg.de/projects/freihand/
384 stars 78 forks source link

Computation of the F Score #31

Closed zhipeng-fan closed 1 year ago

zhipeng-fan commented 2 years ago

Hi!

I got a quick question regarding computing the precision and recall to get the F score in the evaluation. I see in your original paper you refer to [1] for the details. But for pose estimation, the point in Reconstruction has an exact match in GT, while in the general 3D reconstruction task in [1], the relationship between the reconstructed point cloud and ground truth point cloud is not clear. I guess that's why in [1] they define the distance based on the closest point like chamfer distance. I was wondering for Freihand evaluation, are we following [1] exactly or define distance based on the known match relationships?

Thanks!

[1] Tanks and Temples: Benchmarking Large-Scale Scene Reconstruction

zimmerm commented 1 year ago

I'm following the definition exactly.