search

geopavlakos / hamer

HaMeR: Reconstructing Hands in 3D with Transformers
https://geopavlakos.github.io/hamer/
MIT License
326 stars 28 forks source link

multiple hand detected at one location #15

Closed linjiangya closed 6 months ago

linjiangya commented 7 months ago

Dear authors, thank you for your great work. I am now having two problems:

  1. Where is the part that handedness (e.g. left, right) is used or applied to the MANO layer? I think the handedness is needed for generating the verts and the initialization of the MANO layer. But it seems that there is only one MANO layer in your code using MANO_RIGHT.pkl. (Update: Oh it seems to be here where you flipped the X axis: verts[:,0] = (2*is_right-1)*verts[:,0]... It makes sense now. )

  2. Is there a maximum suppression operation? I have tested your code and it seems that sometimes there will be wrong detections like the below:

image image image

geopavlakos commented 6 months ago

You are correct. For the demo code, we don't perform a non-max suppression on the hand level, that's why you occasionally see some of these double detections. If you do a more careful suppression, you should be able to get rid of those.