search

geopavlakos / hamer

HaMeR: Reconstructing Hands in 3D with Transformers
https://geopavlakos.github.io/hamer/
MIT License
326 stars 28 forks source link

pose parameter confusion #46

Closed twinkling13 closed 3 months ago

twinkling13 commented 3 months ago

Really wonderful work! Please forgive me -- I am just starting to learn about MANO and mesh fitting.

There seem to be 21 output keypoints, but there are only 15 + 1 rotation matrices (?) from the pose and the global orient. Am I understanding that correctly? What are the last rotation matrices? And is it possible to convert the rotation matrices to wxyz quaternions?

Thanks so much!

geopavlakos commented 3 months ago

The last few keypoints are not directly associated with a rotation. Instead, they are vertices from the estimated mesh (fingertips).

For this project, we only use rotation matrices and the axis-angle representation, but you could convert to other 3D rotation representations.

twinkling13 commented 3 months ago

I see, thank you!