filby89 / spectre

Official Pytorch Implementation of SPECTRE: Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos
Other
234 stars 21 forks source link

About landmarks #16

Open JasonAnn opened 1 year ago

JasonAnn commented 1 year ago

Hi, thanks for the nice work! I notice the landmarks are from Mesh verts, but I wonder how the landmarks index in the FLAME were got? And what are the differences between 'dynamic/static/full_lmk_faces_idx', 'dynamic/static/full_lmk_bary_coords' ?

Thanks

filby89 commented 7 months ago

Hey, thanks for your interest in SPECTRE. These landmarks are taken directly from FLAME. You can find how these were acquired in the ringnet paper https://arxiv.org/pdf/1905.06817.pdf (Section 3.4). You can find more info here as well:

https://github.com/Rubikplayer/flame-fitting/issues/40