search

zhengyuf / IMavatar

Official repository for CVPR 2022 paper: I M Avatar: Implicit Morphable Head Avatars from Videos
MIT License
628 stars 61 forks source link

FLAMEServer.inverse_skinning_pts #10

Closed UestcJay closed 2 years ago

UestcJay commented 2 years ago

many thanks for your great work! In FLAMEServer.inverse_skinning_pts, I do not understand the meaning of pnts_c_original, why should forward_skinning_pts after getting pnts_c_original? Thanks for your time!

zhengyuf commented 2 years ago

Hey,

Thank you for your question. The FLAME canonical space has the mouth closed, but this results in a sharp transition in LBS weight between the lips, which cannot be learned by a continuous deformer MLP. Therefore, we used a different canonical space from FLAME, by setting the canonical pose to a mouth-opened state. So to answer your question, pnts_c_original is in the FLAME canonical space, we then map it to the IMavatar canonical space.

Best, Yufeng

UestcJay commented 2 years ago

thanks for your reply!