search

cleardusk / 3DDFA_V2

The official PyTorch implementation of Towards Fast, Accurate and Stable 3D Dense Face Alignment, ECCV 2020.
MIT License
2.87k stars 507 forks source link

Align the coordinates of 3D landmarks #24

Open ivanlen opened 3 years ago

ivanlen commented 3 years ago

Hey congrats for this beautiful job, very interesting actually.

I was wondering if there is way to

  1. get a 3d representation of the landmaks, like (x,y,z) coordinates for each landmark point.
  2. I would like to align the arrays of landmarks of different faces with a reference landmarks.

Ideally I would like to have all the 3d landmarks coordinates aligned to the same reference point, for example: all the landmarks coordinates are the coordinates of a frontal face where the proportions of the face are all similar.

cleardusk commented 3 years ago

I am a little confused about your question.

  1. Each landmark has a (x, y, z) coordinates, by weak perspective projection.
  2. Just applying the ICP ?
MrTornado24 commented 3 years ago

Hi, I wonder if the world coordinates of landmarks should be "self.bfm.u_base + self.bfm.w_shp_base @ alpha_shp + self.bfm.w_exp_base @ alpha_exp" in TDDFA.recon_vers()?

tkzky commented 3 years ago

Hello! I have some question about the z axis. I'd like to know does the Z coordinate represent the depth information of the landmarks? Looking forward to your reply!