search

Rubikplayer / flame-fitting

Example code for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 3D keypoints and 3D scans.
http://flame.is.tue.mpg.de/
738 stars 111 forks source link

Deformed Mesh After Fitting (Want to know possible reasons and ways for improvement) #58

Open soni-H opened 1 month ago

soni-H commented 1 month ago

Hi,

I am a student exploring 3D vision and facial parametric models. I have had a hard time fitting flame parameters on my mesh and I guess I am missing something very basic and essential here. The mesh that I am trying to fit has ~38K points and ~64K faces. And it looks like the following on surface reconstruction using ball pivoting filter from meshlab. image image

The mesh surface is not smooth as it is in the example mesh. However, I tried fitting the above mesh and clicked 51 landmarks using PP module of meshlab. The resulting mesh is deformed and looks like I am missing some very basic things to have received such a mesh as output.

image

I'm attaching the mesh and picked 3D keypoints here. It would be a great help if you could spare a few minutes and have a look at the mesh/landmarks. scan_lmks.zip

Is it because the input mesh is not a good enough or there is some issue with the landmarks. Also I have been setting up scale_unit as 'na' so far.

soni-H commented 1 month ago

Can one of the authors kindly comment? @Rubikplayer