yinguobing / cnn-facial-landmark

Training code for facial landmark detection based on deep convolutional neural network.
MIT License
630 stars 182 forks source link

prediction wih 3D #42

Closed abdou31 closed 5 years ago

abdou31 commented 5 years ago

Hello , I want to know how can i use 3D in the model to get good values?

yinguobing commented 5 years ago

Could you be more specific about this question?

abdou31 commented 5 years ago

After training and reached the 92104 steps , i get good resultat for face landmark for frontal face , but no good for profil view ( false result ) Like this : ( see the right gif ) https://github.com/yinguobing/cnn-facial-landmark/blob/master/demo02.gif

yinguobing commented 5 years ago

The demo gifs are actually extracted from the 300VW dataset, which have been used in the training process. This makes them not suitable for evaluating the model's performance.

Since you have successfully trained a model, I think it's a good time for you to read this paper: https://arxiv.org/abs/1608.04188

abdou31 commented 5 years ago

Okey Thanks , Do you have idea how can i train my own dataset? You know that i want to detect iris region ( in the eye ) using landmarks detection, i want to use dataset landmarks that gives iris landmarks , if doese not exist , i want to know how can i annotate dataset with landmarks to get specifics anootations for own dataset?

yinguobing commented 5 years ago

Try this one: https://www.menpo.org/landmarkerio/

abdou31 commented 5 years ago

My question is about 3D , If i have values for exemple in .pts file : ( simple file containes x and y coordinates )

n_points 68 { 252.23 415.1 ... }

If i have the other coordinate z that used for 3D: ( for exemple )

n_points 68 { 252.23 415.1 214.63 ... }

Is it possible to detect the landmarks facial in 3D ( x,y,z)?

yinguobing commented 5 years ago

I think it is possible if you have 3D points as training data.

abdou31 commented 5 years ago

Did the project can train z coordinate? ( 3D annotation ) if yes what can be the form of pts file and what should I modified in scripts of images utility?