TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.84k stars 1.84k forks source link

How can I get tri_68.mat #842

Open yy19931029 opened 4 years ago

yy19931029 commented 4 years ago

Hello Tadas,

When I want to use your code to train my 98 points landmark, the code need .\OpenFace2.2\model_training\pdm_generation\tri_68.mat or in .\OpenFace2.2\x64\Release\model\cen_general.txt need tris_68.txt. I know how to add point, but I don't know how to get tri_68.txt, and if I delete the line in cen_general.txt "Triangulations tris_68.txt", the code still runs fine, whether it will affect the accuracy of facial landmark?

TadasBaltrusaitis commented 4 years ago

Hi,

The triangulation is mainly used in order to do piece-wise affine warping of the face and for masking out face regions. This is an important part for Action Unit detection and success determination when tracking landmarks (this is where the confidence score of detection comes from)

However, it isn't strictly needed for landmark detection, but if you want to have a system that is more resistant to drift when tracking videos, or has a way of measuring confidence/reliability, you will need the triangulation.