search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.94k stars 1.85k forks source link

Landmark stabilization #839

Open pokoso opened 4 years ago

pokoso commented 4 years ago

Hello Tadas,

Compared to the face landmark detection feature of dlib,

The result of landmark points of dlib has some shaking,

but OpenFace has no shaking of landmarks completely.

Can you explain what's different?

Thank you.

TadasBaltrusaitis commented 4 years ago

I don't know the exact details of how dlib is performing landmark detection. OpenFace is using quite a different algorithm, it uses a CE-CLM (Convolutional Expert Constrained Local Model) model, which is a combination of detection of local patches, with optimization over a shape model, such a local and optimization approach typically leads to much less shaking when compared to direct prediction of landmarks.