search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.71k stars 1.82k forks source link

Facial lanmarking completely off #1057

Open m-a-x-c opened 8 months ago

m-a-x-c commented 8 months ago

Describe the bug I tried to use the Face Landmarking tool on an image and the landmarks were completely off (results attached). Is this because I did something wrong or the model is just not that good (e.g. not invariant to camera angle)?

To Reproduce I ran the command .\FaceLandmarkImg.exe -f test_image.png to produce facial landmarking on my test image. The results are attached under 'Screenshots'.

Expected behavior The landmarks were completely off.

Screenshots What the model produced: test_image screenshots to help explain your problem.

Desktop (please complete the following information): Windows 10 (64-bit)

brmarkus commented 8 months ago

Can you try with the samples ("https://github.com/TadasBaltrusaitis/OpenFace/tree/master/samples"), please?

m-a-x-c commented 8 months ago

It does not work with some of the samples either:

sample2

sample3

brmarkus commented 8 months ago

So, mainly due to angles?

Would it make sense for your use-case to (re-)train the model?

https://github.com/TadasBaltrusaitis/OpenFace/wiki/Datasets https://github.com/TadasBaltrusaitis/OpenFace/tree/master/model_training