search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.99k stars 1.86k forks source link

Action units problem #763

Open Angel113110 opened 5 years ago

Angel113110 commented 5 years ago

Dear author I can obtain features about action units when I use FeatureExtraction.exe . I have some questions for you: 1、Can I use these features to do facial expression recognition? 2、 Are these features stable and reliable? 3、If it is possible for me to do FER task, how to use these features?

TadasBaltrusaitis commented 5 years ago

Hi,

  1. What do you mean exactly by facial expression recognition? Action Units are a way to describe a facial expression, so by extracting them you are already doing facial expression recognition. Do you mean facial expression of emotion (e.g. happiness, sadness, surprise etc.)?
  2. With regards to their reliability and stability, it will depend a lot on the dataset you are using them on, they will be much more reliable on frontal facing faces from clear video recordings. The accuracy will drop in cases of occlusion and pose variation. For some expected results please see the OpenFace 2.0 paper.
  3. As mentioned before OpenFace is already performing the FER task, just maybe using a different parametrization than you are interested in.
Angel113110 commented 5 years ago

Thanks for your kind reply. I have already understood.