search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.95k stars 1.85k forks source link

Calculate emotions #772

Open DavidSadeh opened 5 years ago

DavidSadeh commented 5 years ago

Hello How can clustered data and regression help us identify emotions (intensity and weakness)?

TadasBaltrusaitis commented 5 years ago

Hi,

OpenFace recognizes facial expressions and not facial emotions, because the latter is fairly application specific (not to mention culture/context differences).

You would need to collect your own data with your desired annotations (such as intensity and weakness?) and then train a model to run on output from OpenFace (or create a rule based model).

Thanks, Tadas

DavidSadeh commented 5 years ago

Dear Tadas What I mean is: In order to identify disgust (for example), what is the difference between the results of the class and the regression? Should they be combined or are their results separate?

Thanks Davoud

TadasBaltrusaitis commented 5 years ago

Do you mean weather you should use the AU classification or regression results?

You can use both, as they have been trained on different datasets and might have different accuracy on your set.