av-savchenko / face-emotion-recognition

Efficient face emotion recognition in photos and videos
Apache License 2.0
654 stars 124 forks source link

Is it possible to predict action units? #47

Closed tvaranka closed 7 months ago

tvaranka commented 7 months ago

In the paper "Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devices" predictions are made for AUs. I wonder if this is possible with the code provided here?

av-savchenko commented 7 months ago

Thanks for your question. Yes, the abaw5_expr_va_au_train.ipynb contains all the required information to reproduce our paper

tvaranka commented 7 months ago

Thanks for the quick answer! For inference, which model would you recommend for the best AU performance?

av-savchenko commented 7 months ago

Please, take a look at the above-mentioned ipynb file, there are several markdown comments after section "AU (Action Units)" that compare performance for several pre-trained models. I believe, enet_b0_8_best_vgaf works better

tvaranka commented 7 months ago

Thanks a lot!