search

cosanlab / py-feat

Facial Expression Analysis Toolbox
https://py-feat.org/
Other
245 stars 67 forks source link

How to use au_model="rf" and emotion_model = "rf" in version 0.4 #134

Closed ritika24-s closed 1 year ago

ritika24-s commented 2 years ago

Hi,

I wish to use au_model="rf" since RF model gives the intensity as random continuous variable unlike SVM which just gives the possiblity of detecting aus for my analysis.

It was possible in version 0.3.7 but is not in latest version. What's the alternative for this? Also, my requirement is to use HOG based models only for au and emotions. So I can only use either RF or SVM. Is there any alternative for it?

ljchang commented 2 years ago

hi @ritika24-s , We discovered an issue with the output of the RF model, which we haven't had time to fully debug or retrain yet. We disabled it in version 4.0, but plan to revisit adding it in the next version. It might not be too hard to convert the SVM output into probabilities using platt scaling, but I'm not sure if we are retaining enough information in the model to do that without retraining it.

We are currently in the process of doing another major refactor to the code and the AU detector module is next up in the queue, so we should have more info about this soon.

I definitely don't advise you to use the old model at this point, but depending on your project, you could always roll back to the older release.

ritika24-s commented 2 years ago

Hi Luke,

Thanks for replying. I am using PyFeat for my thesis.

In your expert opinion, do you think using the rf model to get AU intensities is still okay? Because my submission is in August and I tried working with SVM but it really doesn't solve my problem at all.

I would love to know your opinion on it.

med-tim commented 2 years ago

I have long used the rf model from the older version and have recently noticed that the AU intensities are significantly different than the newer AU models in version 0.4.

I am also curious to hear if anyone has found the old rf model to be inaccurate.

ritika24-s commented 1 year ago

Hi Luke,

Thanks for replying. I am using PyFeat for my thesis.

In your expert opinion, do you think using the rf model to get AU intensities is still okay? Because my submission is in August and I tried working with SVM but it really doesn't solve my problem at all.

I would love to know your opinion on it.

On Thu, 28 Jul 2022 at 19:07, Luke Chang @.***> wrote:

hi @ritika24-s https://github.com/ritika24-s , We discovered an issue with the output of the RF model, which we haven't had time to fully debug or retrain yet. We disabled it in version 4.0, but plan to revisit adding it in the next version. It might not be too hard to convert the SVM output into probabilities using platt scaling, but I'm not sure if we are retaining enough information in the model to do that without retraining it.

We are currently in the process of doing another major refactor to the code and the AU detector module is next up in the queue, so we should have more info about this soon.

— Reply to this email directly, view it on GitHub https://github.com/cosanlab/py-feat/issues/134#issuecomment-1198469446, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL7EBLTWIVUEBONVOEBT7DLVWLD6XANCNFSM546CY4IA . You are receiving this because you were mentioned.Message ID: @.***>

akiratsuraii commented 1 year ago

Hello Ritika, I'm attempting to use PyFeat for my thesis to obtain the AU intensities also, but it seems that PyFeat is not the greatest option at this time. Could you share to me what you did afterall?Do you still with PyFeat? I'm hoping you'll share with me. Many thanks :D

ejolly commented 1 year ago

Hi @ritika24-s @akiratsuraii please check out our latest release (0.5.0) in which we've added/retrained our AU. Our new default is now xgb which gives continuous valued predictions between 0-1.

Hey @med-tim as mentioned by @ljchang our rf model was not performing properly and so we've now removed it our latest release and no longer recommend its use.