Kartik-3004 / facexformer

Official implementation of FaceXFormer: A Unified Transformer for Facial Analysis
https://kartik-3004.github.io/facexformer_web/
MIT License
170 stars 17 forks source link

Low accuracy with landmark detection task #13

Open karaposu opened 2 months ago

karaposu commented 2 months ago

When i try to hf model with example images it shows bad accuracy in certain facial areas (eyes specially). Here is an example:

Screenshot 2024-05-14 at 12 12 38
uozyurt commented 1 month ago

Actually, the main reason for that is the inputs alignement. You have to properly crop the face if you want to get accurate outputs in these kind of tasks (specifically, facial attribute recognition and landmark detection).

The main mistake is you have too much space above the input face. If you cut this space off, it will give you accurate results (I tried to input in both ways in my local for getting the problem you had). Hope that I fixed your problem!

karaposu commented 1 month ago

@uozyurt Yeah makes sense. This model is a bit extra sensitive about cropping compared to similar ones. Thanks umut