protossw512 / AdaptiveWingLoss

[ICCV 2019] Adaptive Wing Loss for Robust Face Alignment via Heatmap Regression - Official Implementation
Apache License 2.0
395 stars 88 forks source link

About the model's generalization ability #20

Closed HongRealLee closed 4 years ago

HongRealLee commented 4 years ago

Thank you for your implementation! My experiments require facial landmarks annotated in some dataset without ground truth annotation. So I intended to use your model as preprocessing. Firstly, I ran this model as instructed on WFLW dataset, it did perform perfectly. Then, I ran it on KDEF dataset, which is a lab conditioned, multi-posed facial dataset. While the landmarks were way from accurate positions. Why couldn't it generalize from a obviously difficult dataset to a much simpler one? step10 step20 step30 step40

step10 step20 step30 step40

HongRealLee commented 4 years ago

OMG! I observered these misplaced landmarks closely, and find that their shapes basically match subjects's facial parts, but squeezed on th y demension. So I tried to enlarge their y cordinations by the ratio of image itself. The modified landmarks matched perfectly! The model's generalizatin is absolutly fine. Then the previous problem may rise from my code modification. I'd better look into my code more carefully, debug and avoid manual modification on my landmarks. Again, thanks for your sharing! step10 step20

orlevit commented 4 years ago

@HongRealLee I would like to use this code as a preprocess as well, would you share your code please?, How did you address the missing landmarks? is the "heatmap" list is all zeros in the beginning?