exadel-inc / CompreFace

Leading free and open-source face recognition system
https://exadel.com/accelerator-showcase/compreface/
Apache License 2.0
5.72k stars 776 forks source link

Many false positives with a set of ~50 faces #627

Open hawkeye217 opened 3 years ago

hawkeye217 commented 3 years ago

Describe the bug I have trained about 50 different faces with at least 4-5 images per face. When using the web interface to identify a person from an untrained image, I see high "similarity" numbers (> 98%) that are falsely identified as the wrong person.

I noticed this page - is there a setting I can change to get better results and less false positives?

Thanks in advance!

Expected behavior A much lower similarity number for these false positives.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Additional context Add any other context about the problem here.

pospielov commented 3 years ago

Hi, false positives shouldn't depend on the number of faces. But we find out that FaceNet(default) model works badly on Asians. If this is your case - try to use our custom build SubCenter-ArcFace-r100: https://github.com/exadel-inc/CompreFace/tree/master/custom-builds The threshold you mentioned in our documentation - you need to choose it yourself on your side of the application, but the similarities are not configurable, they depend on the model. We will look at this problem more precisely, how we can reduce false positive

hawkeye217 commented 3 years ago

Thank you for the suggestion. Unfortunately the SubCenter-ArcFace-r100 model performance is worse on my dataset. Similarity values are very low with both untrained and trained images.