search

Shawn-Shan / fawkes

Fawkes, privacy preserving tool against facial recognition systems. More info at https://sandlab.cs.uchicago.edu/fawkes
https://sandlab.cs.uchicago.edu/fawkes
BSD 3-Clause "New" or "Revised" License
5.21k stars 481 forks source link

cloak not working? #36

Closed JSheadache closed 4 years ago

JSheadache commented 4 years ago

Thank you for your efforts and research in this area.

I tried cloaking images with Fawkes default settings. When I try it against Amazon rekognition demos the cloak has little to no effect. What am I doing wrong?

e.g.

Celebrity recognition demo, download Bezos sample image, run fawkes, upload cloaked image - recognition match is still 100%

face comparison demo: uploaded original, and cloaked image - match was 99.9%

Shawn-Shan commented 4 years ago

Yes, our cloak might not work if you simply compare the similarity.

Fawkes is designed to defeat large scale face recognition models (in the similarity matching case there are only two class, you or not you). So in order to test, you need to use the face verification API, upload your own image + many images of other people, use the API to train model, and check whether your original image will be recognized as you.

This is fairly complicated, we are actively working on a simple code base to help you test it.

JSheadache commented 4 years ago

Thank you very much for your reply.

Sent with ProtonMail Secure Email.

‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Monday, July 27, 2020 10:57 AM, Shawn Shan notifications@github.com wrote:

Yes, our cloak might not work if you simply compare the similarity.

Fawkes is designed to defeat large scale face recognition models (in the similarity matching case there are only two class, you or not you). So in order to test, you need to use the face verification API, upload your own image + many images of other people, use the API to train model, and check whether your original image will be recognized as you.

This is fairly complicated, we are actively working on a simple code base to help you test it.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.