search

blessedlex / Skynet-Zuckerberg-Edition

CYBR 4580-8950 IA Capstone Project
0 stars 0 forks source link

create Facebook test account to test tagging and determine accuracy behavior and bias #18

Closed blessedlex closed 3 years ago

blessedlex commented 3 years ago

post screenshots here of the UI and testing -- go through the settings of how a user can turn on or turn off the facial recognition feature and record by taking detailed notes &/or screenshots

blessedlex commented 3 years ago

Facebook Account: dshiparo97@gmail.com

blessedlex commented 3 years ago

First thing that is seen once you create a new account and go to facial recognition settings.

1st Capture 2 Capture

smmay97 commented 3 years ago

![Uploading image.png…]()

blessedlex commented 3 years ago

Next, with facial recognition turned off, the user cannot be auto-tagged in any uploads from another user on Facebook.

3 Capture 5 Capture

smmay97 commented 3 years ago

Sean's personal account facial recognition setting set to ON.

Sean Account Screen Shot

blessedlex commented 3 years ago

Sean has his setting on, he was auto-tagged in Devin's upload before the post was even submitted.

6 Capture 7 Capture

blessedlex commented 3 years ago

With my setting off (on my personal account), I was not auto-tagged through the test account upload.

15 Capture 11 Capture 12 Capture 13 Capture

blessedlex commented 3 years ago

After asking a friend for permission to use their photo for the test (Devin Shiparo) account, I tried tagging him from my personal profile AFTER setting Devin's facial recognition setting to ON. The auto-tag feature did not initiate to tag my friend's face.

Note: This may be due to Facebook needing more facial data of my friend before determining that he is Devin from another user's account.

14 Capture

MLHale commented 3 years ago

ok, so the interface is doing what it is supposed to do. What does this tell us? How do you know if they are still doing facial recognition anyway?

If the research question is in regards to whether facebook is complying with their stated policies and respecting user privacy - how do you know? Just because the interface doesnt show tagged data, doesn't mean it doesnt exist.

blessedlex commented 3 years ago

We are shifting our focus into using this testing to obtain any bias and implications for privacy. We are still testing through the UI to get the accuracy of this auto-tagging/manual tagging behavior to potentially be able to replicate it and determine bias.

There have been some inaccuracies noted in this testing. Although the interface may not show the tagged data for user's to see on the UI, the behavior of the tagging and its accuracy are what we want to test to pull any implicit bias, population bias, and privacy implications on.

From the use of my friend's photo, he was not tagged as himself nor was he tagged for Devin. Why is that? The data exists because it has been uploaded but the UI is not accurately tagging/auto-tagging the person. What does an observation of this behavior potentially mean?