biancadanforth / tracking-protection-shield-study

A Shield study to determine the optimal messaging, if any, for Tracking Protection in Firefox.
0 stars 3 forks source link

End the study if the user has another ad-blocking add-on installed? #162

Closed biancadanforth closed 6 years ago

biancadanforth commented 6 years ago

From an e-mail with one of our QA team members, @SoftVision-CarmenFat:

How should we handle the scenario in which an user installs during the study another adblocker addon? Shouldn't the study end in this case? We've tested this with other tracker blockers addons installed like "uBlok" and "Ghostery" in which case the "Tracking Protection Shield Study" will no longer detect any trackers within the visited page.

This is a very good question, and I think you are right that we should probably check for those add-ons as an eligibility criterion for enrollment in the study as well as listen for if they are installed during the study. The three add-ons I can think of are uBlock, Ghostery and Disconnect.

@gregglind, just want to confirm with you that this is a good idea before embarking on this quest. :) I.e. that this is a P1? I know it's probably not a common scenario, but still seems like it would invalidate the study data for that user.

biancadanforth commented 6 years ago

It is possible for Normandy to check as an eligibility criteria for these add-ons on in install and if the user installs one during the study, it will unenroll them within 24 hours.

While this can be done in Normandy, Matt_G's preference is to keep this check in the add-on if possible.

SoftVision-EmilPasca commented 6 years ago

This issue is no longer reproducible with the latest Tracking Protection Messaging .xpi installed (v.1.0.2), retested on Windows 10 x64, Mac OS 10.12 and Ubuntu 16.04 with Unbranded Beta 59.0b14.