mozilla / addon-recommendation-shield-study

Stand-alone verison of Add-on Recommendation for Shield Study
Mozilla Public License 2.0
3 stars 7 forks source link

Possible analysis and telemetry plan #29

Closed gregglind closed 8 years ago

gregglind commented 8 years ago
theory: 
- recommendations are better if they follow ux patterns (urlbar)
- contextual 
- recommendations are awesome

unknowns:
- balancing pushiness to value

Branches:
- no recommendations at all (count 'would offer')
- push open *once* (under some conditions)
- passive only
- NOT DOING: push always, b/c seriously that sucks.

Outcomes by ARM:
- By site:
  - offer vs accept vs 'not for this site'
- Global
  - never show again
  - took an offer
- Uninstall addon
- General Firefox retention (total days)

PACKET:
- usual general telemetry ping
- usual shield-study ping (for uninstall, retention, install, expiry)
- Special:
  - site offer interaction with outcome
    {uid:
     site:
     outcome: missed | took-addon | closed | stop-show
     arm: 
    }
  - general addon interaction:
    {
      uid:
      msg:  nevershow | first-taken
      arm
    }

CONSENT / LEGAL
- see site info
- reports for a LIST OF SITES that user visited. (eTLD level, not specific url level), and the LIST IS <here>

DEPLOY PLAN:
- release