mozilla / fxa

Monorepo for Mozilla Accounts (formerly Firefox Accounts)
https://mozilla.github.io/ecosystem-platform/
Mozilla Public License 2.0
595 stars 210 forks source link

Registration Form view on iOS seems innacurate #3353

Closed davismtl closed 3 years ago

davismtl commented 6 years ago

I wanted to compare the trend of registrations on iOS to the number of views of the registration form but I noticed we get more registrations than form views. That's not right.

https://analytics.amplitude.com/org/31251/chart/yhzgxit

┆Issue is synchronized with this Jira Task ┆Issue Number: FXA-542

davismtl commented 6 years ago

It really seems to be specific to iOS: https://analytics.amplitude.com/org/31251/chart/new/f0k07bf

CC @irrationalagent

irrationalagent commented 6 years ago

At first glance, this seems to be specific to amplitude, although even on re:dash registration rates on iOS are the highest among all devices, which might mean that there are some form views missing, just not enough for us to tell for sure:

https://sql.telemetry.mozilla.org/queries/52331/source

The table contains raw counts for each funnel step. Note that the "engage_no_view" and similar columns contain non-0 entries, indicating that some form views are missing (assuming you must have had a view if you registered).

Specifically, around 5% of flows that registered an account verification event never register having had a form view.

davismtl commented 6 years ago

The older the Android version, the older the hardware.

We should probably still test just in case. Anybody have an old device to test with?

@juliemccracken Is this something we could have Softvision test?

juliemccracken commented 6 years ago

@davismtl I'll ask Softvision.

irrationalagent commented 6 years ago

@davismtl @juliemccracken to be clear, I think Alex was actually referencing this issue with his comment: https://github.com/mozilla/fxa-amplitude-send/issues/59

davismtl commented 6 years ago

@irrationalagent @juliemccracken OMG, this is correct. I have no idea how I left my comment on the wrong bug.

Good catch Leif! I'll copy my comment over there too.

irrationalagent commented 4 years ago

we still have more reg - created than reg - view events, so we should probably leave this one open.