openfoodfoundation / Analytics

A repository to share progress on Analytics work
GNU Affero General Public License v3.0
0 stars 0 forks source link

[Split-Checkout] Set goals/funnels to assess checkout metrics #3

Open filipefurtad0 opened 1 year ago

filipefurtad0 commented 1 year ago

We want to understand conversion rates around Split-checkout. There are many ways to achieve this, two have been identified:

1) using page visits

ATM, not sure how to make option 2) work correctly, so, proceeding with 1).

filipefurtad0 commented 1 year ago

Just published a new version on FR-prod, with this set of trigger/tag/goal:

image

RachL commented 1 year ago

@filipefurtad0 FYI I think FR has turn ON & OFF split checkout a lot of times. Maybe worth keeping UK as main metric base as long as legacy checkout is not removed?

filipefurtad0 commented 1 year ago

Ok, thanks for that heads up @RachL . I'll wait a few days to make sure the tracking is working as expected, and then implement this in UK-prod as well.

filipefurtad0 commented 1 year ago

I'm not too sure we can measure funnels with the "do not track option" enabled. For the same settings (goal/funnel/tag/trigger), on staging-UK, we can track the user journey:

image

Which we can't on uk-prod:

All the conversions seem to happen on the /details step, although the triggers are clearly configured to fire only on the summary step:

image

The only option I see is to remove/disable the funnels. In that case, the the tag/trigger should convert the goal on the checkout/summary page. But we loose conversion info between the details - payment - summary steps (which page is the bottleneck) for split checkout.

Thoughts?

filipefurtad0 commented 1 year ago

I've just noticed that we have the same page title for each of the steps of split-checkout:

image

Having the correct title could perhaps improve our tracking, for example by examining Users Flow data. I would also add-up to the info provided to each customer, on checkout. Should I open a wish-list for this @RachL? What do you think?

RachL commented 1 year ago

@filipefurtad0 the "do-not-track" option shouldn't influence a lot the results for UK or AU prod. It might for FR prod where Firefox is mainly used. To my understanding, Firefox is one of the only browser that activate this option by default. And it's not in our top browser list apart from France.

Why did you concluded with a link between the two? We can discuss in analytics chat tomorrow if that's easier.

re the title, if it makes things easier, sure!

filipefurtad0 commented 1 year ago

Thanks @RachL,

Why did you concluded with a link between the two?

I've set the goals in the same way, both in staging and prod; the only difference is the container setting, so I concluded this could play a role, but maybe that's not it... I don't know why the clicks on the payment and summary pages are not being triggered in UK-prod, these were tested in preview mode (in staging) and should work... :shrug:

We can discuss in analytics chat tomorrow if that's easier.

Let's do that, yes :+1:

re the title, if it makes things easier, sure!

I think changing the page title could be a papercut, and yeah - hopefully improves things when analyze Users Flow data - as of now we can can only find the page "Checkout - Open Food Network" (marked purple, below ):

image

drummer83 commented 9 months ago

Now that #11599 has been closed we could consider looking at this again. Would that make sense at the moment, @filipefurtad0 and @openfoodfoundation/train-drivers-product-owners?

filipefurtad0 commented 9 months ago

Thanks for the reminder @drummer83 !

I'm curious to see how will the diagram above look like in a couple of days/weeks. I've set a reminder to have a look at it by the end of this week again. Edit: this won't be on this week's release, so it makes sense to check Matomo again in the end of next week (not this one).