google / site-kit-wp

Site Kit is a one-stop solution for WordPress users to use everything Google has to offer to make them successful on the web.
https://sitekit.withgoogle.com
Apache License 2.0
1.25k stars 290 forks source link

Only the "All Users" metric is populating on pages where there is a "Not enough traffic to display stats" #7510

Open jamesozzie opened 1 year ago

jamesozzie commented 1 year ago

Bug Description

One user in the forums reported an issue whereby they are seeing only the "All users" metric appear, with no visits in the graph below it, or in the panels/sources pie chart.

This is similar to #7369, only in this instance this occurs on a single site. It may be due to the property connected being also connected on multiple other sites, and requires further troubleshooting.

Steps to reproduce

Unable to reproduce so far. Testing was done to try and recreate this based on selecting the same GA4 property for multiple sites.

Screenshots

image

image

image

Additional Context

Insights & Troubleshooting Checks performed


Do not alter or remove anything below. The following sections will be managed by moderators only.

Acceptance criteria

Implementation Brief

Test Coverage

QA Brief

Changelog entry

jamesozzie commented 1 year ago

Based on the latest updates from the impacted users, on pages where only the "All users" metric is showing, these pages are all displaying the "Not enough data to display stats" banner. It may be possible that the "All users" metric is incorrect, showing data from another site (possibly using the same Analytics property).

As per the image below, there were over 400 users who visited the site over the selected reporting period. None of these are accounted for in the chart below the "All users" metric or in the pie chart to the right.

image

The user also shared a very useful Gif where it shows data possibly sampled, when accessible from analytics.google.com, using the "Source: Analytics" link. See internal testing task. In this recording, it looks like Analytics (and in turn, Site Kit), may be using sample data. When I testing the "Source: Analytics" link on test sites, I’m seeing only unsampled data.

jamesozzie commented 1 year ago

More details left in the internal testing task after the impacted user shared additional insights. Awaiting feedback from another impacted user.

jamesozzie commented 1 year ago

The impacted user shared a recording of their experience, where for individual pages where not all the data is displayed (only the "all users: metric). In this recording it's possible to see that when they click on the "Source: Analytics" link, the data is sampled for this page and the full graph won't show in analytics.google.com/.

The user also confirmed that when using the GA4 query explorer that the "All users" metric does display data as it does in Site Kit.

image

Escalating this for further review. We don't have any test sites impacted by sample data, but if there are other methods to check using the Query Explorer why the pie chart and other Analytics metrics don't display data, I'm happy to continue testing.

jamesozzie commented 1 year ago

Some additional details provided by the impacted user:

Latest comment in the support topic:

 Maybe it’s related to GA4 Reporting identity ?
I tried with “device id” setting, and data is populated where page has low traffic

I enabled Google Signal ins GA4, maybe i dont have to use it ? Or the User ID is missing …
Note: it’s working also if i disable the “Include Google signals in reporting identity” option and keep “Blended”  data
jimmymadon commented 4 months ago

@jamesozzie I've had a deep look into reproducing this. Lets do a sync this week to discuss this issue further.

jamesozzie commented 4 months ago

Happy to sync whenever suits @jimmymadon, and set up any environment in advance if you feel it may be reproducible.