matomo-org / matomo

Empowering People Ethically with the leading open source alternative to Google Analytics that gives you full control over your data. Matomo lets you easily collect data from websites & apps and visualise this data and extract insights. Privacy is built-in. Liberating Web Analytics. Star us on Github? +1. And we love Pull Requests!
https://matomo.org/
GNU General Public License v3.0
19.89k stars 2.65k forks source link

[Bug]: Segment vs All Visits Discrepancy with Search Engine attributed sales #21422

Open 9joshua opened 1 year ago

9joshua commented 1 year ago

What happened?

A simple segment was created with the condition Channel type is Search (Organic)

For a specific week, the Sales by bu Referer -> Channel Type report shows 13 orders for the All Visits segment and 10 for the Organic segment... image image

However, the segmented visitor log for these two reports both show 11 orders. One visit in this log indicates there was an ecommerce order, but there is no entry for the order, so 10 is likely the correct number. This makes me believe the All Visits segment is showing additional orders that may not exist in the Sales by Referrer -> Channel Type table.

The Multi Channel Conversion Attribution report shows 10 orders for both segments... image image

What should happen?

The both the All Visits segment and the Organic segment should show the same number of Search Engine orders because they both draw from visits where the last non-direct referrer is a search engine.

How can this be reproduced?

The occurred on a Cloud instance. Unfortunately I don't have another instance to test this where there are:

  1. Conversion from Search Engine traffic
  2. An Organic segment set up

Matomo Version

Matomo 4

Matomo Patch or Minor Version

4.15

PHP Version

8.1

Server Operating System

NA

What browsers are you seeing the problem on?

Chrome

Computer Operating System

NA

Relevant log output

No response

Validations

bx80 commented 1 year ago

Thanks for reporting this @9joshua, it may be difficult to recreate as it seems be related to a specific combination of data. I'll assign it to the product team for prioritization.

Stan-vw commented 1 year ago

Just trying to understand what the issue here is, because in the first screenshot I see 14 orders (not 13) and every other screenshot I see 10 (never 11) orders. In other words, when looking at All Visits I see 14, and within the Organic segment I consistently see 10.

Can you help me understand the problem?

Also having no steps to reproduce means this is unlikely to be picked up anytime soon, because it might be a data issue rather than a platform issue. Let us know if you've been able to reproduce it consistently, so we can have a look at what's happening 👍