matomo-org / matomo

Empowering People Ethically with the leading open source alternative to Google Analytics that gives you full control over your data. Matomo lets you easily collect data from websites & apps and visualise this data and extract insights. Privacy is built-in. Liberating Web Analytics. Star us on Github? +1. And we love Pull Requests!
https://matomo.org/
GNU General Public License v3.0
19.64k stars 2.62k forks source link

Full support for Filters #15438

Open viezel opened 4 years ago

viezel commented 4 years ago

Since Segments cannot be used as filter anymore (see https://github.com/matomo-org/matomo/issues/15163) Then I put forward this high priority feature request to add full feature support for Filtering. Suggesting Custom Reports plugin as a solution for this feature is not an option. This feature must be part of the core offering.

Most modern web application are data driven and as part of its value proposition it will create dashboard, reports etc to inform its users of the usage of their offering. Building user defined reports/views/dashboards based on user interactions will include filtering, as the user want to see exact results. Filtering and segmentation is the essentials features of any Analytics platform. Hence, we must build this missing feature at its highest priority.

How

As Matomo also advertise to be a replacement of Google Analytics, then lets see what they do:

Filtered queries restrict the rows that do (or do not) get included in the result. Each row in the result is tested against the filter: if the filter matches, the row is retained and if it doesn't match, the row is dropped.

Dimension filtering: Filtering occurs before any dimensions are aggregated, so that the returned metrics represent the total for only the relevant dimensions.

  • Metrics filtering: Filtering on metrics occurs after the metrics are aggregated.
  • Valid combinations: You can filter for a dimension or metric that is not part of your query, provided all dimensions/metrics in the request and the filter are valid combinations. For example, you might want to query for a dated list of pageviews, filtering on a particular browser.

Source: https://developers.google.com/analytics/devguides/reporting/core/v3/reference#filters

For rich possibilities of Filtering the massive amount of data a regular website/app gets, we need the following operators:

Metric Filter Operators

Operator Description
== Equals
!= Does not equal
> Greater than
< Less than
>= Greater than or equal to
<= Less than or equal to

Dimension Filter Operators

Operator Description
== Exact match
!= Does not match
=@ Contains substring
!@ Does not contain substring
=~ Contains a match for the regular expression
!~ Does not match regular expression

It would be a big plus if we could get support for Regular expression in those filters.

Filter Syntax

Given the fact that Segments are alreadty supported, we only need to invent a filter parameter.

metric_dimension_name operator expression

Example:

filter=referrerName==Google,referrerName==Bing;country==IN
Chardonneaur commented 4 years ago

Silly remark, though wouldn't it be the same feature as the shortcut one in Google Analytics? So to say applying a filter gives you the possibility to save it and to make it as custom report (though you won't have the possibility to add additional columns)

marcorieser commented 4 years ago

vote 👍

tsteur commented 4 years ago

Hi there,

quick update here:

We'll see next year (this year is already fully planned) whether work on this or not. It's not too high of a priority because:

I do fully understand it's useful and would love to have this too. The combination of performance trouble, taking long time to develop etc while there are workarounds makes it not the best candidate to work on right now though (not saying we won't do it next year or so)

marcorieser commented 4 years ago

@tsteur It seems that I missed the configuration option in the documentation. Thanks for the hint and the update. This will be fine for us for the moment. 👍

Petsios commented 3 years ago

Hello,

is this config still available (working) with version 4.2.1?: _segments can be put into "filter" mode with a config flag (of course it then applies to all segments). To enable this set [General]enable_segmentscache=0 in config/config.ini.php

Thanks a lot

Findus23 commented 3 years ago

Hi @Petsios,

Nothing changed about this since the release of Matomo 4: https://github.com/matomo-org/matomo/blob/d099f75f836b6ed8402bc91c9534846642824058/config/global.ini.php#L205-L209

jr-ewing commented 2 years ago

Hi, sorry for the question ... Is there any progress here? It would be great if, for example, you could specify whether a segment should have Action or Visit Scope.

viezel commented 2 years ago

.

sgiehl commented 2 years ago

It would be great if, for example, you could specify whether a segment should have Action or Visit Scope.

@jr-ewing Isn't that kind of automatically defined by the segment? As soon as an action dimension is used its an action scope otherwise it's visit scope. Or what exactly do you mean here?

KarthikRaja1388 commented 2 years ago

Customer's request: I want to build widgets that work with the filters.

sgiehl commented 2 years ago

@KarthikRaja1388 Are you able to explain that a bit more? Does he want to e.g. show an page url report, that only contains urls that matches a certain pattern, or is that request really about filtering the data before archiving?

KarthikRaja1388 commented 2 years ago

@sgiehl Will post the customer's full question:

In the Custom Report Plugin I have the option of filters. So I want to build widgets that work with the filters. Segments not working for me - in this case.

What I want to recreate is the table under "Pages". My widget should have the same columns as under "Pages". In addition, I want to display the entry columns, which you can currently find under entry pages.

So I would like to show the values ​​of a URL. So say 1:1 the values ​​from Pages.

atom-box commented 10 months ago

Matomo: What is the feature you are missing the most in Matomo and why? User: ...option for multiple filtering

atom-box commented 10 months ago

Question: What is the feature you are missing the most in Matomo and why? Answer: Segment reports temporarily without creating permanent report segments. View event category, action and value simultaneously for events. (Answer in Deutsch: Reports vorübergehend segmentieren, ohne dauerhafte Berichtssegmente zu erstellen. Für Ereignisse Ereigniskategorie, Aktion und Wert gleichzeitig betrachten.)