mattab
commented
9 years ago Hi @skyhawk669 thanks for the report. Do you maybe notice any improvement in 2.11.0 ?
Closed skyhawk669 closed 8 years ago
mattab
commented
9 years ago Hi @skyhawk669 thanks for the report. Do you maybe notice any improvement in 2.11.0 ?
PatrickChen
commented
9 years ago i also seem to have this problem. in my case, the problem seems to be that, after an upgrade, the January and February archive_blob and archive_numeric aren't purging their duplicate data. i suspect it's the upgrade as that is a common thread between me, skyhawk669, and gaumondp's situations.
here's a comparison of mysql queries after running
SELECT idsite, date1, date2, period, name, COUNT(*) as count FROM piwik_archivenumeric... GROUP BY idsite, date1, date2, period, name HAVING count > 1;
i've tried upgrading (a clone of) our piwik to 2.11.1, ran all the archive and scheduled tasks, and the db is still not purging the duplicates. when doing run-scheduled-tasks, it says "Purging temporary archives: skipped" for the January and February archives.
gaumondp
commented
9 years ago As asked by Matt I repost here but I start adding something more from my previous report :
In case it could be a clue : Another thing changed in February on my server: The CLI command changed from numeric IP in "--url=" to real domain...
console core:archive --url=http://1.2.3.4/ >> piwik-console-cron.log Became: core:archive --url=http://my.website.com/ >> piwik-console-cron.log
And this was my initial post:
Piwik 2.11.b3 PHP 5.3.13 Updated from command line.
Single Piwik instance with 6 web sites, about 2.5 millions pageviews a month.
Since the update mid-January, my Reports Table has double :
CanuckNick
commented
9 years ago I'm seeing the same thing here after we updated from 2.8.3 to 2.10.0. That being said, I can't say for sure that I noticed how large the tables were before the update. I noticed this after investigating some other issues we seem to be having. We have been on 2.11.1 for 24 hours now and the tables are still quite large. I'll be more than happy to run any queries for further diagnosis.
PatrickChen
commented
9 years ago @CanuckNick and @gaumondp can you both try running this query: SELECT idsite, date1, date2, period, name, COUNT(*) as count FROM piwik_archive_numeric_2015_02 GROUP BY idsite, date1, date2, period, name HAVING count > 1;
If you see my screenshot above, I ran this query for 2014_12, 2015_01, and 2015_02, then sorted by the "Count" column. My results showed that 2014_12 and prior, the tables had at most Count's of 4, while 2015_01 and 2015_02 have Count's as high as 76 so far.
According to capedfuzz on the forum (http://forum.piwik.org/read.php?2,123852,page=1#msg-123931), this indicates that "If the result isn't an empty set and there are a lot of rows, it means there are lots of duplicate archives that aren't being deleted for some reason."
CanuckNick
commented
9 years ago Sure. My counts from November and December are considerably lower than January and February. Here are some screenshots of the highest counts. These are in the order of 2014_11, 2014_12, 2015_01, 2015_02.
gaumondp
commented
9 years ago Far from 1 :(
mattab
commented
9 years ago Thanks everyone for the reports, that's really helpful. It looks like the issue is that duplicated archives are not deleted as suggested by @diosmosis - we will fix it in the next major release.
Please write a comment if you also experience this issue and haven't commented yet!
rainyroads
commented
9 years ago I've noticed the same thing after upgrading. Table sizes have been massive over the last two months.
MariaDB [analytics]> SELECT table_name AS "Tables", round(((data_length + index_length) / 1024 / 1024), 2) "Size in MB" FROM information_schema.TABLES WHERE table_schema = "analytics" ORDER BY (data_length + index_length) DESC;
+-------------------------------+------------+
| Tables | Size in MB |
+-------------------------------+------------+
| piwik_archive_blob_2015_02 | 4133.88 |
| piwik_archive_blob_2015_01 | 2871.53 |
| piwik_archive_blob_2014_12 | 172.08 |
| piwik_archive_blob_2014_01 | 167.11 |
| piwik_archive_blob_2014_03 | 160.19 |
| piwik_archive_blob_2013_08 | 159.14 |Please excuse the huge pastes. February 2015:
+--------+------------+------------+--------+----------------------------------------------------+-------+
| idsite | date1 | date2 | period | name | count |
+--------+------------+------------+--------+----------------------------------------------------+-------+
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | bounce_count | 58 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | done | 45 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | max_actions | 58 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | nb_actions | 58 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | nb_visits | 58 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-01 | 2015-02-01 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_downloads | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_hits_with_time_generation | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_outlinks | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_pageviews | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_uniq_downloads | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_uniq_outlinks | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_nb_uniq_pageviews | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Actions_sum_time_generation | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | bounce_count | 939 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | done | 486 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | max_actions | 939 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | nb_actions | 939 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | nb_uniq_visitors | 939 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | nb_users | 137 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | nb_visits | 939 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Referrers_distinctKeywords | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Referrers_distinctSearchEngines | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Referrers_distinctWebsites | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | Referrers_distinctWebsitesUrls | 470 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | sum_visit_length | 939 |
| 1 | 2015-02-01 | 2015-02-28 | 3 | UserCountry_distinctCountries | 470 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_downloads | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_hits_with_time_generation | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_outlinks | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_pageviews | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_uniq_downloads | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_uniq_outlinks | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_nb_uniq_pageviews | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Actions_sum_time_generation | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | bounce_count | 60 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | done | 46 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | max_actions | 60 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | nb_actions | 60 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | nb_uniq_visitors | 60 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | nb_visits | 60 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Referrers_distinctCampaigns | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Referrers_distinctKeywords | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Referrers_distinctSearchEngines | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Referrers_distinctWebsites | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | Referrers_distinctWebsitesUrls | 30 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | sum_visit_length | 60 |
| 1 | 2015-02-02 | 2015-02-02 | 1 | UserCountry_distinctCountries | 30 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_downloads | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_hits_with_time_generation | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_outlinks | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_pageviews | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_uniq_downloads | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_uniq_outlinks | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_nb_uniq_pageviews | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Actions_sum_time_generation | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | bounce_count | 198 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | done | 100 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | max_actions | 198 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | nb_actions | 198 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | nb_uniq_visitors | 198 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | nb_visits | 198 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Referrers_distinctKeywords | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Referrers_distinctSearchEngines | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Referrers_distinctWebsites | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | Referrers_distinctWebsitesUrls | 99 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | sum_visit_length | 198 |
| 1 | 2015-02-02 | 2015-02-08 | 2 | UserCountry_distinctCountries | 99 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_downloads | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_hits_with_time_generation | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_outlinks | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_pageviews | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_uniq_downloads | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_uniq_outlinks | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_nb_uniq_pageviews | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Actions_sum_time_generation | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | bounce_count | 60 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | done | 48 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | max_actions | 60 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | nb_actions | 60 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | nb_uniq_visitors | 60 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | nb_visits | 60 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Referrers_distinctCampaigns | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Referrers_distinctKeywords | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Referrers_distinctSearchEngines | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Referrers_distinctWebsites | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | Referrers_distinctWebsitesUrls | 30 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | sum_visit_length | 60 |
| 1 | 2015-02-03 | 2015-02-03 | 1 | UserCountry_distinctCountries | 30 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | bounce_count | 58 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | done | 48 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | max_actions | 58 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | nb_actions | 58 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | nb_visits | 58 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-04 | 2015-02-04 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_downloads | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_hits_with_time_generation | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_outlinks | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_pageviews | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_uniq_downloads | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_uniq_outlinks | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_nb_uniq_pageviews | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Actions_sum_time_generation | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | bounce_count | 56 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | done | 45 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | max_actions | 56 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | nb_actions | 56 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | nb_uniq_visitors | 56 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | nb_visits | 56 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Referrers_distinctCampaigns | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Referrers_distinctKeywords | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Referrers_distinctSearchEngines | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Referrers_distinctWebsites | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | Referrers_distinctWebsitesUrls | 28 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | sum_visit_length | 56 |
| 1 | 2015-02-05 | 2015-02-05 | 1 | UserCountry_distinctCountries | 28 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | bounce_count | 58 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | done | 45 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | max_actions | 58 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | nb_actions | 58 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | nb_visits | 58 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-06 | 2015-02-06 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | bounce_count | 58 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | done | 47 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | max_actions | 58 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | nb_actions | 58 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | nb_visits | 58 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-07 | 2015-02-07 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | bounce_count | 58 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | done | 47 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | max_actions | 58 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | nb_actions | 58 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | nb_visits | 58 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-08 | 2015-02-08 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | bounce_count | 58 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | done | 47 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | max_actions | 58 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | nb_actions | 58 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | nb_visits | 58 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-09 | 2015-02-09 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_downloads | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_hits_with_time_generation | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_outlinks | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_pageviews | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_uniq_downloads | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_uniq_outlinks | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_nb_uniq_pageviews | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Actions_sum_time_generation | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | bounce_count | 196 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | done | 99 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | max_actions | 196 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | nb_actions | 196 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | nb_uniq_visitors | 196 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | nb_visits | 196 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Referrers_distinctKeywords | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Referrers_distinctSearchEngines | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Referrers_distinctWebsites | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | Referrers_distinctWebsitesUrls | 98 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | sum_visit_length | 196 |
| 1 | 2015-02-09 | 2015-02-15 | 2 | UserCountry_distinctCountries | 98 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_downloads | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_hits_with_time_generation | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_outlinks | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_pageviews | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_uniq_downloads | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_uniq_outlinks | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_nb_uniq_pageviews | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Actions_sum_time_generation | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | bounce_count | 56 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | done | 46 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | max_actions | 56 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | nb_actions | 56 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | nb_uniq_visitors | 56 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | nb_visits | 56 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Referrers_distinctCampaigns | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Referrers_distinctKeywords | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Referrers_distinctSearchEngines | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Referrers_distinctWebsites | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | Referrers_distinctWebsitesUrls | 28 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | sum_visit_length | 56 |
| 1 | 2015-02-10 | 2015-02-10 | 1 | UserCountry_distinctCountries | 28 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | bounce_count | 58 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | done | 46 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | max_actions | 58 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | nb_actions | 58 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | nb_visits | 58 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-11 | 2015-02-11 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_downloads | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_hits_with_time_generation | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_outlinks | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_pageviews | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_uniq_downloads | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_uniq_outlinks | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_nb_uniq_pageviews | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Actions_sum_time_generation | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | bounce_count | 62 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | done | 48 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | max_actions | 62 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | nb_actions | 62 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | nb_uniq_visitors | 62 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | nb_visits | 62 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Referrers_distinctCampaigns | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Referrers_distinctKeywords | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Referrers_distinctSearchEngines | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Referrers_distinctWebsites | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | Referrers_distinctWebsitesUrls | 31 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | sum_visit_length | 62 |
| 1 | 2015-02-12 | 2015-02-12 | 1 | UserCountry_distinctCountries | 31 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | bounce_count | 58 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | done | 48 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | max_actions | 58 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | nb_actions | 58 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | nb_visits | 58 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-13 | 2015-02-13 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | bounce_count | 58 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | done | 47 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | max_actions | 58 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | nb_actions | 58 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | nb_visits | 58 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-14 | 2015-02-14 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_downloads | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_hits_with_time_generation | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_outlinks | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_pageviews | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_uniq_downloads | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_uniq_outlinks | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_nb_uniq_pageviews | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Actions_sum_time_generation | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | bounce_count | 60 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | done | 47 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | max_actions | 60 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | nb_actions | 60 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | nb_uniq_visitors | 60 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | nb_visits | 60 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Referrers_distinctCampaigns | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Referrers_distinctKeywords | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Referrers_distinctSearchEngines | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Referrers_distinctWebsites | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | Referrers_distinctWebsitesUrls | 30 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | sum_visit_length | 60 |
| 1 | 2015-02-15 | 2015-02-15 | 1 | UserCountry_distinctCountries | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_downloads | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_hits_with_time_generation | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_outlinks | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_pageviews | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_uniq_downloads | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_uniq_outlinks | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_nb_uniq_pageviews | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Actions_sum_time_generation | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | bounce_count | 59 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | done | 47 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | max_actions | 59 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | nb_actions | 59 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | nb_uniq_visitors | 59 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | nb_visits | 59 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Referrers_distinctCampaigns | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Referrers_distinctKeywords | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Referrers_distinctSearchEngines | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Referrers_distinctWebsites | 30 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | sum_visit_length | 59 |
| 1 | 2015-02-16 | 2015-02-16 | 1 | UserCountry_distinctCountries | 30 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_downloads | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_hits_with_time_generation | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_outlinks | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_pageviews | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_uniq_downloads | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_uniq_outlinks | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_nb_uniq_pageviews | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Actions_sum_time_generation | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | bounce_count | 201 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | done | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | max_actions | 201 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | nb_actions | 201 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | nb_uniq_visitors | 201 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | nb_users | 30 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | nb_visits | 201 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Referrers_distinctKeywords | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Referrers_distinctSearchEngines | 101 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Referrers_distinctWebsites | 100 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | Referrers_distinctWebsitesUrls | 100 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | sum_visit_length | 201 |
| 1 | 2015-02-16 | 2015-02-22 | 2 | UserCountry_distinctCountries | 101 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | bounce_count | 58 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | done | 47 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | max_actions | 58 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | nb_actions | 58 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | nb_visits | 58 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-17 | 2015-02-17 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_downloads | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_hits_with_time_generation | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_outlinks | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_pageviews | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_uniq_downloads | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_uniq_outlinks | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_nb_uniq_pageviews | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Actions_sum_time_generation | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | bounce_count | 60 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | done | 47 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | max_actions | 60 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | nb_actions | 60 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | nb_uniq_visitors | 60 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | nb_visits | 60 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Referrers_distinctCampaigns | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Referrers_distinctKeywords | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Referrers_distinctSearchEngines | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Referrers_distinctWebsites | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | Referrers_distinctWebsitesUrls | 30 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | sum_visit_length | 60 |
| 1 | 2015-02-18 | 2015-02-18 | 1 | UserCountry_distinctCountries | 30 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_downloads | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_hits_with_time_generation | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_outlinks | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_pageviews | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_uniq_downloads | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_uniq_outlinks | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_nb_uniq_pageviews | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Actions_sum_time_generation | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | bounce_count | 56 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | done | 46 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | max_actions | 56 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | nb_actions | 56 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | nb_uniq_visitors | 56 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | nb_visits | 56 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Referrers_distinctCampaigns | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Referrers_distinctKeywords | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Referrers_distinctSearchEngines | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Referrers_distinctWebsites | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | Referrers_distinctWebsitesUrls | 28 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | sum_visit_length | 56 |
| 1 | 2015-02-19 | 2015-02-19 | 1 | UserCountry_distinctCountries | 28 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | bounce_count | 58 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | done | 46 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | max_actions | 58 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | nb_actions | 58 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | nb_visits | 58 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-20 | 2015-02-20 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_downloads | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_hits_with_time_generation | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_outlinks | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_pageviews | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_uniq_downloads | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_uniq_outlinks | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_nb_uniq_pageviews | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Actions_sum_time_generation | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | bounce_count | 58 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | done | 47 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | max_actions | 58 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | nb_actions | 58 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | nb_uniq_visitors | 58 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | nb_visits | 58 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Referrers_distinctCampaigns | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Referrers_distinctKeywords | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Referrers_distinctSearchEngines | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Referrers_distinctWebsites | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | Referrers_distinctWebsitesUrls | 29 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | sum_visit_length | 58 |
| 1 | 2015-02-21 | 2015-02-21 | 1 | UserCountry_distinctCountries | 29 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_downloads | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_hits_with_time_generation | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_outlinks | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_pageviews | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_uniq_downloads | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_uniq_outlinks | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_nb_uniq_pageviews | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Actions_sum_time_generation | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | bounce_count | 82 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | done | 58 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | max_actions | 82 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | nb_actions | 82 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | nb_uniq_visitors | 82 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | nb_users | 76 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | nb_visits | 82 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Referrers_distinctCampaigns | 24 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Referrers_distinctKeywords | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Referrers_distinctSearchEngines | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Referrers_distinctWebsites | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | Referrers_distinctWebsitesUrls | 41 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | sum_visit_length | 82 |
| 1 | 2015-02-22 | 2015-02-22 | 1 | UserCountry_distinctCountries | 41 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_downloads | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_hits_with_time_generation | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_outlinks | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_pageviews | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_uniq_downloads | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_uniq_outlinks | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_nb_uniq_pageviews | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Actions_sum_time_generation | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | bounce_count | 62 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | done | 48 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | max_actions | 62 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | nb_actions | 62 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | nb_uniq_visitors | 62 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | nb_visits | 62 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Referrers_distinctKeywords | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Referrers_distinctSearchEngines | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Referrers_distinctWebsites | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | Referrers_distinctWebsitesUrls | 31 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | sum_visit_length | 62 |
| 1 | 2015-02-23 | 2015-02-23 | 1 | UserCountry_distinctCountries | 31 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_downloads | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_hits_with_time_generation | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_outlinks | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_pageviews | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_uniq_downloads | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_uniq_outlinks | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_nb_uniq_pageviews | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Actions_sum_time_generation | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | bounce_count | 72 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | done | 38 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | max_actions | 72 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | nb_actions | 72 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | nb_uniq_visitors | 72 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | nb_users | 22 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | nb_visits | 72 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Referrers_distinctKeywords | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Referrers_distinctSearchEngines | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Referrers_distinctWebsites | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | Referrers_distinctWebsitesUrls | 36 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | sum_visit_length | 72 |
| 1 | 2015-02-23 | 2015-03-01 | 2 | UserCountry_distinctCountries | 36 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_downloads | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_hits_with_time_generation | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_outlinks | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_pageviews | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_uniq_downloads | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_uniq_outlinks | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_nb_uniq_pageviews | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Actions_sum_time_generation | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | bounce_count | 60 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | done | 49 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | max_actions | 60 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | nb_actions | 60 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | nb_uniq_visitors | 60 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | nb_users | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | nb_visits | 60 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Referrers_distinctKeywords | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Referrers_distinctSearchEngines | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Referrers_distinctWebsites | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | Referrers_distinctWebsitesUrls | 30 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | sum_visit_length | 60 |
| 1 | 2015-02-24 | 2015-02-24 | 1 | UserCountry_distinctCountries | 30 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_downloads | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_hits_with_time_generation | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_outlinks | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_pageviews | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_uniq_downloads | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_uniq_outlinks | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_nb_uniq_pageviews | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Actions_sum_time_generation | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | bounce_count | 18 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | done | 26 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | max_actions | 18 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | nb_actions | 18 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | nb_uniq_visitors | 18 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | nb_visits | 18 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Referrers_distinctKeywords | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Referrers_distinctSearchEngines | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Referrers_distinctWebsites | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | Referrers_distinctWebsitesUrls | 9 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | sum_visit_length | 18 |
| 1 | 2015-02-25 | 2015-02-25 | 1 | UserCountry_distinctCountries | 9 |
| 1 | 2015-02-26 | 2015-02-26 | 1 | done | 17 |
| 1 | 2015-02-27 | 2015-02-27 | 1 | done | 4 |
+--------+------------+------------+--------+----------------------------------------------------+-------+December 2014:
MariaDB [analytics]> SELECT idsite, date1, date2, period, name, COUNT(*) as count FROM piwik_archive_numeric_2014_12 GROUP BY idsite, date1, date2, period, name HAVING count > 1;
+--------+------------+------------+--------+------------------+-------+
| idsite | date1 | date2 | period | name | count |
+--------+------------+------------+--------+------------------+-------+
| 1 | 2014-12-01 | 2014-12-01 | 1 | bounce_count | 2 |
| 1 | 2014-12-01 | 2014-12-01 | 1 | max_actions | 2 |
| 1 | 2014-12-01 | 2014-12-01 | 1 | nb_actions | 2 |
| 1 | 2014-12-01 | 2014-12-01 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-01 | 2014-12-01 | 1 | nb_visits | 2 |
| 1 | 2014-12-01 | 2014-12-01 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-01 | 2014-12-07 | 2 | bounce_count | 2 |
| 1 | 2014-12-01 | 2014-12-07 | 2 | max_actions | 2 |
| 1 | 2014-12-01 | 2014-12-07 | 2 | nb_actions | 2 |
| 1 | 2014-12-01 | 2014-12-07 | 2 | nb_uniq_visitors | 2 |
| 1 | 2014-12-01 | 2014-12-07 | 2 | nb_visits | 2 |
| 1 | 2014-12-01 | 2014-12-07 | 2 | sum_visit_length | 2 |
| 1 | 2014-12-01 | 2014-12-31 | 3 | bounce_count | 2 |
| 1 | 2014-12-01 | 2014-12-31 | 3 | max_actions | 2 |
| 1 | 2014-12-01 | 2014-12-31 | 3 | nb_actions | 2 |
| 1 | 2014-12-01 | 2014-12-31 | 3 | nb_uniq_visitors | 2 |
| 1 | 2014-12-01 | 2014-12-31 | 3 | nb_visits | 2 |
| 1 | 2014-12-01 | 2014-12-31 | 3 | sum_visit_length | 2 |
| 1 | 2014-12-02 | 2014-12-02 | 1 | bounce_count | 2 |
| 1 | 2014-12-02 | 2014-12-02 | 1 | max_actions | 2 |
| 1 | 2014-12-02 | 2014-12-02 | 1 | nb_actions | 2 |
| 1 | 2014-12-02 | 2014-12-02 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-02 | 2014-12-02 | 1 | nb_visits | 2 |
| 1 | 2014-12-02 | 2014-12-02 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-03 | 2014-12-03 | 1 | bounce_count | 2 |
| 1 | 2014-12-03 | 2014-12-03 | 1 | max_actions | 2 |
| 1 | 2014-12-03 | 2014-12-03 | 1 | nb_actions | 2 |
| 1 | 2014-12-03 | 2014-12-03 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-03 | 2014-12-03 | 1 | nb_visits | 2 |
| 1 | 2014-12-03 | 2014-12-03 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-04 | 2014-12-04 | 1 | bounce_count | 2 |
| 1 | 2014-12-04 | 2014-12-04 | 1 | max_actions | 2 |
| 1 | 2014-12-04 | 2014-12-04 | 1 | nb_actions | 2 |
| 1 | 2014-12-04 | 2014-12-04 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-04 | 2014-12-04 | 1 | nb_visits | 2 |
| 1 | 2014-12-04 | 2014-12-04 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-05 | 2014-12-05 | 1 | bounce_count | 2 |
| 1 | 2014-12-05 | 2014-12-05 | 1 | max_actions | 2 |
| 1 | 2014-12-05 | 2014-12-05 | 1 | nb_actions | 2 |
| 1 | 2014-12-05 | 2014-12-05 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-05 | 2014-12-05 | 1 | nb_visits | 2 |
| 1 | 2014-12-05 | 2014-12-05 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-06 | 2014-12-06 | 1 | bounce_count | 2 |
| 1 | 2014-12-06 | 2014-12-06 | 1 | max_actions | 2 |
| 1 | 2014-12-06 | 2014-12-06 | 1 | nb_actions | 2 |
| 1 | 2014-12-06 | 2014-12-06 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-06 | 2014-12-06 | 1 | nb_visits | 2 |
| 1 | 2014-12-06 | 2014-12-06 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-07 | 2014-12-07 | 1 | bounce_count | 2 |
| 1 | 2014-12-07 | 2014-12-07 | 1 | max_actions | 2 |
| 1 | 2014-12-07 | 2014-12-07 | 1 | nb_actions | 2 |
| 1 | 2014-12-07 | 2014-12-07 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-07 | 2014-12-07 | 1 | nb_visits | 2 |
| 1 | 2014-12-07 | 2014-12-07 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-08 | 2014-12-08 | 1 | bounce_count | 2 |
| 1 | 2014-12-08 | 2014-12-08 | 1 | max_actions | 2 |
| 1 | 2014-12-08 | 2014-12-08 | 1 | nb_actions | 2 |
| 1 | 2014-12-08 | 2014-12-08 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-08 | 2014-12-08 | 1 | nb_visits | 2 |
| 1 | 2014-12-08 | 2014-12-08 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-08 | 2014-12-14 | 2 | bounce_count | 2 |
| 1 | 2014-12-08 | 2014-12-14 | 2 | max_actions | 2 |
| 1 | 2014-12-08 | 2014-12-14 | 2 | nb_actions | 2 |
| 1 | 2014-12-08 | 2014-12-14 | 2 | nb_uniq_visitors | 2 |
| 1 | 2014-12-08 | 2014-12-14 | 2 | nb_visits | 2 |
| 1 | 2014-12-08 | 2014-12-14 | 2 | sum_visit_length | 2 |
| 1 | 2014-12-09 | 2014-12-09 | 1 | bounce_count | 2 |
| 1 | 2014-12-09 | 2014-12-09 | 1 | max_actions | 2 |
| 1 | 2014-12-09 | 2014-12-09 | 1 | nb_actions | 2 |
| 1 | 2014-12-09 | 2014-12-09 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-09 | 2014-12-09 | 1 | nb_visits | 2 |
| 1 | 2014-12-09 | 2014-12-09 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-10 | 2014-12-10 | 1 | bounce_count | 2 |
| 1 | 2014-12-10 | 2014-12-10 | 1 | max_actions | 2 |
| 1 | 2014-12-10 | 2014-12-10 | 1 | nb_actions | 2 |
| 1 | 2014-12-10 | 2014-12-10 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-10 | 2014-12-10 | 1 | nb_visits | 2 |
| 1 | 2014-12-10 | 2014-12-10 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-11 | 2014-12-11 | 1 | bounce_count | 2 |
| 1 | 2014-12-11 | 2014-12-11 | 1 | max_actions | 2 |
| 1 | 2014-12-11 | 2014-12-11 | 1 | nb_actions | 2 |
| 1 | 2014-12-11 | 2014-12-11 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-11 | 2014-12-11 | 1 | nb_visits | 2 |
| 1 | 2014-12-11 | 2014-12-11 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-12 | 2014-12-12 | 1 | bounce_count | 2 |
| 1 | 2014-12-12 | 2014-12-12 | 1 | max_actions | 2 |
| 1 | 2014-12-12 | 2014-12-12 | 1 | nb_actions | 2 |
| 1 | 2014-12-12 | 2014-12-12 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-12 | 2014-12-12 | 1 | nb_visits | 2 |
| 1 | 2014-12-12 | 2014-12-12 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-13 | 2014-12-13 | 1 | bounce_count | 2 |
| 1 | 2014-12-13 | 2014-12-13 | 1 | max_actions | 2 |
| 1 | 2014-12-13 | 2014-12-13 | 1 | nb_actions | 2 |
| 1 | 2014-12-13 | 2014-12-13 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-13 | 2014-12-13 | 1 | nb_visits | 2 |
| 1 | 2014-12-13 | 2014-12-13 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-14 | 2014-12-14 | 1 | bounce_count | 2 |
| 1 | 2014-12-14 | 2014-12-14 | 1 | max_actions | 2 |
| 1 | 2014-12-14 | 2014-12-14 | 1 | nb_actions | 2 |
| 1 | 2014-12-14 | 2014-12-14 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-14 | 2014-12-14 | 1 | nb_visits | 2 |
| 1 | 2014-12-14 | 2014-12-14 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-15 | 2014-12-15 | 1 | bounce_count | 2 |
| 1 | 2014-12-15 | 2014-12-15 | 1 | max_actions | 2 |
| 1 | 2014-12-15 | 2014-12-15 | 1 | nb_actions | 2 |
| 1 | 2014-12-15 | 2014-12-15 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-15 | 2014-12-15 | 1 | nb_visits | 2 |
| 1 | 2014-12-15 | 2014-12-15 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-15 | 2014-12-21 | 2 | bounce_count | 2 |
| 1 | 2014-12-15 | 2014-12-21 | 2 | max_actions | 2 |
| 1 | 2014-12-15 | 2014-12-21 | 2 | nb_actions | 2 |
| 1 | 2014-12-15 | 2014-12-21 | 2 | nb_uniq_visitors | 2 |
| 1 | 2014-12-15 | 2014-12-21 | 2 | nb_visits | 2 |
| 1 | 2014-12-15 | 2014-12-21 | 2 | sum_visit_length | 2 |
| 1 | 2014-12-16 | 2014-12-16 | 1 | bounce_count | 2 |
| 1 | 2014-12-16 | 2014-12-16 | 1 | max_actions | 2 |
| 1 | 2014-12-16 | 2014-12-16 | 1 | nb_actions | 2 |
| 1 | 2014-12-16 | 2014-12-16 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-16 | 2014-12-16 | 1 | nb_visits | 2 |
| 1 | 2014-12-16 | 2014-12-16 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-17 | 2014-12-17 | 1 | bounce_count | 2 |
| 1 | 2014-12-17 | 2014-12-17 | 1 | max_actions | 2 |
| 1 | 2014-12-17 | 2014-12-17 | 1 | nb_actions | 2 |
| 1 | 2014-12-17 | 2014-12-17 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-17 | 2014-12-17 | 1 | nb_visits | 2 |
| 1 | 2014-12-17 | 2014-12-17 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-18 | 2014-12-18 | 1 | bounce_count | 2 |
| 1 | 2014-12-18 | 2014-12-18 | 1 | max_actions | 2 |
| 1 | 2014-12-18 | 2014-12-18 | 1 | nb_actions | 2 |
| 1 | 2014-12-18 | 2014-12-18 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-18 | 2014-12-18 | 1 | nb_visits | 2 |
| 1 | 2014-12-18 | 2014-12-18 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-19 | 2014-12-19 | 1 | bounce_count | 2 |
| 1 | 2014-12-19 | 2014-12-19 | 1 | max_actions | 2 |
| 1 | 2014-12-19 | 2014-12-19 | 1 | nb_actions | 2 |
| 1 | 2014-12-19 | 2014-12-19 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-19 | 2014-12-19 | 1 | nb_visits | 2 |
| 1 | 2014-12-19 | 2014-12-19 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-20 | 2014-12-20 | 1 | bounce_count | 2 |
| 1 | 2014-12-20 | 2014-12-20 | 1 | max_actions | 2 |
| 1 | 2014-12-20 | 2014-12-20 | 1 | nb_actions | 2 |
| 1 | 2014-12-20 | 2014-12-20 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-20 | 2014-12-20 | 1 | nb_visits | 2 |
| 1 | 2014-12-20 | 2014-12-20 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-21 | 2014-12-21 | 1 | bounce_count | 2 |
| 1 | 2014-12-21 | 2014-12-21 | 1 | max_actions | 2 |
| 1 | 2014-12-21 | 2014-12-21 | 1 | nb_actions | 2 |
| 1 | 2014-12-21 | 2014-12-21 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-21 | 2014-12-21 | 1 | nb_visits | 2 |
| 1 | 2014-12-21 | 2014-12-21 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-22 | 2014-12-22 | 1 | bounce_count | 2 |
| 1 | 2014-12-22 | 2014-12-22 | 1 | max_actions | 2 |
| 1 | 2014-12-22 | 2014-12-22 | 1 | nb_actions | 2 |
| 1 | 2014-12-22 | 2014-12-22 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-22 | 2014-12-22 | 1 | nb_visits | 2 |
| 1 | 2014-12-22 | 2014-12-22 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-22 | 2014-12-28 | 2 | bounce_count | 2 |
| 1 | 2014-12-22 | 2014-12-28 | 2 | max_actions | 2 |
| 1 | 2014-12-22 | 2014-12-28 | 2 | nb_actions | 2 |
| 1 | 2014-12-22 | 2014-12-28 | 2 | nb_uniq_visitors | 2 |
| 1 | 2014-12-22 | 2014-12-28 | 2 | nb_visits | 2 |
| 1 | 2014-12-22 | 2014-12-28 | 2 | sum_visit_length | 2 |
| 1 | 2014-12-23 | 2014-12-23 | 1 | bounce_count | 2 |
| 1 | 2014-12-23 | 2014-12-23 | 1 | max_actions | 2 |
| 1 | 2014-12-23 | 2014-12-23 | 1 | nb_actions | 2 |
| 1 | 2014-12-23 | 2014-12-23 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-23 | 2014-12-23 | 1 | nb_visits | 2 |
| 1 | 2014-12-23 | 2014-12-23 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-24 | 2014-12-24 | 1 | bounce_count | 2 |
| 1 | 2014-12-24 | 2014-12-24 | 1 | max_actions | 2 |
| 1 | 2014-12-24 | 2014-12-24 | 1 | nb_actions | 2 |
| 1 | 2014-12-24 | 2014-12-24 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-24 | 2014-12-24 | 1 | nb_visits | 2 |
| 1 | 2014-12-24 | 2014-12-24 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-25 | 2014-12-25 | 1 | bounce_count | 2 |
| 1 | 2014-12-25 | 2014-12-25 | 1 | max_actions | 2 |
| 1 | 2014-12-25 | 2014-12-25 | 1 | nb_actions | 2 |
| 1 | 2014-12-25 | 2014-12-25 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-25 | 2014-12-25 | 1 | nb_visits | 2 |
| 1 | 2014-12-25 | 2014-12-25 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-26 | 2014-12-26 | 1 | bounce_count | 2 |
| 1 | 2014-12-26 | 2014-12-26 | 1 | max_actions | 2 |
| 1 | 2014-12-26 | 2014-12-26 | 1 | nb_actions | 2 |
| 1 | 2014-12-26 | 2014-12-26 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-26 | 2014-12-26 | 1 | nb_visits | 2 |
| 1 | 2014-12-26 | 2014-12-26 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-27 | 2014-12-27 | 1 | bounce_count | 2 |
| 1 | 2014-12-27 | 2014-12-27 | 1 | max_actions | 2 |
| 1 | 2014-12-27 | 2014-12-27 | 1 | nb_actions | 2 |
| 1 | 2014-12-27 | 2014-12-27 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-27 | 2014-12-27 | 1 | nb_visits | 2 |
| 1 | 2014-12-27 | 2014-12-27 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-28 | 2014-12-28 | 1 | bounce_count | 2 |
| 1 | 2014-12-28 | 2014-12-28 | 1 | max_actions | 2 |
| 1 | 2014-12-28 | 2014-12-28 | 1 | nb_actions | 2 |
| 1 | 2014-12-28 | 2014-12-28 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-28 | 2014-12-28 | 1 | nb_visits | 2 |
| 1 | 2014-12-28 | 2014-12-28 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-29 | 2014-12-29 | 1 | bounce_count | 2 |
| 1 | 2014-12-29 | 2014-12-29 | 1 | max_actions | 2 |
| 1 | 2014-12-29 | 2014-12-29 | 1 | nb_actions | 2 |
| 1 | 2014-12-29 | 2014-12-29 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-29 | 2014-12-29 | 1 | nb_visits | 2 |
| 1 | 2014-12-29 | 2014-12-29 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-29 | 2015-01-04 | 2 | bounce_count | 2 |
| 1 | 2014-12-29 | 2015-01-04 | 2 | max_actions | 2 |
| 1 | 2014-12-29 | 2015-01-04 | 2 | nb_actions | 2 |
| 1 | 2014-12-29 | 2015-01-04 | 2 | nb_uniq_visitors | 2 |
| 1 | 2014-12-29 | 2015-01-04 | 2 | nb_visits | 2 |
| 1 | 2014-12-29 | 2015-01-04 | 2 | sum_visit_length | 2 |
| 1 | 2014-12-30 | 2014-12-30 | 1 | bounce_count | 2 |
| 1 | 2014-12-30 | 2014-12-30 | 1 | max_actions | 2 |
| 1 | 2014-12-30 | 2014-12-30 | 1 | nb_actions | 2 |
| 1 | 2014-12-30 | 2014-12-30 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-30 | 2014-12-30 | 1 | nb_visits | 2 |
| 1 | 2014-12-30 | 2014-12-30 | 1 | sum_visit_length | 2 |
| 1 | 2014-12-31 | 2014-12-31 | 1 | bounce_count | 2 |
| 1 | 2014-12-31 | 2014-12-31 | 1 | max_actions | 2 |
| 1 | 2014-12-31 | 2014-12-31 | 1 | nb_actions | 2 |
| 1 | 2014-12-31 | 2014-12-31 | 1 | nb_uniq_visitors | 2 |
| 1 | 2014-12-31 | 2014-12-31 | 1 | nb_visits | 2 |
| 1 | 2014-12-31 | 2014-12-31 | 1 | sum_visit_length | 2 |
+--------+------------+------------+--------+------------------+-------+
diosmosis
commented
9 years ago Could someone experiencing this problem run the following query on a bloated numeric table:
SELECT idarchive, name, value, period, date1, date2, ts_archived FROM piwik_archive_numeric_2015_01 where name like 'done%' and value <> 1;? Thanks!
If the results are too large to copy-paste, feel free to email them to hello@piwik.org.
diosmosis
commented
9 years ago Also, if anyone wants to see a better output message than "Purging temporary archives: skipped", you can replace the core/ArchiveProcessor/Rules.php file with this: https://raw.githubusercontent.com/piwik/piwik/master/core/ArchiveProcessor/Rules.php and run the core:run-scheduled-tasks --force command.
Please post the message you see here, it may help us fix the issue.
CanuckNick
commented
9 years ago @diosmosis - I just sent an email with a couple result exports from my tables. Hopefully that will help.
I will see if I can update and run the change to Rules.php in our test environment and get back to you.
CanuckNick
commented
9 years ago Just ran core:run-scheduled-tasks --force with the updated Rules.php file. This is the updated message:
Purging temporary archives: skipped (no authorization)
skyhawk669
commented
9 years ago @diosmosis - here's the results of the query you requested:
For 2015-01:
For 2015-02:
skyhawk669
commented
9 years ago @diosmosis, I have run the job with the modified Rules file and I get the same messages as @CanuckNick for each skipped line: " Purging temporary archives: skipped (no authorization) "
PatrickChen
commented
9 years ago @diosmosis I also got "Purging temporary archives: skipped (no authorization)" for all archives including the newest 2015 Jan, Feb, Mar archives
diosmosis
commented
9 years ago If you run the core:archive command and see if you get the same message when the scheduled task is run? You may have to wait for the 6 hours between purgings to pass to get useful output. Also if you've got cron archiving setup you could just check the cron job output.
CanuckNick
commented
9 years ago I believe the cron is running on a regular basis in our testing environment still so I will check the output tomorrow morning (EST) and get back to you.
CanuckNick
commented
9 years ago Just checked the logs, this is what shows up this morning:
Purging temporary archives: skipped (purging every 6hours)
diosmosis
commented
9 years ago @CanuckNick is your cron archiving job set to run hourly? If so, one of the runs will have a message unlike "purging every 6hours". Can you find the most recent message like this?
Apologies for the seemingly unending back and forth, this is one of the neglected parts of Piwik (intersecting with another neglected part), and it shows.
CanuckNick
commented
9 years ago @diosmosis - Yes, the cron is running every hour. Just a reminder that I'm using our test instance for this so there is no new data being added to Piwik but I don't think that would make a difference for what we're trying to do here (but maybe I'm wrong?). The test instance does have the bloated tables as well. I only enabled logging in Piwik in this instance yesterday morning (tmp/logs/piwik.log) and the only entries in that file is from 1 AM UTC when the daily scheduled tasks ran.
mattab
commented
9 years ago Fixing this is a bit more complicated than we thought so we will fix it for the next major release 2.12.0 instead (due in about 2 weeks)
diosmosis
commented
9 years ago @CanuckNick Can you try to do the following?
UPDATE piwik_option SET option_value='a:1:{s:55:"Piwik\\Plugins\\CoreAdminHome\\Tasks.purgeOutdatedArchives";i:0;}' WHERE option_name = 'TaskScheduler.timetable';. This will force the purgeOutdatedArchives task to run next scheduled tasks run.DELETE FROM piwik_option WHERE option_name LIKE 'lastPurge_%';. This will make sure purging doesn't get delayed for 6 hours../console core:archive --url=... and check the output.Also, would it be possible for me to access and debug the test instance directly? If it's possible (and desired), can you send temporary access credentials to hello@piwik.org?
CanuckNick
commented
9 years ago @diosmosis - I have completed 1-3. I will check back in the morning for step 4 and report back. Below is the relevant (and I believe expected) output from running these commands. I did save a copy of the previous value of TaskScheduler.timetable and the lastPurge_% results if that's of any value to you.
Unfortunately my installations are behind a firewall so I am unable to provide you with access. Maybe someone else that is experiencing this issue is able to. That being said, if you want to reach out directly and get me to try/check a few more things for you please feel free to email me directly (I think you should have my email address from the email I sent to hello@piwik.org yesterday - if not I can send you another email).
INFO CoreConsole[2015-03-03 23:44:53] ---------------------------
INFO CoreConsole[2015-03-03 23:44:53] SCHEDULED TASKS
INFO CoreConsole[2015-03-03 23:44:53] Starting Scheduled tasks...
INFO CoreConsole[2015-03-03 23:44:54] task,output
Piwik\Plugins\CoreAdminHome\Tasks.purgeOutdatedArchives,Time elapsed: 0.430s
INFO CoreConsole[2015-03-03 23:44:54] done
INFO CoreConsole[2015-03-03 23:44:54] ---------------------------
INFO CoreAdminHome[2015-03-03 23:44:54] Purging temporary archives: skipped (purging every 6hours)@diosmosis I followed the same instructions and got the same result as CanuckNick "task,output Piwik\Plugins\CoreAdminHome\Tasks.purgeOutdatedArchives,Time elapsed: 27.016s"
There was also no effect on the db size
diosmosis
commented
9 years ago @CanuckNick @PatrickChen Thanks for the info, after thinking about it, I think I know where the problem lies. I should have a makeshift solution for you to try soon, but I doubt a proper solution will be available until 2.12.0.
Note: @CanuckNick I have your email address, and may be in touch for further help sorting this issue out.
mattab
commented
9 years ago There was also no effect on the db size
@PatrickChen are your piwik tables in Myiasm or Innodb? If they are myiasam, you may need to run OPTIMIZE TABLE archive_blob_xxx to see the data being freed. If that's the case, could you confirm whether an OPTIMIZE TABLE frees up the data after the task "Tasks.purgeOutdatedArchives` was executed?
mattab
commented
9 years ago Just ran core:run-scheduled-tasks --force with the updated Rules.php file. This is the updated message: Purging temporary archives: skipped (no authorization)
Forcing the scheduled task should force the tasks, here the task wasn't forced. I created separate issue for that: #7351
PatrickChen
commented
9 years ago @mattab my piwik tables are Innodb. either way, I ran the OPTIMIZE TABLE piwik_archive_blob_2015_01; and it seems to have cleared up that table, reducing it from 5Gb to 300Mb (this is on the test instance where i had already run @diosmosis 's 4 step instructions above). After running the Optimize Table on 2015_01, I ran *SELECT idsite, date1, date2, period, name, COUNT() as count FROM piwik_archive_blob_2015_01 GROUP BY idsite, date1, date2, period, name HAVING count > 1;** again. Prior to Optimize I believe the highest Count's were in the 40's, now the highest Count is 7.
diosmosis
commented
9 years ago Until 2.12 comes out, I've created a makeshift solution for users experiencing this issue. I've created a new console command here: https://gist.githubusercontent.com/diosmosis/a6b9cc61ff08bbe9bab5/raw/e408cf7c6c495ea4da4b8a43b17681614264f450/PurgeOldArchiveData.php. The command requires using 2.11.2.
Download and copy the file to plugins/CoreAdminHome/Commands and run it like ./console core:purge-old-archive-data 2015-03-01 2015-02-01 2015-01-01 to purge all old + invalidated data from your archive tables. Note: if you don't supply a date, it will purge from the most recent archive table, and if you use all, it will purge from all existing tables. Also, you may have to clear any PHP caches used for the command to become available.
If you plan on using it on a production instance w/ old tables, it would be a good idea to make sure your data is backed up, just in case something else goes wrong.
This command will only purge the tables once, which means until 2.12 comes out the tables may still grow. In the mean time, you could setup a cron job to run /path/to/console core:purge-old-archive-data daily or weekly to keep your most recent archive tables small.
If you do notice your tables continuing to grow, please check your core:archive cron job output for scheduled task logs, as there may be multiple bugs causing this problem. And if anyone is able to give us access to an instance experiencing the issue, that would also be very helpful.
mattab
commented
9 years ago Hi everyone,
we have merged the pull request that deals with this issue. Although because we were not able to quite reproduce it, we need your help to confirm that the new code fixes the issue.
Can you please upgrade to 2.12.0-b3 and check if after 24 or 48 hours you find that the data is purged?
if it's not purged yet you can manually purge it using the new command ./console core:purge-old-archive-data - after purging it, wait 1 or 2 days, and if you see that the data is still growing then the bug may not be fixed completely.
either way (whether it's fixed or not) please comment so we can know! Thanks
GreenReaper
commented
9 years ago I'm getting read spikes every two or three hours that weren't there before (2.11):
diosmosis
commented
9 years ago @GreenReaper Can you provide more detailed information? Such as which tables are being read from and what the queries were?
mattab
commented
9 years ago Hi guys,
It would be great if one or more of you could confirm whether the bug is now fixed in the latest beta version. BTW this beta version is very stable and has no known issue, so I can say it's fit for your production environment to test :+1: thanks in advance for letting us know....
rainyroads
commented
9 years ago No luck on my end, using the latest beta release. https://gist.github.com/FujiMakoto/5ff50cc23e80c498d7af
diosmosis
commented
9 years ago @FujiMakoto Do you remember what the size of the 2015_03 table was before you ran the command?
rainyroads
commented
9 years ago @diosmosis I do not, I forgot to check before running the purge task, sorry. However, interestingly, I've noticed the 2015_01 table seems to have doubled in size since my comment 20 days ago,
MariaDB [analytics]> SELECT table_name AS "Tables", round(((data_length + index_length) / 1024 / 1024), 2) "Size in MB" FROM information_schema.TABLES WHERE table_schema = "analytics" ORDER BY (data_length + index_length) DESC;
+-------------------------------+------------+
| Tables | Size in MB |
+-------------------------------+------------+
| piwik_archive_blob_2015_02 | 4133.88 |
| piwik_archive_blob_2015_01 | 2871.53 |
| piwik_archive_blob_2014_12 | 172.08 |
| piwik_archive_blob_2014_01 | 167.11 |
| piwik_archive_blob_2014_03 | 160.19 |
| piwik_archive_blob_2013_08 | 159.14 |Could you run ./console core:purge-old-archive-data 2015-02-01 and see if it has any effect?
However, interestingly, the 2015_01 table seems to have doubled in size since my comment 20 days ago,
This makes sense, the year reports are stored in the *_01 table, so if there's an issue w/ archives being added, it makes sense that this table would continue to grow as well.
rainyroads
commented
9 years ago Still abnormally large, but it has definitely made a large dent in the table size. https://gist.github.com/FujiMakoto/7ea457483e8031e61924
diosmosis
commented
9 years ago Hmm, so part of the problem still exists, could you send a data dump of the piwik_archive_numeric_2015_03 table to hello@piwik.org?
rainyroads
commented
9 years ago Sure, I sent it just now.
diosmosis
commented
9 years ago @FujiMakoto From the data you sent, it looks like everything was purged correctly; can you try to optimize one of the tables?
mattab
commented
9 years ago Hi guys,
for those of you using Mariadb, please try with latest beta version just released, it includes the fix OPTIMIZE TABLES should be run against mariadb instances that support it in #7462 which will now defragment your tables.
For those of you not on Mariadb, maybe the latest beta fixes the issue already?
or do you still see your archives tables too large?
mattab
commented
9 years ago moving to 2.13.0 but hopefully this issue should be fixed in Piwik 2.12.0-b7 or later.
Please leave a comment, when you know whether issue is fixed or not...
rainyroads
commented
9 years ago Sorry for the delayed response, after rebuilding the tables the table sizes are back to normal:
MariaDB [(none)]> SELECT table_name AS "Tables", round(((data_length + index_length) / 1024 / 1024), 2) "Size in MB" FROM information_schema.TABLES WHERE table_schema = "analytics" ORDER BY (data_length + index_length) DESC;
+-------------------------------+------------+
| Tables | Size in MB |
+-------------------------------+------------+
| piwik_archive_blob_2015_03 | 148.34 |
| piwik_archive_blob_2015_01 | 96.23 |
| piwik_archive_blob_2013_12 | 67.19 |
| piwik_archive_blob_2014_01 | 65.19 |
| piwik_archive_blob_2014_09 | 64.19 |
| piwik_archive_blob_2014_07 | 62.19 |
| piwik_archive_blob_2014_04 | 62.19 |
| piwik_archive_blob_2014_12 | 61.19 |
| piwik_archive_blob_2014_08 | 60.17 |
| piwik_log_link_visit_action | 59.64 |
| piwik_archive_blob_2014_03 | 59.17 |
| piwik_archive_blob_2013_07 | 59.17 |
| piwik_archive_blob_2014_06 | 58.17 |
| piwik_archive_blob_2013_08 | 58.17 |
| piwik_archive_blob_2013_09 | 57.17 |
| piwik_archive_blob_2014_10 | 57.14 |
| piwik_archive_blob_2014_05 | 56.14 |
| piwik_archive_blob_2014_11 | 56.14 |
| piwik_archive_blob_2014_02 | 55.14 |
| piwik_archive_blob_2013_06 | 54.17 |
| piwik_archive_blob_2013_11 | 54.14 |
| piwik_archive_blob_2013_10 | 54.14 |
| piwik_archive_blob_2015_02 | 53.14 |
| piwik_archive_blob_2013_05 | 49.13 |
| piwik_log_visit | 16.06 |
| piwik_log_action | 10.03 |
| piwik_archive_blob_2013_01 | 5.88 |
| piwik_archive_blob_2013_04 | 1.70 |
| piwik_option | 1.53 |
| piwik_archive_numeric_2013_12 | 0.61 |
| piwik_archive_numeric_2013_11 | 0.56 |
| piwik_archive_numeric_2013_10 | 0.56 |
| piwik_archive_numeric_2013_09 | 0.56 |
| piwik_archive_numeric_2013_08 | 0.56 |
| piwik_archive_numeric_2013_06 | 0.55 |
| piwik_archive_numeric_2013_05 | 0.50 |
| piwik_archive_numeric_2015_03 | 0.47 |
| piwik_archive_numeric_2013_07 | 0.47 |
| piwik_archive_numeric_2014_01 | 0.41 |
| piwik_archive_numeric_2014_04 | 0.34 |
| piwik_archive_numeric_2014_02 | 0.31 |
| piwik_archive_numeric_2014_09 | 0.31 |
| piwik_archive_numeric_2014_07 | 0.31 |
| piwik_archive_numeric_2014_03 | 0.30 |
| piwik_archive_numeric_2015_01 | 0.30 |
| piwik_archive_numeric_2014_06 | 0.30 |
| piwik_archive_numeric_2014_05 | 0.30 |
| piwik_archive_numeric_2014_12 | 0.27 |
| piwik_archive_numeric_2014_10 | 0.27 |
| piwik_archive_numeric_2014_08 | 0.27 |
| piwik_archive_numeric_2014_11 | 0.25 |
| piwik_archive_numeric_2015_02 | 0.23 |
| piwik_archive_numeric_2011_07 | 0.05 |
| piwik_archive_numeric_2012_11 | 0.05 |
| piwik_log_conversion | 0.05 |
| piwik_archive_numeric_2011_06 | 0.05 |
| piwik_archive_numeric_2012_10 | 0.05 |
| piwik_archive_numeric_2011_01 | 0.05 |
| piwik_archive_numeric_2012_09 | 0.05 |
| piwik_archive_numeric_2012_08 | 0.05 |
| piwik_archive_numeric_2010_01 | 0.05 |
| piwik_archive_numeric_2012_07 | 0.05 |
| piwik_archive_numeric_2009_01 | 0.05 |
| piwik_archive_numeric_2008_01 | 0.05 |
| piwik_archive_numeric_2012_06 | 0.05 |
| piwik_archive_numeric_2007_01 | 0.05 |
| piwik_archive_numeric_2012_05 | 0.05 |
| piwik_archive_numeric_2006_01 | 0.05 |
| piwik_archive_numeric_2012_04 | 0.05 |
| piwik_archive_numeric_2005_01 | 0.05 |
| piwik_archive_numeric_2012_03 | 0.05 |
| piwik_archive_numeric_2012_02 | 0.05 |
| piwik_archive_numeric_2004_01 | 0.05 |
| piwik_archive_numeric_2012_01 | 0.05 |
| piwik_archive_numeric_2011_12 | 0.05 |
| piwik_archive_numeric_2013_04 | 0.05 |
| piwik_archive_numeric_2013_03 | 0.05 |
| piwik_archive_numeric_2011_11 | 0.05 |
| piwik_archive_numeric_2013_02 | 0.05 |
| piwik_archive_numeric_2011_10 | 0.05 |
| piwik_archive_numeric_2011_09 | 0.05 |
| piwik_archive_numeric_2013_01 | 0.05 |
| piwik_archive_numeric_2011_08 | 0.05 |
| piwik_archive_numeric_2012_12 | 0.05 |
| piwik_log_conversion_item | 0.03 |
| piwik_archive_blob_2012_01 | 0.03 |
| piwik_archive_blob_2011_12 | 0.03 |
| piwik_archive_blob_2011_11 | 0.03 |
| piwik_archive_blob_2013_03 | 0.03 |
| piwik_archive_blob_2013_02 | 0.03 |
| piwik_archive_blob_2011_10 | 0.03 |
| piwik_archive_blob_2011_09 | 0.03 |
| piwik_user | 0.03 |
| piwik_archive_blob_2011_08 | 0.03 |
| piwik_archive_blob_2012_12 | 0.03 |
| piwik_archive_blob_2011_07 | 0.03 |
| piwik_archive_blob_2012_11 | 0.03 |
| piwik_archive_blob_2011_06 | 0.03 |
| piwik_archive_blob_2012_10 | 0.03 |
| piwik_archive_blob_2011_01 | 0.03 |
| piwik_archive_blob_2012_09 | 0.03 |
| piwik_archive_blob_2010_01 | 0.03 |
| piwik_archive_blob_2012_08 | 0.03 |
| piwik_archive_blob_2012_07 | 0.03 |
| piwik_archive_blob_2009_01 | 0.03 |
| piwik_archive_blob_2012_06 | 0.03 |
| piwik_archive_blob_2008_01 | 0.03 |
| piwik_archive_blob_2007_01 | 0.03 |
| piwik_archive_blob_2012_05 | 0.03 |
| piwik_archive_blob_2006_01 | 0.03 |
| piwik_archive_blob_2012_04 | 0.03 |
| piwik_archive_blob_2005_01 | 0.03 |
| piwik_log_profiling | 0.03 |
| piwik_archive_blob_2012_03 | 0.03 |
| piwik_archive_blob_2004_01 | 0.03 |
| piwik_archive_blob_2012_02 | 0.03 |
| piwik_access | 0.02 |
| piwik_user_language | 0.02 |
| piwik_user_dashboard | 0.02 |
| piwik_goal | 0.02 |
| piwik_site_url | 0.02 |
| piwik_site | 0.02 |
| piwik_session | 0.02 |
| piwik_sequence | 0.02 |
| piwik_segment | 0.02 |
| piwik_report | 0.02 |
| piwik_logger_message | 0.02 |
+-------------------------------+------------+I installed 2.12.0-rc2 and tried running the core:archive command and got a "[Exception] Trying to log a message that is not a string" error, though it didn't skip the scheduled tasks like core:archive was doing before.
I also tried core:purge-old-archive-data 2015-03 but it had no effect on my archive or blob tables... How can I do the Rebuild table that FujiMakoto mentioned? I'm on Innodb.
I'll respond in a few days with whether the rate of ballooning db size has slowed or not.
rainyroads
commented
9 years ago @PatrickChen Run the following command, replacing "piwik" with the name of your Piwik database table
mysqlcheck -o piwik -u root -pThe disk read spikes and InnoDB activity I was getting went away after the optimize, along with just over 1GB of my 5.5GB piwik database. Result!
skyhawk669
commented
9 years ago I've been running Piwik 2.12.0-rc2 for a couple of days and I have to run ./console core:purge-old-archive-data for the tables to be purged. It doesn't seem to automatically do it so far.
diosmosis
commented
9 years ago @skyhawk669 Are you using cron archiving? If so, can you check if archives are being purged in scheduled task output? Also are you using MariaDB?
Since upgrading to 2.10 the archive blobs and archive numbers tables have tripled in size (blob tables usually between 30-40MB, now they are 140-500MB).
The archiving process is set in cron to run every hour and nothing else has changed in the system beyond upgrading from 2.9 to 2.10 (no drastic change in amount of visitors, or to the structure of the site).
The tables are reduced in size a bit by running core:run-scheduled-tasks --force, but they're still quite a bit bigger than they used to be.
More background info in the following thread: http://forum.piwik.org/read.php?2,123852
Running Piwik on: Red Hat 5 apache 2.4 PHP 5.4.35 MySQL 5.0.45