Open Gul-liver opened 6 months ago
Hi @Gul-liver,
I think I can reproduce this problem. It seems that, after you delete every visit for a day, the archives are properly flagged for recreation. But, as no visit for that day (or segment) exists anymore, no new archive will be created to replace the old one.
To verify this assumption, could you run run archiving with "debug" output and check if a specific line is written?
# add -vvv to your archive command and all parameters you also need
./console core:archive -vvv
This may generate a LOT of output, so you may want to limit the archiving to a narrow date range that is displaying a wrong report for your site (e.g. using --force-date-range=2024-03-09,2024-03-11
).
You should receive output similar to this:
...
INFO [2024-03-21 23:17:38] 5347 START
INFO [2024-03-21 23:17:38] 5347 Starting Matomo reports archiving...
DEBUG [2024-03-21 23:17:38] 5347 Applying queued rearchiving...
INFO [2024-03-21 23:17:38] 5347 Start processing archives for site 1.
DEBUG [2024-03-21 23:17:38] 5347 Checking for queued invalidations...
...
DEBUG [2024-03-21 23:17:38] 5347 No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:17:38).
DEBUG [2024-03-21 23:17:38] 5347 Found invalidated archive we can skip (no visits): [idinvalidation = 489, idsite = 1, period = day(2024-03-21 - 2024-03-21), name = done, segment = ]
DEBUG [2024-03-21 23:17:38] 5347 No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:17:38).
DEBUG [2024-03-21 23:17:38] 5347 Found invalidated archive we can skip (no visits): [idinvalidation = 458, idsite = 1, period = day(2024-03-21 - 2024-03-21), name = done, segment = ]
...
If my assumption is correct, you should find a row with "DEBUG ... Found invalidated archive we can skip ..." for the days with the outdated reports.
Hi mmeudert,
Thanks a lot for your answer !
So I launched:
./console core:archive -vvv --force-all-websites --url=https://url-du-site-matomo/ --force-date-range=2024-03-09,2024-03-11 >./log-archivage-verbose-pb-10-MARS.txt
And this log contains (concerned website is "site 3"):
[32mINFO [2024-03-21 23:31:48] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:48] 3449008 [39m INIT [32mINFO [2024-03-21 23:31:48] 3449008 [39m Running Matomo 5.0.3 as Super User [32mINFO [2024-03-21 23:31:48] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:48] 3449008 [39m NOTES [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Async process archiving supported, using CliMulti. [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Reports for today will be processed at most every 1800 seconds. You can change this value in Matomo UI > Settings > General Settings. [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Archiving was last executed without error 26 min 42s ago. [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Will process all 2 websites [32mINFO [2024-03-21 23:31:48] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:48] 3449008 [39m START [32mINFO [2024-03-21 23:31:48] 3449008 [39m Starting Matomo reports archiving... [32mINFO [2024-03-21 23:31:48] 3449008 [39m 1 out of 3 archivers running currently [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Applying queued rearchiving... [32mINFO [2024-03-21 23:31:48] 3449008 [39m Start processing archives for site 1. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Checking for queued invalidations... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Today archive can be skipped due to no visits for idSite = 1, skipping invalidation... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Yesterday archive can be skipped due to no visits for idSite = 1, skipping invalidation... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Done invalidating [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m No next invalidated archive. [32mINFO [2024-03-21 23:31:48] 3449008 [39m Finished archiving for site 1, 0 API requests, Time elapsed: 0.027s [1 / 2 done] [32mINFO [2024-03-21 23:31:48] 3449008 [39m Start processing archives for site 3. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Checking for queued invalidations... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Today archive can be skipped due to no visits for idSite = 3, skipping invalidation... [32mINFO [2024-03-21 23:31:48] 3449008 [39m Will invalidate archived reports for yesterday in site ID = 3's timezone (2024-03-21 00:00:00). [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = , plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==cmp-bjh-ete-2022, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerType==search, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==news-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerName==Instagram, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Invalidating custom date range (last7) for site 3 [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = , plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = campaignName==cmp-bjh-ete-2022, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = referrerType==search, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = campaignName==news-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = referrerName==Instagram, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Done invalidating [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m No next invalidated archive. [32mINFO [2024-03-21 23:31:49] 3449008 [39m Finished archiving for site 3, 0 API requests, Time elapsed: 0.442s [2 / 2 done] [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m No more sites left to archive, stopping. [32mINFO [2024-03-21 23:31:49] 3449008 [39m Done archiving! [32mINFO [2024-03-21 23:31:49] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:49] 3449008 [39m SUMMARY [32mINFO [2024-03-21 23:31:49] 3449008 [39m Processed 0 archives. [32mINFO [2024-03-21 23:31:49] 3449008 [39m Total API requests: 0 [32mINFO [2024-03-21 23:31:49] 3449008 [39m done: 0 req, 488 ms, no error [32mINFO [2024-03-21 23:31:49] 3449008 [39m Time elapsed: 0.488s [32mINFO [2024-03-21 23:31:49] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:49] 3449008 [39m SCHEDULED TASKS [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m 27 scheduled tasks loaded [32mINFO [2024-03-21 23:31:49] 3449008 [39m Starting Scheduled tasks... [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 0: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 1: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 2: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 3: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 4: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 5: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 6: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 7: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 8: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 9: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 10: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 11: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 12: [32mINFO [2024-03-21 23:31:49] 3449008 [39m done [32mINFO [2024-03-21 23:31:49] 3449008 [39m ---------------------------
I've got the same issue for 2024-03-15: just one visit, a "bad visit", that I can't nomore delete completely :+1: No visit, but country stays recorded, hour range, and unfortunately "performance" (which are very poor, so statistics are really distorted).
So I tried for this day:
./console core:archive -vvv --force-idsites=3 --url=https://url-du-site-matomo/ --force-date-range=2024-03-14,2024-03-16 >./log-archivage-verbose-pb-15-MARS.txt
And log is:
[32mINFO [2024-03-21 23:56:16] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:16] 3465615 [39m INIT [32mINFO [2024-03-21 23:56:16] 3465615 [39m Running Matomo 5.0.3 as Super User [32mINFO [2024-03-21 23:56:16] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:16] 3465615 [39m NOTES [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Async process archiving supported, using CliMulti. [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Reports for today will be processed at most every 1800 seconds. You can change this value in Matomo UI > Settings > General Settings. [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Archiving was last executed without error 24 min 27s ago. [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Will process 1 websites (--force-idsites) [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Will process specified sites: 3 [32mINFO [2024-03-21 23:56:16] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:16] 3465615 [39m START [32mINFO [2024-03-21 23:56:16] 3465615 [39m Starting Matomo reports archiving... [32mINFO [2024-03-21 23:56:16] 3465615 [39m 1 out of 3 archivers running currently [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Applying queued rearchiving... [32mINFO [2024-03-21 23:56:16] 3465615 [39m Start processing archives for site 3. [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Checking for queued invalidations... [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Today archive can be skipped due to no visits for idSite = 3, skipping invalidation... [32mINFO [2024-03-21 23:56:16] 3465615 [39m Will invalidate archived reports for yesterday in site ID = 3's timezone (2024-03-21 00:00:00). [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = , plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==cmp-bjh-ete-2022, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerType==search, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==news-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerName==Instagram, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Invalidating custom date range (last7) for site 3 [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Done invalidating [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140560, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done, segment = ]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140565, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done3d32f56c8acbf157c19f17e770f65aa6, segment = campaignName==cmp-bjh-ete-2022] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140564, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donec24ce145a5f671ec1bdf052b72d54a0d, segment = campaignName==news-st-valentin-2023] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140563, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = doneb97ac64c174a9fe28a80ee071b64383b, segment = campaignSource==goo%253Fmtm_campaign%253Dcmp-bjh-st-valentin-2023] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140562, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donebf2a28dff7e55ab332fdae3b175f301c, segment = referrerName==Instagram] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140561, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done9eb972afd97a94801f1c96c18d9b492b, segment = referrerType==search] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No next invalidated archive. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&trigger=archivephp' 2>&1 [32mINFO [2024-03-21 23:56:17] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = '', 71 visits found. Time elapsed: 0.586s [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140565, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done3d32f56c8acbf157c19f17e770f65aa6, segment = campaignName==cmp-bjh-ete-2022]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140564, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donec24ce145a5f671ec1bdf052b72d54a0d, segment = campaignName==news-st-valentin-2023]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140563, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = doneb97ac64c174a9fe28a80ee071b64383b, segment = campaignSource==goo%253Fmtm_campaign%253Dcmp-bjh-st-valentin-2023]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dcmp-bjh-ete-2022&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dnews-st-valentin-2023&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignSource%3D%3Dgoo%25253Fmtm_campaign%25253Dcmp-bjh-st-valentin-2023&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dcmp-bjh-ete-2022&trigger=archivephp&pid=80713566a39b24491bdaa1b708071b8104cff96f00a4ee7a4ea02ad9f3060cc430c022f3e3cabc7608798d9a250dcfff6d760&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/80713566a39b24491bdaa1b708071b8104cff96f00a4ee7a4ea02ad9f3060cc430c022f3e3cabc7608798d9a250dcfff6d760.output 2>&1 & [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dnews-st-valentin-2023&trigger=archivephp&pid=e76d425330497ab20ea80ab91d1bccfd6f4609438e42ecdc1d39456c31aa7fb8a394a96fc8d07f51eee730ddd9ecbeb773821&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/e76d425330497ab20ea80ab91d1bccfd6f4609438e42ecdc1d39456c31aa7fb8a394a96fc8d07f51eee730ddd9ecbeb773821.output 2>&1 & [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignSource%3D%3Dgoo%25253Fmtm_campaign%25253Dcmp-bjh-st-valentin-2023&trigger=archivephp&pid=80bf531ceaa71f5a1e68553f499e851a8054f5cc03c7093eec87ba32adbb421cc4d91e787c508a74ccb3384fbad7967864b12&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/80bf531ceaa71f5a1e68553f499e851a8054f5cc03c7093eec87ba32adbb421cc4d91e787c508a74ccb3384fbad7967864b12.output 2>&1 & [32mINFO [2024-03-21 23:56:18] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'campaignName==cmp-bjh-ete-2022', 0 visits found. Time elapsed: 1.098s [32mINFO [2024-03-21 23:56:18] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'campaignName==news-st-valentin-2023', 0 visits found. Time elapsed: 1.098s [32mINFO [2024-03-21 23:56:18] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023', 0 visits found. Time elapsed: 1.098s [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:18). [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Processing invalidation: [idinvalidation = 140562, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donebf2a28dff7e55ab332fdae3b175f301c, segment = referrerName==Instagram]. [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:18). [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Processing invalidation: [idinvalidation = 140561, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done9eb972afd97a94801f1c96c18d9b492b, segment = referrerType==search]. [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m No next invalidated archive. [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerName%3D%3DInstagram&trigger=archivephp [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerType%3D%3Dsearch&trigger=archivephp [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerName%3D%3DInstagram&trigger=archivephp&pid=6b34ef285b78d851ef304cf716a43ba043a1a1628d74750a223ae07ce4e68bdb8eb7028af03babaa8663bcb45100d1601be50&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/6b34ef285b78d851ef304cf716a43ba043a1a1628d74750a223ae07ce4e68bdb8eb7028af03babaa8663bcb45100d1601be50.output 2>&1 & [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerType%3D%3Dsearch&trigger=archivephp&pid=896fbbd1d582e3ec07d30bb2a0339a9e49b8e4aa14a0b8135d5fcfcce029178eeaafc6b45484136f3811f2c575e182362ed21&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/896fbbd1d582e3ec07d30bb2a0339a9e49b8e4aa14a0b8135d5fcfcce029178eeaafc6b45484136f3811f2c575e182362ed21.output 2>&1 & [32mINFO [2024-03-21 23:56:20] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'referrerName==Instagram', 0 visits found. Time elapsed: 0.777s [32mINFO [2024-03-21 23:56:20] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'referrerType==search', 4 visits found. Time elapsed: 1.385s [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m No next invalidated archive. [32mINFO [2024-03-21 23:56:20] 3465615 [39m Finished archiving for site 3, 6 API requests, Time elapsed: 3.541s [1 / 1 done] [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m No more sites left to archive, stopping. [32mINFO [2024-03-21 23:56:20] 3465615 [39m Done archiving! [32mINFO [2024-03-21 23:56:20] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:20] 3465615 [39m SUMMARY [32mINFO [2024-03-21 23:56:20] 3465615 [39m Processed 6 archives. [32mINFO [2024-03-21 23:56:20] 3465615 [39m Total API requests: 6 [32mINFO [2024-03-21 23:56:20] 3465615 [39m done: 6 req, 3559 ms, no error [32mINFO [2024-03-21 23:56:20] 3465615 [39m Time elapsed: 3.559s [32mINFO [2024-03-21 23:56:20] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:20] 3465615 [39m SCHEDULED TASKS [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m 27 scheduled tasks loaded [32mINFO [2024-03-21 23:56:20] 3465615 [39m Starting Scheduled tasks... [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 0: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 1: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 2: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 3: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 4: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 5: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 6: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 7: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 8: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 9: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 10: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 11: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 12: [32mINFO [2024-03-21 23:56:20] 3465615 [39m done [32mINFO [2024-03-21 23:56:20] 3465615 [39m ---------------------------
Does it validate what you thought about ?
Anyway, thanks a lot !
Best regards
Sorry for this bad format ... I shouldn't have formatted this as "code"..
So, log for 10 Mars:
[32mINFO [2024-03-21 23:31:48] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:48] 3449008 [39m INIT [32mINFO [2024-03-21 23:31:48] 3449008 [39m Running Matomo 5.0.3 as Super User [32mINFO [2024-03-21 23:31:48] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:48] 3449008 [39m NOTES [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Async process archiving supported, using CliMulti. [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Reports for today will be processed at most every 1800 seconds. You can change this value in Matomo UI > Settings > General Settings. [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Archiving was last executed without error 26 min 42s ago. [32mINFO [2024-03-21 23:31:48] 3449008 [39m - Will process all 2 websites [32mINFO [2024-03-21 23:31:48] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:48] 3449008 [39m START [32mINFO [2024-03-21 23:31:48] 3449008 [39m Starting Matomo reports archiving... [32mINFO [2024-03-21 23:31:48] 3449008 [39m 1 out of 3 archivers running currently [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Applying queued rearchiving... [32mINFO [2024-03-21 23:31:48] 3449008 [39m Start processing archives for site 1. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Checking for queued invalidations... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Today archive can be skipped due to no visits for idSite = 1, skipping invalidation... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Yesterday archive can be skipped due to no visits for idSite = 1, skipping invalidation... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Done invalidating [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m No next invalidated archive. [32mINFO [2024-03-21 23:31:48] 3449008 [39m Finished archiving for site 1, 0 API requests, Time elapsed: 0.027s [1 / 2 done] [32mINFO [2024-03-21 23:31:48] 3449008 [39m Start processing archives for site 3. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Checking for queued invalidations... [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Today archive can be skipped due to no visits for idSite = 3, skipping invalidation... [32mINFO [2024-03-21 23:31:48] 3449008 [39m Will invalidate archived reports for yesterday in site ID = 3's timezone (2024-03-21 00:00:00). [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = , plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==cmp-bjh-ete-2022, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerType==search, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:48] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==news-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerName==Instagram, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Invalidating custom date range (last7) for site 3 [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = , plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = campaignName==cmp-bjh-ete-2022, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = referrerType==search, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = campaignName==news-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Found usable archive for [idSite = 3, period = range 2024-03-15,2024-03-21, segment = referrerName==Instagram, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Done invalidating [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m No next invalidated archive. [32mINFO [2024-03-21 23:31:49] 3449008 [39m Finished archiving for site 3, 0 API requests, Time elapsed: 0.442s [2 / 2 done] [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m No more sites left to archive, stopping. [32mINFO [2024-03-21 23:31:49] 3449008 [39m Done archiving! [32mINFO [2024-03-21 23:31:49] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:49] 3449008 [39m SUMMARY [32mINFO [2024-03-21 23:31:49] 3449008 [39m Processed 0 archives. [32mINFO [2024-03-21 23:31:49] 3449008 [39m Total API requests: 0 [32mINFO [2024-03-21 23:31:49] 3449008 [39m done: 0 req, 488 ms, no error [32mINFO [2024-03-21 23:31:49] 3449008 [39m Time elapsed: 0.488s [32mINFO [2024-03-21 23:31:49] 3449008 [39m --------------------------- [32mINFO [2024-03-21 23:31:49] 3449008 [39m SCHEDULED TASKS [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m 27 scheduled tasks loaded [32mINFO [2024-03-21 23:31:49] 3449008 [39m Starting Scheduled tasks... [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 0: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 1: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 2: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 3: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 4: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 5: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 6: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 7: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 8: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 9: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 10: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 11: [37mDEBUG [2024-03-21 23:31:49] 3449008 [39m Executing tasks with priority 12: [32mINFO [2024-03-21 23:31:49] 3449008 [39m done [32mINFO [2024-03-21 23:31:49] 3449008 [39m ---------------------------
And log for 15 Mars:
[32mINFO [2024-03-21 23:56:16] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:16] 3465615 [39m INIT [32mINFO [2024-03-21 23:56:16] 3465615 [39m Running Matomo 5.0.3 as Super User [32mINFO [2024-03-21 23:56:16] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:16] 3465615 [39m NOTES [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Async process archiving supported, using CliMulti. [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Reports for today will be processed at most every 1800 seconds. You can change this value in Matomo UI > Settings > General Settings. [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Archiving was last executed without error 24 min 27s ago. [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Will process 1 websites (--force-idsites) [32mINFO [2024-03-21 23:56:16] 3465615 [39m - Will process specified sites: 3 [32mINFO [2024-03-21 23:56:16] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:16] 3465615 [39m START [32mINFO [2024-03-21 23:56:16] 3465615 [39m Starting Matomo reports archiving... [32mINFO [2024-03-21 23:56:16] 3465615 [39m 1 out of 3 archivers running currently [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Applying queued rearchiving... [32mINFO [2024-03-21 23:56:16] 3465615 [39m Start processing archives for site 3. [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Checking for queued invalidations... [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Today archive can be skipped due to no visits for idSite = 3, skipping invalidation... [32mINFO [2024-03-21 23:56:16] 3465615 [39m Will invalidate archived reports for yesterday in site ID = 3's timezone (2024-03-21 00:00:00). [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = , plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==cmp-bjh-ete-2022, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:16] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerType==search, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = campaignName==news-st-valentin-2023, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found usable archive for [idSite = 3, period = day 2024-03-21,2024-03-21, segment = referrerName==Instagram, plugin = , report = ], skipping invalidation. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Invalidating custom date range (last7) for site 3 [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Done invalidating [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140560, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done, segment = ]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140565, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done3d32f56c8acbf157c19f17e770f65aa6, segment = campaignName==cmp-bjh-ete-2022] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140564, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donec24ce145a5f671ec1bdf052b72d54a0d, segment = campaignName==news-st-valentin-2023] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140563, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = doneb97ac64c174a9fe28a80ee071b64383b, segment = campaignSource==goo%253Fmtm_campaign%253Dcmp-bjh-st-valentin-2023] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140562, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donebf2a28dff7e55ab332fdae3b175f301c, segment = referrerName==Instagram] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Found archive with intersecting period with others in concurrent batch, skipping until next batch: [idinvalidation = 140561, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done9eb972afd97a94801f1c96c18d9b492b, segment = referrerType==search] [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No next invalidated archive. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&trigger=archivephp' 2>&1 [32mINFO [2024-03-21 23:56:17] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = '', 71 visits found. Time elapsed: 0.586s [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140565, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done3d32f56c8acbf157c19f17e770f65aa6, segment = campaignName==cmp-bjh-ete-2022]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140564, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donec24ce145a5f671ec1bdf052b72d54a0d, segment = campaignName==news-st-valentin-2023]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:17). [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Processing invalidation: [idinvalidation = 140563, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = doneb97ac64c174a9fe28a80ee071b64383b, segment = campaignSource==goo%253Fmtm_campaign%253Dcmp-bjh-st-valentin-2023]. [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dcmp-bjh-ete-2022&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dnews-st-valentin-2023&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignSource%3D%3Dgoo%25253Fmtm_campaign%25253Dcmp-bjh-st-valentin-2023&trigger=archivephp [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dcmp-bjh-ete-2022&trigger=archivephp&pid=80713566a39b24491bdaa1b708071b8104cff96f00a4ee7a4ea02ad9f3060cc430c022f3e3cabc7608798d9a250dcfff6d760&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/80713566a39b24491bdaa1b708071b8104cff96f00a4ee7a4ea02ad9f3060cc430c022f3e3cabc7608798d9a250dcfff6d760.output 2>&1 & [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignName%3D%3Dnews-st-valentin-2023&trigger=archivephp&pid=e76d425330497ab20ea80ab91d1bccfd6f4609438e42ecdc1d39456c31aa7fb8a394a96fc8d07f51eee730ddd9ecbeb773821&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/e76d425330497ab20ea80ab91d1bccfd6f4609438e42ecdc1d39456c31aa7fb8a394a96fc8d07f51eee730ddd9ecbeb773821.output 2>&1 & [37mDEBUG [2024-03-21 23:56:17] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=campaignSource%3D%3Dgoo%25253Fmtm_campaign%25253Dcmp-bjh-st-valentin-2023&trigger=archivephp&pid=80bf531ceaa71f5a1e68553f499e851a8054f5cc03c7093eec87ba32adbb421cc4d91e787c508a74ccb3384fbad7967864b12&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/80bf531ceaa71f5a1e68553f499e851a8054f5cc03c7093eec87ba32adbb421cc4d91e787c508a74ccb3384fbad7967864b12.output 2>&1 & [32mINFO [2024-03-21 23:56:18] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'campaignName==cmp-bjh-ete-2022', 0 visits found. Time elapsed: 1.098s [32mINFO [2024-03-21 23:56:18] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'campaignName==news-st-valentin-2023', 0 visits found. Time elapsed: 1.098s [32mINFO [2024-03-21 23:56:18] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'campaignSource==goo%3Fmtm_campaign%3Dcmp-bjh-st-valentin-2023', 0 visits found. Time elapsed: 1.098s [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:18). [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Processing invalidation: [idinvalidation = 140562, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = donebf2a28dff7e55ab332fdae3b175f301c, segment = referrerName==Instagram]. [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m No usable archive exists (ts_archived of existing = , now = 2024-03-21 23:56:18). [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Processing invalidation: [idinvalidation = 140561, idsite = 3, period = range(2024-03-15 - 2024-03-21), name = done9eb972afd97a94801f1c96c18d9b492b, segment = referrerType==search]. [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m No next invalidated archive. [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerName%3D%3DInstagram&trigger=archivephp [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m process_new_segments_from set to beginning_of_time or cannot recognize value [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Starting archiving for ?module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerType%3D%3Dsearch&trigger=archivephp [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerName%3D%3DInstagram&trigger=archivephp&pid=6b34ef285b78d851ef304cf716a43ba043a1a1628d74750a223ae07ce4e68bdb8eb7028af03babaa8663bcb45100d1601be50&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/6b34ef285b78d851ef304cf716a43ba043a1a1628d74750a223ae07ce4e68bdb8eb7028af03babaa8663bcb45100d1601be50.output 2>&1 & [37mDEBUG [2024-03-21 23:56:18] 3465615 [39m Running command: /opt/alt/php81/usr/bin/php -q /home/dreamboxorg/data.dream-box.org/console climulti:request -q --matomo-domain='data.dream-box.org' --superuser 'module=API&method=CoreAdminHome.archiveReports&idSite=3&period=range&date=2024-03-15,2024-03-21&format=json&segment=referrerType%3D%3Dsearch&trigger=archivephp&pid=896fbbd1d582e3ec07d30bb2a0339a9e49b8e4aa14a0b8135d5fcfcce029178eeaafc6b45484136f3811f2c575e182362ed21&runid=3465615' > /home/dreamboxorg/data.dream-box.org/tmp/climulti/896fbbd1d582e3ec07d30bb2a0339a9e49b8e4aa14a0b8135d5fcfcce029178eeaafc6b45484136f3811f2c575e182362ed21.output 2>&1 & [32mINFO [2024-03-21 23:56:20] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'referrerName==Instagram', 0 visits found. Time elapsed: 0.777s [32mINFO [2024-03-21 23:56:20] 3465615 [39m Archived website id 3, period = range, date = 2024-03-15,2024-03-21, segment = 'referrerType==search', 4 visits found. Time elapsed: 1.385s [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m No next invalidated archive. [32mINFO [2024-03-21 23:56:20] 3465615 [39m Finished archiving for site 3, 6 API requests, Time elapsed: 3.541s [1 / 1 done] [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m No more sites left to archive, stopping. [32mINFO [2024-03-21 23:56:20] 3465615 [39m Done archiving! [32mINFO [2024-03-21 23:56:20] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:20] 3465615 [39m SUMMARY [32mINFO [2024-03-21 23:56:20] 3465615 [39m Processed 6 archives. [32mINFO [2024-03-21 23:56:20] 3465615 [39m Total API requests: 6 [32mINFO [2024-03-21 23:56:20] 3465615 [39m done: 6 req, 3559 ms, no error [32mINFO [2024-03-21 23:56:20] 3465615 [39m Time elapsed: 3.559s [32mINFO [2024-03-21 23:56:20] 3465615 [39m --------------------------- [32mINFO [2024-03-21 23:56:20] 3465615 [39m SCHEDULED TASKS [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m 27 scheduled tasks loaded [32mINFO [2024-03-21 23:56:20] 3465615 [39m Starting Scheduled tasks... [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 0: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 1: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 2: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 3: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 4: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 5: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 6: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 7: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 8: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m EI shouldn't have formatted this as "code".xecuting tasks with priority 9: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 10: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 11: [37mDEBUG [2024-03-21 23:56:20] 3465615 [39m Executing tasks with priority 12: [32mINFO [2024-03-21 23:56:20] 3465615 [39m done [32mINFO [2024-03-21 23:56:20] 3465615 [39m ---------------------------
I've got the same issue for 2024-03-15: just one visit, a "bad visit", that I can't nomore delete completely 👍 No visit, but country stays recorded, hour range, and unfortunately "performance" (which are very poor, so statistics are really distorted).
That should confirm my assumption.
Your logs don't show the line I was looking for, but I think you haven't run core:invalidate-report-data
for these days beforehand. And I also did not mention is specifically, but we should have enough info to prioritize this for a fix.
Hi mmeudert,
Looking at the bash history, I can tell that I ran "core:invalidate-report-data" for this date, before:
./console core:invalidate-report-data --dates=2024-03-15 --sites=3 > ./log-invalidate-15-MARS-2024.log
But this log is not very verbose:
[32mINFO [2024-03-21 21:41:50] 3370473 [39m Invalidating day periods in 2024-03-15 [segment = ]... [32mINFO [2024-03-21 21:41:50] 3370473 [39m Invalidating week periods in 2024-03-15 [segment = ]... [32mINFO [2024-03-21 21:41:50] 3370473 [39m Invalidating month periods in 2024-03-15 [segment = ]... [32mINFO [2024-03-21 21:41:50] 3370473 [39m Invalidating year periods in 2024-03-15 [segment = ]...
As I consult this history, I realize that I may have made a mistake ... I ran this, after "core:invalidate-report-data":
./console core:delete-logs-data --dates=2024-03-15 --idsite=3
I probably shouldn't have done it... I thought that deleting this data would delete these reports in the GUI. Now I have no idea where Matomo is getting this data from.
Below are a few captures showing significant concern for March 15.
Would other logs or database extracts be useful to better understand the problem ?
Thanks ! Best regards
In fact, there's no problem with this procedure when there are still archived visits after deleting one (or more) for a day.
What happened?
Hi,
With a matomo hosted on a server I administer, I have a problem recreating the statistics when I want to delete a visit (which is not significant). I've opened a forum post; [https://forum.matomo.org/t/stats-de-performance-non-recreees/55766/1](forum post)
In short, when I delete a visit with the tool present in the "administration" >> "PrivacyManager" >> "gdprTools" section
The visit is indeed deleted in "Visitors", but it's still taken into account in many statistics (hours, geographical origin, device...) And in the "performance" menu, where you'll find access times, DOM generation times, etc., the deleted visit still has an impact. The website concerned has few visits, so it's easy to see this concern.
What should happen?
When one or more visits are deleted, they should no longer have an impact on the statistics.
How can this be reproduced?
Click on "Admin" >> RGPD tools" >> Search for a visite (with its ID) >> Delete it
./console core:invalidate-report-data --dates=2024-03-10 --sites=3
./console core:archive --force-all-websites --url=https://url-du-site-matomo/
Matomo version
5.0.3
PHP version
8.1.27
Server operating system
Linux - Litespeed (no cache !)
What browsers are you seeing the problem on?
Firefox
Computer operating system
Linux
Relevant log output
Validations