dmwm / PHEDEX

CMS data-placement suite
8 stars 18 forks source link

InfoFileSize agent performance issue #1052

Open nikmagini opened 7 years ago

nikmagini commented 7 years ago

The InfoFileSize agent (used to populate summary tables with a file size statistics) is running slowly, often reaching the 2 hour timeout and getting killed/restarted by Watchdog:

https://ggus.eu/?mode=ticket_info&ticket_id=124312

The agent is performing full table scans on the t_dps_file table which is constantly growing:

https://github.com/dmwm/PHEDEX/blob/master/perl_lib/PHEDEX/Monitoring/InfoFileSize/Agent.pm

Not a critical issue since the histogram/overview tables are only used to generate summary reports for the website.