search

distributed-system-analysis / pbench

A benchmarking and performance analysis framework
http://distributed-system-analysis.github.io/pbench/
GNU General Public License v3.0
188 stars 108 forks source link

Add simple report generator #3602

Closed dbutenhof closed 9 months ago

dbutenhof commented 10 months ago

This will report on the state of the ARCHIVE, BACKUP, and CACHE on-disk trees in addition to the state of the SQL database. (I'm going to leave analyzing and reporting on the Opensearch database for another time, since this is "off books" weekend upstream work!)

This packages the ad hoc SQL queries I've been doing to monitor the server as a CLI utility, plus some more.

Here's the output of pbench-report-generator --all on the production server:

Archive report:
  117,446 tarballs consuming 21.7 TB
  The smallest tarball is 1.0 kB, pbench-user-benchmark__2020.04.03T11.05.44
  The biggest tarball is 41.1 GB, uperf_Azure_RHEL-8.10.0-20240116.45_x86_64_gen2_pci_netvsc_quick_D240125T014727_2024.01.25T01.47.28
Backup report:
  117,447 tarballs consuming 21.7 TB
Cache report:
  97,464 datasets consuming 45.6 TB
  4 datasets have never been unpacked, 0 are missing reference timestamps, 0 have bad size metadata
  The smallest cache is 24.6 kB, pbench-user-benchmark__2020.04.03T11.05.44
  The biggest cache is 110.5 GB, trafficgen_RHOSP16.2-RHEL8.3-nrt-OVS-OFFLOAD-PVP-LossTests_tg:trex_r:none_fs:64,128,256,512,1024,1500_nf:1024_fm:si_td:bi_ml:0.002,0.0005,0.0001_tt:bs__2020-12-26T03:16:38
  The least recently used cache was referenced Dec 11, specjbb2005__2023.09.22T00.22.28
  The most recently used cache was referenced today, uperf_rhel84_4.18.0.277_kernel_10gb_jumbo_2021.01.26T09.51.18
SQL storage report:
  Table                Rows       Storage   
  -------------------- ---------- ----------
  alembic_version               1    57.3 kB
  audit                   683,922   224.7 MB
  datasets                117,449    34.3 MB
  templates                    12   221.2 kB
  server_settings               0    24.6 kB
  users                        11    81.9 kB
  dataset_metadata        352,344   217.9 MB
  dataset_operations      340,986    29.1 MB
  api_keys                      5    81.9 kB
  indexmaps               291,510    79.7 GB
Operational states:
  UPLOAD states:
          OK  117,449
  TOOLINDEX states:
       READY  106,112
  INDEX states:
          OK  106,112
      FAILED      494
           CODE  7:    365  Bad metadata.log file encountered
           CODE  1:    128  Operational error while indexing
           CODE 12:      1  Unexpected error encountered
       READY   10,819
webbnh commented 10 months ago

I forgot to add...are you going to update the PR description with the new output?