search

distributed-system-analysis / pbench

A benchmarking and performance analysis framework
http://distributed-system-analysis.github.io/pbench/
GNU General Public License v3.0
182 stars 109 forks source link

Ops fixes #3616

Closed dbutenhof closed 2 months ago

dbutenhof commented 2 months ago

Correct accounting and reporting of cache unpacking statistics.

Avoid reflecting SQLAlchemy init_db errors into conmon.

Cache report:
  25,702 datasets currently unpacked, consuming 85.1 TB
  5,492 datasets have unpack metrics and 2 have been unpacked more than once.
  The most unpacked dataset has been unpacked 2 times, uperf__2024.04.10T23.35.29
  The least recently used cache was referenced Jan 22, fio__2020.03.09T12.19.24
  The most recently used cache was referenced today, uperf__2024.04.10T23.35.29
  The smallest cache is 4.1 kB, fio__2020.03.03T21.51.55
  The biggest cache is 420.8 GB, uperf_rhel8.5_4.10.0.310.el8_intel_10gb_long_run_2021.06.08T17.54.04
  The worst compression ratio is -4201.758%, fio__2020.03.03T21.51.55
  The best compression ratio is 99.800%, fio__2020.02.27T14.03.02
  The fastest cache unpack is 0.025 seconds, pbench-user-benchmark__2020.05.01T09.13.21
  The slowest cache unpack is 66527.955 seconds, uperf_ethanolx_nps1_hton_biosdefault_tp_1x100GbE_CX5_8.1_147_2020.01.14T15.53.38
  The fastest cache unpack streaming rate is 538.635 Mb/second, pbench-user-benchmark_0400r-020cpt-0000d_ms-100ka-ytlsru-120s-mix-aws-perfci_2020.10.14T06.00.43
  The slowest cache unpack streaming rate is 0.287 Mb/second, pbench-user-benchmark__2020.04.29T10.13.07
  622 datasets have no unpacked size, 0 are missing reference timestamps, 0 have bad size metadata