search

whamcloud / lustre-collector

Collects various Lustre properties and serializes to JSON or YAML output
MIT License
8 stars 3 forks source link

`brw_stats` are not available #40

Closed RDruon closed 2 years ago

RDruon commented 2 years ago

brw_stats moved from obdfilter.*.brw_stats to osd-*.*.brw_stats. The collector still use the old path (see obdfilter_parser.rs#L24

[root@node1 ~]# lctl get_param osd*.*.brw_stats
osd-ldiskfs.MGS.brw_stats=
snapshot_time:         1646316869.203619503 (secs.nsecs)

                           read      |     write
pages per bulk r/w     rpcs  % cum % |  rpcs        % cum %

                           read      |     write
discontiguous pages    rpcs  % cum % |  rpcs        % cum %

                           read      |     write
discontiguous blocks   rpcs  % cum % |  rpcs        % cum %

                           read      |     write
disk fragmented I/Os   ios   % cum % |  ios         % cum %

                           read      |     write
disk I/Os in flight    ios   % cum % |  ios         % cum %

                           read      |     write
I/O time (1/1000s)     ios   % cum % |  ios         % cum %

                           read      |     write
disk I/O size          ios   % cum % |  ios         % cum %
osd-ldiskfs.fs-MDT0000.brw_stats=
snapshot_time:         1646316869.203850118 (secs.nsecs)

                           read      |     write
pages per bulk r/w     rpcs  % cum % |  rpcs        % cum %

                           read      |     write
discontiguous pages    rpcs  % cum % |  rpcs        % cum %

                           read      |     write
discontiguous blocks   rpcs  % cum % |  rpcs        % cum %

                           read      |     write
disk fragmented I/Os   ios   % cum % |  ios         % cum %

                           read      |     write
disk I/Os in flight    ios   % cum % |  ios         % cum %

                           read      |     write
I/O time (1/1000s)     ios   % cum % |  ios         % cum %

                           read      |     write
disk I/O size          ios   % cum % |  ios         % cum %
osd-ldiskfs.fs-OST0000.brw_stats=
snapshot_time:         1646316922.019503598 (secs.nsecs)

                           read      |     write
pages per bulk r/w     rpcs  % cum % |  rpcs        % cum %

                           read      |     write
discontiguous pages    rpcs  % cum % |  rpcs        % cum %

                           read      |     write
discontiguous blocks   rpcs  % cum % |  rpcs        % cum %

                           read      |     write
disk fragmented I/Os   ios   % cum % |  ios         % cum %

                           read      |     write
disk I/Os in flight    ios   % cum % |  ios         % cum %

                           read      |     write
I/O time (1/1000s)     ios   % cum % |  ios         % cum %

                           read      |     write
disk I/O size          ios   % cum % |  ios         % cum %

I tried to move the brw_stats parser to use osd-* but it conflicts with the existing mds_parser see mds_parser.rs#L111

jgrund commented 2 years ago

@RDruon Can you open a patch with a fixture? (include full output for lctl get_param osd-*.*.brw_stats).

RDruon commented 2 years ago

Opened #41