snabbco / snabb

Snabb: Simple and fast packet networking
Apache License 2.0
2.97k stars 300 forks source link

config get-state output format for InfluxDB (and other time series databases)? #1284

Open mwiget opened 6 years ago

mwiget commented 6 years ago

snabb gained yang based configuration and state information via snabb config. Counters are nicely exposed via snabb config get-state using two display output formats: yang or xpath.

I was in need to display near real-time telemetry data of running snabb lwaftr instances via a web page and reverted to Grafana with InfluxDB backend. Starting from the xpath format, I translated it via tr/awk into the required InfluxDB HTTP API:

grafana1

snabb config get-state -f xpath $HOSTNAME / \
  | tr '/' ' ' | tr '[|]' ' ' | awk '{print $4 "," $2 "," $1 "=" $3 " value=" $5}' \
  | grep -v 'value=$' \
  | curl -i -XPOST 'http://influxdb:8086/write?db=lwaftr' --data-binary @-

Granted, not very nice, but functional for the demo. I open this issue to discuss ways to extend get-state to adhere to various output formats for easy consumption of third party time series databases.

Does it make sense to add DB specific output formats to get-state? If so, what are the most common programmatic API's in use?

A running lwaftr installation with 5 interfaces reports these stats:

~ # snabb config get-state lwaftr1 /
br-instances {
  binding {
    br-instance {
      id 1;
      traffic-stat {
        active-softwire-num 0;
        dropped-ipv4-byte 395847195;
        dropped-ipv4-bytes 0;
        dropped-ipv4-fragments 0;
        dropped-ipv4-packet 2176278;
        dropped-ipv6-byte 308817853;
        dropped-ipv6-packet 2176163;
        hairpin-ipv4-bytes 0;
        hairpin-ipv4-packets 0;
        ipv6-fragments-bytes-reassembled 0;
        ipv6-fragments-reassembled 0;
        rcvd-ipv4-byte 154705021;
        rcvd-ipv4-packet 1089480;
        rcvd-ipv6-byte 197399838;
        rcvd-ipv6-packet 1084638;
        sent-ipv4-byte 154011212;
        sent-ipv4-packet 1084586;
        sent-ipv6-byte 198282266;
        sent-ipv6-packet 1089463;
      }
    }
    br-instance {
      id 3;
      traffic-stat {
        active-softwire-num 0;
        dropped-ipv4-byte 397478627;
        dropped-ipv4-bytes 0;
        dropped-ipv4-fragments 0;
        dropped-ipv4-packet 2185246;
        dropped-ipv6-byte 310089585;
        dropped-ipv6-packet 2185109;
        hairpin-ipv4-bytes 0;
        hairpin-ipv4-packets 0;
        ipv6-fragments-bytes-reassembled 0;
        ipv6-fragments-reassembled 0;
        rcvd-ipv4-byte 154926541;
        rcvd-ipv4-packet 1091040;
        rcvd-ipv6-byte 198746638;
        rcvd-ipv6-packet 1092038;
        sent-ipv4-byte 155062012;
        sent-ipv4-packet 1091986;
        sent-ipv6-byte 198566186;
        sent-ipv6-packet 1091023;
      }
    }
    br-instance {
      id 4;
      traffic-stat {
        active-softwire-num 0;
        dropped-ipv4-byte 561367356;
        dropped-ipv4-bytes 0;
        dropped-ipv4-fragments 0;
        dropped-ipv4-packet 2894607;
        dropped-ipv6-byte 474592086;
        dropped-ipv6-packet 2894548;
        hairpin-ipv4-bytes 0;
        hairpin-ipv4-packets 0;
        ipv6-fragments-bytes-reassembled 0;
        ipv6-fragments-reassembled 0;
        rcvd-ipv4-byte 153608623;
        rcvd-ipv4-packet 1081759;
        rcvd-ipv6-byte 364327937;
        rcvd-ipv6-packet 1810718;
        sent-ipv4-byte 154219100;
        sent-ipv4-packet 1086050;
        sent-ipv6-byte 196876680;
        sent-ipv6-packet 1081740;
      }
    }
    br-instance {
      id 2;
      traffic-stat {
        active-softwire-num 0;
        dropped-ipv4-byte 676279636;
        dropped-ipv4-bytes 0;
        dropped-ipv4-fragments 0;
        dropped-ipv4-packet 4452825;
        dropped-ipv6-byte 1365251104;
        dropped-ipv6-packet 2375900;
        hairpin-ipv4-bytes 0;
        hairpin-ipv4-packets 0;
        ipv6-fragments-bytes-reassembled 0;
        ipv6-fragments-reassembled 0;
        rcvd-ipv4-byte 247489875;
        rcvd-ipv4-packet 1189497;
        rcvd-ipv6-byte 197928853;
        rcvd-ipv6-packet 1087546;
        sent-ipv4-byte 154423722;
        sent-ipv4-packet 1087491;
        sent-ipv6-byte 199154774;
        sent-ipv6-packet 1094257;
      }
    }
    br-instance {
      id 5;
      traffic-stat {
        active-softwire-num 0;
        dropped-ipv4-byte 394848597;
        dropped-ipv4-bytes 0;
        dropped-ipv4-fragments 0;
        dropped-ipv4-packet 2170768;
        dropped-ipv6-byte 308042531;
        dropped-ipv6-packet 2170719;
        hairpin-ipv4-bytes 0;
        hairpin-ipv4-packets 0;
        ipv6-fragments-bytes-reassembled 0;
        ipv6-fragments-reassembled 0;
        rcvd-ipv4-byte 153517191;
        rcvd-ipv4-packet 1081115;
        rcvd-ipv6-byte 197927258;
        rcvd-ipv6-packet 1087535;
        sent-ipv4-byte 154422728;
        sent-ipv4-packet 1087484;
        sent-ipv6-byte 196759836;
        sent-ipv6-packet 1081098;
      }
    }
  }
}

converted to InfluxDB consumable output via HTTP API:

~ # snabb config get-state -f xpath lwaftr1 / | tr '/' ' ' | tr '[|]' ' ' | aw
k '{print $4 "," $2 "," $1 "=" $3 " value=" $5}'|grep -v 'value=$'
active-softwire-num,id=2,br-instance=traffic-stat value=0
dropped-ipv4-byte,id=2,br-instance=traffic-stat value=681159155
dropped-ipv4-bytes,id=2,br-instance=traffic-stat value=0
dropped-ipv4-fragments,id=2,br-instance=traffic-stat value=0
dropped-ipv4-packet,id=2,br-instance=traffic-stat value=4485492
dropped-ipv6-byte,id=2,br-instance=traffic-stat value=1373758027
dropped-ipv6-packet,id=2,br-instance=traffic-stat value=2393137
hairpin-ipv4-bytes,id=2,br-instance=traffic-stat value=0
hairpin-ipv4-packets,id=2,br-instance=traffic-stat value=0
ipv6-fragments-bytes-reassembled,id=2,br-instance=traffic-stat value=0
ipv6-fragments-reassembled,id=2,br-instance=traffic-stat value=0
rcvd-ipv4-byte,id=2,br-instance=traffic-stat value=249207320
rcvd-ipv4-packet,id=2,br-instance=traffic-stat value=1198117
rcvd-ipv6-byte,id=2,br-instance=traffic-stat value=199392133
rcvd-ipv6-packet,id=2,br-instance=traffic-stat value=1095586
sent-ipv4-byte,id=2,br-instance=traffic-stat value=155565402
sent-ipv4-packet,id=2,br-instance=traffic-stat value=1095531
sent-ipv6-byte,id=2,br-instance=traffic-stat value=200621694
sent-ipv6-packet,id=2,br-instance=traffic-stat value=1102317
active-softwire-num,id=3,br-instance=traffic-stat value=0
dropped-ipv4-byte,id=3,br-instance=traffic-stat value=400419681
dropped-ipv4-bytes,id=3,br-instance=traffic-stat value=0
dropped-ipv4-fragments,id=3,br-instance=traffic-stat value=0
dropped-ipv4-packet,id=3,br-instance=traffic-stat value=2201411
dropped-ipv6-byte,id=3,br-instance=traffic-stat value=312384121
dropped-ipv6-packet,id=3,br-instance=traffic-stat value=2201273
hairpin-ipv4-bytes,id=3,br-instance=traffic-stat value=0
hairpin-ipv4-packets,id=3,br-instance=traffic-stat value=0
ipv6-fragments-bytes-reassembled,id=3,br-instance=traffic-stat value=0
ipv6-fragments-reassembled,id=3,br-instance=traffic-stat value=0
rcvd-ipv4-byte,id=3,br-instance=traffic-stat value=156071345
rcvd-ipv4-packet,id=3,br-instance=traffic-stat value=1099102
rcvd-ipv6-byte,id=3,br-instance=traffic-stat value=200219746
rcvd-ipv6-packet,id=3,br-instance=traffic-stat value=1100132
sent-ipv4-byte,id=3,br-instance=traffic-stat value=156211360
sent-ipv4-packet,id=3,br-instance=traffic-stat value=1100080
sent-ipv6-byte,id=3,br-instance=traffic-stat value=200033470
sent-ipv6-packet,id=3,br-instance=traffic-stat value=1099085
active-softwire-num,id=1,br-instance=traffic-stat value=0
dropped-ipv4-byte,id=1,br-instance=traffic-stat value=398769311
dropped-ipv4-bytes,id=1,br-instance=traffic-stat value=0
dropped-ipv4-fragments,id=1,br-instance=traffic-stat value=0
dropped-ipv4-packet,id=1,br-instance=traffic-stat value=2192340
dropped-ipv6-byte,id=1,br-instance=traffic-stat value=311097479
dropped-ipv6-packet,id=1,br-instance=traffic-stat value=2192222
hairpin-ipv4-bytes,id=1,br-instance=traffic-stat value=0
hairpin-ipv4-packets,id=1,br-instance=traffic-stat value=0
ipv6-fragments-bytes-reassembled,id=1,br-instance=traffic-stat value=0
ipv6-fragments-reassembled,id=1,br-instance=traffic-stat value=0
rcvd-ipv4-byte,id=1,br-instance=traffic-stat value=155842299
rcvd-ipv4-packet,id=1,br-instance=traffic-stat value=1097489
rcvd-ipv6-byte,id=1,br-instance=traffic-stat value=198863482
rcvd-ipv6-packet,id=1,br-instance=traffic-stat value=1092680
sent-ipv4-byte,id=1,br-instance=traffic-stat value=155153176
sent-ipv4-packet,id=1,br-instance=traffic-stat value=1092628
sent-ipv6-byte,id=1,br-instance=traffic-stat value=199739904
sent-ipv6-packet,id=1,br-instance=traffic-stat value=1097472
active-softwire-num,id=4,br-instance=traffic-stat value=0
dropped-ipv4-byte,id=4,br-instance=traffic-stat value=565506892
dropped-ipv4-bytes,id=4,br-instance=traffic-stat value=0
dropped-ipv4-fragments,id=4,br-instance=traffic-stat value=0
dropped-ipv4-packet,id=4,br-instance=traffic-stat value=2915951
dropped-ipv6-byte,id=4,br-instance=traffic-stat value=478091202
dropped-ipv6-packet,id=4,br-instance=traffic-stat value=2915890
hairpin-ipv4-bytes,id=4,br-instance=traffic-stat value=0
hairpin-ipv4-packets,id=4,br-instance=traffic-stat value=0
ipv6-fragments-bytes-reassembled,id=4,br-instance=traffic-stat value=0
ipv6-fragments-reassembled,id=4,br-instance=traffic-stat value=0
rcvd-ipv4-byte,id=4,br-instance=traffic-stat value=154740789
rcvd-ipv4-packet,id=4,br-instance=traffic-stat value=1089732
rcvd-ipv6-byte,id=4,br-instance=traffic-stat value=367015623
rcvd-ipv6-packet,id=4,br-instance=traffic-stat value=1824079
sent-ipv4-byte,id=4,br-instance=traffic-stat value=155359076
sent-ipv4-packet,id=4,br-instance=traffic-stat value=1094078
sent-ipv6-byte,id=4,br-instance=traffic-stat value=198327766
sent-ipv6-packet,id=4,br-instance=traffic-stat value=1089713
active-softwire-num,id=5,br-instance=traffic-stat value=0
dropped-ipv4-byte,id=5,br-instance=traffic-stat value=397725153
dropped-ipv4-bytes,id=5,br-instance=traffic-stat value=0
dropped-ipv4-fragments,id=5,br-instance=traffic-stat value=0
dropped-ipv4-packet,id=5,br-instance=traffic-stat value=2186578
dropped-ipv6-byte,id=5,br-instance=traffic-stat value=310286799
dropped-ipv6-packet,id=5,br-instance=traffic-stat value=2186529
hairpin-ipv4-bytes,id=5,br-instance=traffic-stat value=0
hairpin-ipv4-packets,id=5,br-instance=traffic-stat value=0
ipv6-fragments-bytes-reassembled,id=5,br-instance=traffic-stat value=0
ipv6-fragments-reassembled,id=5,br-instance=traffic-stat value=0
rcvd-ipv4-byte,id=5,br-instance=traffic-stat value=154646517
rcvd-ipv4-packet,id=5,br-instance=traffic-stat value=1089068
rcvd-ipv6-byte,id=5,br-instance=traffic-stat value=199355776
rcvd-ipv6-packet,id=5,br-instance=traffic-stat value=1095384
sent-ipv4-byte,id=5,br-instance=traffic-stat value=155537286
sent-ipv4-packet,id=5,br-instance=traffic-stat value=1095333
sent-ipv6-byte,id=5,br-instance=traffic-stat value=198207282
sent-ipv6-packet,id=5,br-instance=traffic-stat value=1089051
mwiget commented 6 years ago

Turns out, the shell script based conversion from xpath to influxdb rest format works equally well and without any change when using another shema: snabb-softwire-v2:

snabb config get-state -s snabb-softwire-v2 -f xpath $HOSTNAME / \
      | tr '/' ' ' | tr '[|]' ' ' | awk '{print $4 "," $2 "," $1 "=" $3 " value=" $5}' \
      |grep -v 'value=$' \
      | curl -i -XPOST 'http://influxdb:8086/write?db=lwaftr' --data-binary @-
mwiget commented 6 years ago

Adding an example output using snabb-softwire-v2 schema. The device key contains the interface name, making it very easy to select individual interfaces or stack them in Grafana.

screenshot 2018-03-21 12 40 42

~ # snabb config get-state -s snabb-softwire-v2 -f xpath lwaftr1 / | tr '/' ' ' | tr '[|]' ' ' | awk '{print $4 "," $2 "," $1 "=" $3 " value=" $5}' \
>       |grep -v 'value=$'
drop-all-ipv4-iface-bytes,device=eth4,instance=softwire-state value=14284
drop-all-ipv4-iface-packets,device=eth4,instance=softwire-state value=98
drop-all-ipv6-iface-bytes,device=eth4,instance=softwire-state value=10552
drop-all-ipv6-iface-packets,device=eth4,instance=softwire-state value=88
drop-bad-checksum-icmpv4-bytes,device=eth4,instance=softwire-state value=0
drop-bad-checksum-icmpv4-packets,device=eth4,instance=softwire-state value=0
drop-in-by-policy-icmpv4-bytes,device=eth4,instance=softwire-state value=0
drop-in-by-policy-icmpv4-packets,device=eth4,instance=softwire-state value=0
drop-in-by-policy-icmpv6-bytes,device=eth4,instance=softwire-state value=0
drop-in-by-policy-icmpv6-packets,device=eth4,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-bytes,device=eth4,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-packets,device=eth4,instance=softwire-state value=0
drop-ipv4-frag-disabled,device=eth4,instance=softwire-state value=0
drop-ipv4-frag-invalid-reassembly,device=eth4,instance=softwire-state value=0
drop-ipv4-frag-random-evicted,device=eth4,instance=softwire-state value=0
drop-ipv6-frag-disabled,device=eth4,instance=softwire-state value=0
drop-ipv6-frag-invalid-reassembly,device=eth4,instance=softwire-state value=0
drop-ipv6-frag-random-evicted,device=eth4,instance=softwire-state value=0
drop-misplaced-not-ipv4-bytes,device=eth4,instance=softwire-state value=14284
drop-misplaced-not-ipv4-packets,device=eth4,instance=softwire-state value=98
drop-misplaced-not-ipv6-bytes,device=eth4,instance=softwire-state value=9782
drop-misplaced-not-ipv6-packets,device=eth4,instance=softwire-state value=81
drop-no-dest-softwire-ipv4-bytes,device=eth4,instance=softwire-state value=0
drop-no-dest-softwire-ipv4-packets,device=eth4,instance=softwire-state value=0
drop-no-source-softwire-ipv6-bytes,device=eth4,instance=softwire-state value=0
drop-no-source-softwire-ipv6-packets,device=eth4,instance=softwire-state value=0
drop-out-by-policy-icmpv4-packets,device=eth4,instance=softwire-state value=0
drop-out-by-policy-icmpv6-packets,device=eth4,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-bytes,device=eth4,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-packets,device=eth4,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-bytes,device=eth4,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-packets,device=eth4,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-bytes,device=eth4,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-packets,device=eth4,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-bytes,device=eth4,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-packets,device=eth4,instance=softwire-state value=0
drop-ttl-zero-ipv4-bytes,device=eth4,instance=softwire-state value=0
drop-ttl-zero-ipv4-packets,device=eth4,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-bytes,device=eth4,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-packets,device=eth4,instance=softwire-state value=0
drop-unknown-protocol-ipv6-bytes,device=eth4,instance=softwire-state value=770
drop-unknown-protocol-ipv6-packets,device=eth4,instance=softwire-state value=7
hairpin-ipv4-bytes,device=eth4,instance=softwire-state value=0
hairpin-ipv4-packets,device=eth4,instance=softwire-state value=0
in-ipv4-bytes,device=eth4,instance=softwire-state value=8946
in-ipv4-frag-needs-reassembly,device=eth4,instance=softwire-state value=0
in-ipv4-frag-reassembled,device=eth4,instance=softwire-state value=0
in-ipv4-frag-reassembly-unneeded,device=eth4,instance=softwire-state value=170
in-ipv4-packets,device=eth4,instance=softwire-state value=63
in-ipv6-bytes,device=eth4,instance=softwire-state value=770
in-ipv6-frag-needs-reassembly,device=eth4,instance=softwire-state value=0
in-ipv6-frag-reassembled,device=eth4,instance=softwire-state value=0
in-ipv6-frag-reassembly-unneeded,device=eth4,instance=softwire-state value=108
in-ipv6-packets,device=eth4,instance=softwire-state value=7
ingress-packet-drops,device=eth4,instance=softwire-state value=0
memuse-ipv4-frag-reassembly-buffer,device=eth4,instance=softwire-state value=463482888
memuse-ipv6-frag-reassembly-buffer,device=eth4,instance=softwire-state value=464549592
out-icmpv4-bytes,device=eth4,instance=softwire-state value=0
out-icmpv4-packets,device=eth4,instance=softwire-state value=0
out-icmpv6-bytes,device=eth4,instance=softwire-state value=0
out-icmpv6-packets,device=eth4,instance=softwire-state value=0
out-ipv4-bytes,device=eth4,instance=softwire-state value=0
out-ipv4-frag,device=eth4,instance=softwire-state value=0
out-ipv4-frag-not,device=eth4,instance=softwire-state value=9
out-ipv4-packets,device=eth4,instance=softwire-state value=0
out-ipv6-bytes,device=eth4,instance=softwire-state value=11466
out-ipv6-frag,device=eth4,instance=softwire-state value=0
out-ipv6-frag-not,device=eth4,instance=softwire-state value=72
out-ipv6-packets,device=eth4,instance=softwire-state value=63
drop-all-ipv4-iface-bytes,device=eth0,instance=softwire-state value=814507
drop-all-ipv4-iface-packets,device=eth0,instance=softwire-state value=849
drop-all-ipv6-iface-bytes,device=eth0,instance=softwire-state value=4083757
drop-all-ipv6-iface-packets,device=eth0,instance=softwire-state value=1158
drop-bad-checksum-icmpv4-bytes,device=eth0,instance=softwire-state value=0
drop-bad-checksum-icmpv4-packets,device=eth0,instance=softwire-state value=0
drop-in-by-policy-icmpv4-bytes,device=eth0,instance=softwire-state value=0
drop-in-by-policy-icmpv4-packets,device=eth0,instance=softwire-state value=0
drop-in-by-policy-icmpv6-bytes,device=eth0,instance=softwire-state value=0
drop-in-by-policy-icmpv6-packets,device=eth0,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-bytes,device=eth0,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-packets,device=eth0,instance=softwire-state value=0
drop-ipv4-frag-disabled,device=eth0,instance=softwire-state value=0
drop-ipv4-frag-invalid-reassembly,device=eth0,instance=softwire-state value=0
drop-ipv4-frag-random-evicted,device=eth0,instance=softwire-state value=0
drop-ipv6-frag-disabled,device=eth0,instance=softwire-state value=0
drop-ipv6-frag-invalid-reassembly,device=eth0,instance=softwire-state value=0
drop-ipv6-frag-random-evicted,device=eth0,instance=softwire-state value=0
drop-misplaced-not-ipv4-bytes,device=eth0,instance=softwire-state value=43424
drop-misplaced-not-ipv4-packets,device=eth0,instance=softwire-state value=264
drop-misplaced-not-ipv6-bytes,device=eth0,instance=softwire-state value=4083317
drop-misplaced-not-ipv6-packets,device=eth0,instance=softwire-state value=1154
drop-no-dest-softwire-ipv4-bytes,device=eth0,instance=softwire-state value=771083
drop-no-dest-softwire-ipv4-packets,device=eth0,instance=softwire-state value=585
drop-no-source-softwire-ipv6-bytes,device=eth0,instance=softwire-state value=0
drop-no-source-softwire-ipv6-packets,device=eth0,instance=softwire-state value=0
drop-out-by-policy-icmpv4-packets,device=eth0,instance=softwire-state value=585
drop-out-by-policy-icmpv6-packets,device=eth0,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-bytes,device=eth0,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-packets,device=eth0,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-bytes,device=eth0,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-packets,device=eth0,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-bytes,device=eth0,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-packets,device=eth0,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-bytes,device=eth0,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-packets,device=eth0,instance=softwire-state value=0
drop-ttl-zero-ipv4-bytes,device=eth0,instance=softwire-state value=0
drop-ttl-zero-ipv4-packets,device=eth0,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-bytes,device=eth0,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-packets,device=eth0,instance=softwire-state value=0
drop-unknown-protocol-ipv6-bytes,device=eth0,instance=softwire-state value=440
drop-unknown-protocol-ipv6-packets,device=eth0,instance=softwire-state value=4
hairpin-ipv4-bytes,device=eth0,instance=softwire-state value=0
hairpin-ipv4-packets,device=eth0,instance=softwire-state value=0
in-ipv4-bytes,device=eth0,instance=softwire-state value=802323
in-ipv4-frag-needs-reassembly,device=eth0,instance=softwire-state value=0
in-ipv4-frag-reassembled,device=eth0,instance=softwire-state value=0
in-ipv4-frag-reassembly-unneeded,device=eth0,instance=softwire-state value=1089
in-ipv4-packets,device=eth0,instance=softwire-state value=805
in-ipv6-bytes,device=eth0,instance=softwire-state value=440
in-ipv6-frag-needs-reassembly,device=eth0,instance=softwire-state value=0
in-ipv6-frag-reassembled,device=eth0,instance=softwire-state value=0
in-ipv6-frag-reassembly-unneeded,device=eth0,instance=softwire-state value=1189
in-ipv6-packets,device=eth0,instance=softwire-state value=4
ingress-packet-drops,device=eth0,instance=softwire-state value=0
memuse-ipv4-frag-reassembly-buffer,device=eth0,instance=softwire-state value=463482888
memuse-ipv6-frag-reassembly-buffer,device=eth0,instance=softwire-state value=464549592
out-icmpv4-bytes,device=eth0,instance=softwire-state value=0
out-icmpv4-packets,device=eth0,instance=softwire-state value=0
out-icmpv6-bytes,device=eth0,instance=softwire-state value=0
out-icmpv6-packets,device=eth0,instance=softwire-state value=0
out-ipv4-bytes,device=eth0,instance=softwire-state value=0
out-ipv4-frag,device=eth0,instance=softwire-state value=0
out-ipv4-frag-not,device=eth0,instance=softwire-state value=9
out-ipv4-packets,device=eth0,instance=softwire-state value=0
out-ipv6-bytes,device=eth0,instance=softwire-state value=40040
out-ipv6-frag,device=eth0,instance=softwire-state value=0
out-ipv6-frag-not,device=eth0,instance=softwire-state value=229
out-ipv6-packets,device=eth0,instance=softwire-state value=220
drop-all-ipv4-iface-bytes,device=eth2,instance=softwire-state value=2748
drop-all-ipv4-iface-packets,device=eth2,instance=softwire-state value=34
drop-all-ipv6-iface-bytes,device=eth2,instance=softwire-state value=1412
drop-all-ipv6-iface-packets,device=eth2,instance=softwire-state value=22
drop-bad-checksum-icmpv4-bytes,device=eth2,instance=softwire-state value=0
drop-bad-checksum-icmpv4-packets,device=eth2,instance=softwire-state value=0
drop-in-by-policy-icmpv4-bytes,device=eth2,instance=softwire-state value=0
drop-in-by-policy-icmpv4-packets,device=eth2,instance=softwire-state value=0
drop-in-by-policy-icmpv6-bytes,device=eth2,instance=softwire-state value=0
drop-in-by-policy-icmpv6-packets,device=eth2,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-bytes,device=eth2,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-packets,device=eth2,instance=softwire-state value=0
drop-ipv4-frag-disabled,device=eth2,instance=softwire-state value=0
drop-ipv4-frag-invalid-reassembly,device=eth2,instance=softwire-state value=0
drop-ipv4-frag-random-evicted,device=eth2,instance=softwire-state value=0
drop-ipv6-frag-disabled,device=eth2,instance=softwire-state value=0
drop-ipv6-frag-invalid-reassembly,device=eth2,instance=softwire-state value=0
drop-ipv6-frag-random-evicted,device=eth2,instance=softwire-state value=0
drop-misplaced-not-ipv4-bytes,device=eth2,instance=softwire-state value=2748
drop-misplaced-not-ipv4-packets,device=eth2,instance=softwire-state value=34
drop-misplaced-not-ipv6-bytes,device=eth2,instance=softwire-state value=752
drop-misplaced-not-ipv6-packets,device=eth2,instance=softwire-state value=16
drop-no-dest-softwire-ipv4-bytes,device=eth2,instance=softwire-state value=0
drop-no-dest-softwire-ipv4-packets,device=eth2,instance=softwire-state value=0
drop-no-source-softwire-ipv6-bytes,device=eth2,instance=softwire-state value=0
drop-no-source-softwire-ipv6-packets,device=eth2,instance=softwire-state value=0
drop-out-by-policy-icmpv4-packets,device=eth2,instance=softwire-state value=0
drop-out-by-policy-icmpv6-packets,device=eth2,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-bytes,device=eth2,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-packets,device=eth2,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-bytes,device=eth2,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-packets,device=eth2,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-bytes,device=eth2,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-packets,device=eth2,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-bytes,device=eth2,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-packets,device=eth2,instance=softwire-state value=0
drop-ttl-zero-ipv4-bytes,device=eth2,instance=softwire-state value=0
drop-ttl-zero-ipv4-packets,device=eth2,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-bytes,device=eth2,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-packets,device=eth2,instance=softwire-state value=0
drop-unknown-protocol-ipv6-bytes,device=eth2,instance=softwire-state value=660
drop-unknown-protocol-ipv6-packets,device=eth2,instance=softwire-state value=6
hairpin-ipv4-bytes,device=eth2,instance=softwire-state value=0
hairpin-ipv4-packets,device=eth2,instance=softwire-state value=0
in-ipv4-bytes,device=eth2,instance=softwire-state value=0
in-ipv4-frag-needs-reassembly,device=eth2,instance=softwire-state value=0
in-ipv4-frag-reassembled,device=eth2,instance=softwire-state value=0
in-ipv4-frag-reassembly-unneeded,device=eth2,instance=softwire-state value=42
in-ipv4-packets,device=eth2,instance=softwire-state value=0
in-ipv6-bytes,device=eth2,instance=softwire-state value=660
in-ipv6-frag-needs-reassembly,device=eth2,instance=softwire-state value=0
in-ipv6-frag-reassembled,device=eth2,instance=softwire-state value=0
in-ipv6-frag-reassembly-unneeded,device=eth2,instance=softwire-state value=41
in-ipv6-packets,device=eth2,instance=softwire-state value=6
ingress-packet-drops,device=eth2,instance=softwire-state value=0
memuse-ipv4-frag-reassembly-buffer,device=eth2,instance=softwire-state value=463482888
memuse-ipv6-frag-reassembly-buffer,device=eth2,instance=softwire-state value=464549592
out-icmpv4-bytes,device=eth2,instance=softwire-state value=0
out-icmpv4-packets,device=eth2,instance=softwire-state value=0
out-icmpv6-bytes,device=eth2,instance=softwire-state value=0
out-icmpv6-packets,device=eth2,instance=softwire-state value=0
out-ipv4-bytes,device=eth2,instance=softwire-state value=0
out-ipv4-frag,device=eth2,instance=softwire-state value=0
out-ipv4-frag-not,device=eth2,instance=softwire-state value=8
out-ipv4-packets,device=eth2,instance=softwire-state value=0
out-ipv6-bytes,device=eth2,instance=softwire-state value=0
out-ipv6-frag,device=eth2,instance=softwire-state value=0
out-ipv6-frag-not,device=eth2,instance=softwire-state value=9
out-ipv6-packets,device=eth2,instance=softwire-state value=0
drop-all-ipv4-iface-bytes,device=eth1,instance=softwire-state value=14214
drop-all-ipv4-iface-packets,device=eth1,instance=softwire-state value=97
drop-all-ipv6-iface-bytes,device=eth1,instance=softwire-state value=10442
drop-all-ipv6-iface-packets,device=eth1,instance=softwire-state value=87
drop-bad-checksum-icmpv4-bytes,device=eth1,instance=softwire-state value=0
drop-bad-checksum-icmpv4-packets,device=eth1,instance=softwire-state value=0
drop-in-by-policy-icmpv4-bytes,device=eth1,instance=softwire-state value=0
drop-in-by-policy-icmpv4-packets,device=eth1,instance=softwire-state value=0
drop-in-by-policy-icmpv6-bytes,device=eth1,instance=softwire-state value=0
drop-in-by-policy-icmpv6-packets,device=eth1,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-bytes,device=eth1,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-packets,device=eth1,instance=softwire-state value=0
drop-ipv4-frag-disabled,device=eth1,instance=softwire-state value=0
drop-ipv4-frag-invalid-reassembly,device=eth1,instance=softwire-state value=0
drop-ipv4-frag-random-evicted,device=eth1,instance=softwire-state value=0
drop-ipv6-frag-disabled,device=eth1,instance=softwire-state value=0
drop-ipv6-frag-invalid-reassembly,device=eth1,instance=softwire-state value=0
drop-ipv6-frag-random-evicted,device=eth1,instance=softwire-state value=0
drop-misplaced-not-ipv4-bytes,device=eth1,instance=softwire-state value=14214
drop-misplaced-not-ipv4-packets,device=eth1,instance=softwire-state value=97
drop-misplaced-not-ipv6-bytes,device=eth1,instance=softwire-state value=9782
drop-misplaced-not-ipv6-packets,device=eth1,instance=softwire-state value=81
drop-no-dest-softwire-ipv4-bytes,device=eth1,instance=softwire-state value=0
drop-no-dest-softwire-ipv4-packets,device=eth1,instance=softwire-state value=0
drop-no-source-softwire-ipv6-bytes,device=eth1,instance=softwire-state value=0
drop-no-source-softwire-ipv6-packets,device=eth1,instance=softwire-state value=0
drop-out-by-policy-icmpv4-packets,device=eth1,instance=softwire-state value=0
drop-out-by-policy-icmpv6-packets,device=eth1,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-bytes,device=eth1,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-packets,device=eth1,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-bytes,device=eth1,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-packets,device=eth1,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-bytes,device=eth1,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-packets,device=eth1,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-bytes,device=eth1,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-packets,device=eth1,instance=softwire-state value=0
drop-ttl-zero-ipv4-bytes,device=eth1,instance=softwire-state value=0
drop-ttl-zero-ipv4-packets,device=eth1,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-bytes,device=eth1,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-packets,device=eth1,instance=softwire-state value=0
drop-unknown-protocol-ipv6-bytes,device=eth1,instance=softwire-state value=660
drop-unknown-protocol-ipv6-packets,device=eth1,instance=softwire-state value=6
hairpin-ipv4-bytes,device=eth1,instance=softwire-state value=0
hairpin-ipv4-packets,device=eth1,instance=softwire-state value=0
in-ipv4-bytes,device=eth1,instance=softwire-state value=8946
in-ipv4-frag-needs-reassembly,device=eth1,instance=softwire-state value=0
in-ipv4-frag-reassembled,device=eth1,instance=softwire-state value=0
in-ipv4-frag-reassembly-unneeded,device=eth1,instance=softwire-state value=169
in-ipv4-packets,device=eth1,instance=softwire-state value=63
in-ipv6-bytes,device=eth1,instance=softwire-state value=660
in-ipv6-frag-needs-reassembly,device=eth1,instance=softwire-state value=0
in-ipv6-frag-reassembled,device=eth1,instance=softwire-state value=0
in-ipv6-frag-reassembly-unneeded,device=eth1,instance=softwire-state value=106
in-ipv6-packets,device=eth1,instance=softwire-state value=6
ingress-packet-drops,device=eth1,instance=softwire-state value=0
memuse-ipv4-frag-reassembly-buffer,device=eth1,instance=softwire-state value=463482888
memuse-ipv6-frag-reassembly-buffer,device=eth1,instance=softwire-state value=464549592
out-icmpv4-bytes,device=eth1,instance=softwire-state value=0
out-icmpv4-packets,device=eth1,instance=softwire-state value=0
out-icmpv6-bytes,device=eth1,instance=softwire-state value=0
out-icmpv6-packets,device=eth1,instance=softwire-state value=0
out-ipv4-bytes,device=eth1,instance=softwire-state value=0
out-ipv4-frag,device=eth1,instance=softwire-state value=0
out-ipv4-frag-not,device=eth1,instance=softwire-state value=9
out-ipv4-packets,device=eth1,instance=softwire-state value=0
out-ipv6-bytes,device=eth1,instance=softwire-state value=11466
out-ipv6-frag,device=eth1,instance=softwire-state value=0
out-ipv6-frag-not,device=eth1,instance=softwire-state value=72
out-ipv6-packets,device=eth1,instance=softwire-state value=63
drop-all-ipv4-iface-bytes,device=eth3,instance=softwire-state value=36214
drop-all-ipv4-iface-packets,device=eth3,instance=softwire-state value=219
drop-all-ipv6-iface-bytes,device=eth3,instance=softwire-state value=27572
drop-all-ipv6-iface-packets,device=eth3,instance=softwire-state value=208
drop-bad-checksum-icmpv4-bytes,device=eth3,instance=softwire-state value=0
drop-bad-checksum-icmpv4-packets,device=eth3,instance=softwire-state value=0
drop-in-by-policy-icmpv4-bytes,device=eth3,instance=softwire-state value=0
drop-in-by-policy-icmpv4-packets,device=eth3,instance=softwire-state value=0
drop-in-by-policy-icmpv6-bytes,device=eth3,instance=softwire-state value=0
drop-in-by-policy-icmpv6-packets,device=eth3,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-bytes,device=eth3,instance=softwire-state value=0
drop-in-by-rfc7596-icmpv4-packets,device=eth3,instance=softwire-state value=0
drop-ipv4-frag-disabled,device=eth3,instance=softwire-state value=0
drop-ipv4-frag-invalid-reassembly,device=eth3,instance=softwire-state value=0
drop-ipv4-frag-random-evicted,device=eth3,instance=softwire-state value=0
drop-ipv6-frag-disabled,device=eth3,instance=softwire-state value=0
drop-ipv6-frag-invalid-reassembly,device=eth3,instance=softwire-state value=0
drop-ipv6-frag-random-evicted,device=eth3,instance=softwire-state value=0
drop-misplaced-not-ipv4-bytes,device=eth3,instance=softwire-state value=36214
drop-misplaced-not-ipv4-packets,device=eth3,instance=softwire-state value=219
drop-misplaced-not-ipv6-bytes,device=eth3,instance=softwire-state value=26822
drop-misplaced-not-ipv6-packets,device=eth3,instance=softwire-state value=201
drop-no-dest-softwire-ipv4-bytes,device=eth3,instance=softwire-state value=0
drop-no-dest-softwire-ipv4-packets,device=eth3,instance=softwire-state value=0
drop-no-source-softwire-ipv6-bytes,device=eth3,instance=softwire-state value=0
drop-no-source-softwire-ipv6-packets,device=eth3,instance=softwire-state value=0
drop-out-by-policy-icmpv4-packets,device=eth3,instance=softwire-state value=0
drop-out-by-policy-icmpv6-packets,device=eth3,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-bytes,device=eth3,instance=softwire-state value=0
drop-over-mtu-but-dont-fragment-ipv4-packets,device=eth3,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-bytes,device=eth3,instance=softwire-state value=0
drop-over-rate-limit-icmpv6-packets,device=eth3,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-bytes,device=eth3,instance=softwire-state value=0
drop-over-time-but-not-hop-limit-icmpv6-packets,device=eth3,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-bytes,device=eth3,instance=softwire-state value=0
drop-too-big-type-but-not-code-icmpv6-packets,device=eth3,instance=softwire-state value=0
drop-ttl-zero-ipv4-bytes,device=eth3,instance=softwire-state value=0
drop-ttl-zero-ipv4-packets,device=eth3,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-bytes,device=eth3,instance=softwire-state value=0
drop-unknown-protocol-icmpv6-packets,device=eth3,instance=softwire-state value=0
drop-unknown-protocol-ipv6-bytes,device=eth3,instance=softwire-state value=750
drop-unknown-protocol-ipv6-packets,device=eth3,instance=softwire-state value=7
hairpin-ipv4-bytes,device=eth3,instance=softwire-state value=0
hairpin-ipv4-packets,device=eth3,instance=softwire-state value=0
in-ipv4-bytes,device=eth3,instance=softwire-state value=25986
in-ipv4-frag-needs-reassembly,device=eth3,instance=softwire-state value=0
in-ipv4-frag-reassembled,device=eth3,instance=softwire-state value=0
in-ipv4-frag-reassembly-unneeded,device=eth3,instance=softwire-state value=411
in-ipv4-packets,device=eth3,instance=softwire-state value=183
in-ipv6-bytes,device=eth3,instance=softwire-state value=750
in-ipv6-frag-needs-reassembly,device=eth3,instance=softwire-state value=0
in-ipv6-frag-reassembled,device=eth3,instance=softwire-state value=0
in-ipv6-frag-reassembly-unneeded,device=eth3,instance=softwire-state value=228
in-ipv6-packets,device=eth3,instance=softwire-state value=7
ingress-packet-drops,device=eth3,instance=softwire-state value=0
memuse-ipv4-frag-reassembly-buffer,device=eth3,instance=softwire-state value=463482888
memuse-ipv6-frag-reassembly-buffer,device=eth3,instance=softwire-state value=464549592
out-icmpv4-bytes,device=eth3,instance=softwire-state value=0
out-icmpv4-packets,device=eth3,instance=softwire-state value=0
out-icmpv6-bytes,device=eth3,instance=softwire-state value=0
out-icmpv6-packets,device=eth3,instance=softwire-state value=0
out-ipv4-bytes,device=eth3,instance=softwire-state value=0
out-ipv4-frag,device=eth3,instance=softwire-state value=0
out-ipv4-frag-not,device=eth3,instance=softwire-state value=9
out-ipv4-packets,device=eth3,instance=softwire-state value=0
out-ipv6-bytes,device=eth3,instance=softwire-state value=33306
out-ipv6-frag,device=eth3,instance=softwire-state value=0
out-ipv6-frag-not,device=eth3,instance=softwire-state value=192
out-ipv6-packets,device=eth3,instance=softwire-state value=183