collect network usage - Githubissues

majst01 commented 4 years ago

In order to be able to collect network usage data i propose the following solution:

install node-exporter on the firewall which exposes:
- node_network_receive_packets_total{device=vrf123} 12234
- node_network_transmit_packets_total{device=vrf123} 12234
firewall-policy-controller will scrape these and store them in a CRD MetalNetworkStatistics ?
kube-counter can then collect them as it does for pods and volumes.

We should add a flag to every network in metal-api the specify if this network must be accounted or not.

node-exporter is already installed.

To scrape the output of node-exporter, the textparse package of prometheus is able to parse the metrics: https://github.com/prometheus/prometheus/blob/master/pkg/textparse

@chbmuc @Gerrit91 @mwindower

mwennrich commented 4 years ago

just a reminder: network usage gets also collected on the switch interfaces

majst01 commented 4 years ago

Yes but scraping these metrics from the switch and put them into relation to a actual cluster is difficult.

metal-stack / firewall-controller