Internal metrics reported by carbon-c-relay seems to be wrong

[ervikrant06]

Plotting internal metrics of carbon-c-relay and go-carbon.. Pictures are showing stacked output. carbon-c-relay it showing total number of received metrics to be 1.5B but the total number of metrics reported by go-carbon is approx 5-6M I believe go-carbon reporting correct state.

Carbon-c-relay stat

` go-carbon stat

Some info about setup:

Whole setup is running in K8s

• Three POD of carbon-c-relay running. Each of the backend of carbon-c-relay is a K8s service. Each K8s service has 3 go-carbon PODs running on same node that means 9 go-carbon PODs spread across 3 nodes.

cluster graphite
        fnv1a_ch
                cache-testsvc-1:2003
                cache-testsvc-2:2003
                cache-testsvc-3:2003
    ;
listen
        type linemode
                2003 proto tcp
   ;
match
    *
    send to graphite
  ;

[grobian]

you need to use nonNegativeDerivative with c-relay's stats

[ervikrant06]

Thanks. It worked.