fix: add exclude filter for otel duration and content_length

hypertrace / hypertrace-collector

OpenTelemetry collector distribution for Hypertrace platform

6 stars 5 forks source link

fix: add exclude filter for otel duration and content_length #113

Closed tim-mwangi closed 1 year ago

tim-mwangi commented 1 year ago

Description

Recently we started receiving agent metrics as well and otel go http and instrumentation send up duration and content_length metrics. However, they send up a metric object for each request which leads to a flood of metrics and the collector and prometheus server memory fills up quickly. We have added a filter processor to filter out these metrics.

Testing

Verified that the filter works locally

Checklist:

[✅ ] My changes generate no new warnings

tim-mwangi commented 1 year ago

We should strive to replace our existing metrics remover processor with the filter processor. I'm not sure if the None metric type or the logic we use to remove the Empty type metrics translates to a filter.