ScalaConsultants / mesmer

OpenTelemetry agent for Scala applications
https://mesmer.io
Apache License 2.0
71 stars 12 forks source link

Research: collector (post) processor for mesmer metrics attributes #387

Open lgajowy opened 2 years ago

lgajowy commented 2 years ago

An Opentelemetry Collector can be extended with a "processor": https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/processor/resourceprocessor/README.md. Such a processor can add/remove/modify attributes right before the metric data is exported to a backend, eg. a prometheus instance.

We can sometimes have attributes that can have a high cardinality, which seems to be problematic in the backend. For example, a request path attribute of an Akka Http request can be infinite:

We could aggregate such paths to one path attribute value: foo/bar/{id}.

To do

lgajowy commented 2 years ago

@adamgadomski I'm removing it from the scope of 0.8.0. We don't need this right now. We should focus on ZIO instead. Please reinstate the issue in the 0.8.0 milestone if you think otherwise.