Metrics - Micrometer Integration

[csviri]

Integrate micrometer to generate metrics about usage / execution. The goal is that there are now not only logs but meaningful metrics exposed about the execution.

[csviri]

https://micrometer.io/

[csviri]

Would be great to gather here the metrics we are interested in. Some which came to my mind:

• number of controller executions
• number of events processed
• controller execution durations
• number of custom resource managed
• retry related metrics

Feel free to add yours.

[jmrodri]

@csviri How would something like this integrate with prometheus on kubernetes? Most operators output their metrics to be scraped by a prometheus service to expose their items to the console.

[csviri]

@jmrodri The idea is that we would make it very easy to integrate with a metrics endpoint, thus to expose the metrics to http. Prometheus is supported by micrometer so I guess that would not be a hassle.

But ideally we would not be dependent on any framework (spring / quarkus / micronaut) but would make it very easy to integrate with them. So the controller is what exposes the metrics will be native to the desired framework.

[csviri]

An important part of this would be extensibility. So anybody should be able to add own metrics. The simplest way to do that (the metrics about the Custom Resource processing ) is just expose the micrometer api to the controller. So the user can add custom metrics directly to the controller implementation. What we should provide out of the box is probably metrics that are not necessary available from the controllers. Like threading related metrics, maybe some event handling. But also some basic standard metrics mentioned above that is makes sense for everybody.

[jmrodri]

/assign @laxmikantbpandhare

[metacosm]

Another project to look into is https://opentelemetry.io/

[jmrodri]

Another resources mentioned during community meeting: https://quarkus.io/guides/micrometer

[metacosm]

Seems like Micrometer is indeed the framework of choice to deal with metrics in Quarkus. This shouldn't prevent us from looking at opentelemetry but it seems more focused on tracing than metrics.

[laxmikantbpandhare]

Yes @metacosm - Micrometer is better choice as compare to OpenTelemetry. There are few differences like OpentTelemetry does not support dedicated times type, distribution summery type and also it does not have any naming conventions. OpenTelemetry is more focused on tracing while micrometer is built specifically for getting the metrics/usage of an application. OpenTelemetry would be useful to measure across many Micro-services as they hand off requests and you need to trace behavior, while Micrometer would be more useful for tracking a single application's performance and health.

[laxmikantbpandhare]

I am still looking for actual API's and services that both OpenTelemetry and Micrometer offers. I will share those details shortly.

[laxmikantbpandhare]

Raised PR #486