otterize / network-mapper

Map Kubernetes traffic: in-cluster, to the Internet, and to AWS IAM and export as text, intents, or an image
Apache License 2.0
612 stars 23 forks source link

Support emitting map as an OpenTelemetry metric #140

Closed smithclay closed 11 months ago

smithclay commented 1 year ago

Several different monitoring and observability solutions (like Grafana tempo) can natively visualize maps from timeseries data that follows a specific format.

If network mapper emits a OpenTelemetry timeseries with from and to edges, the connections inferred from network-mapper can be easily visualized and used in external tools for performance, inventory, and observability use-cases.

AdaptiveStep commented 1 month ago

im trying to get this service-map into my tracing pipeline. Anyone got any good idea on how to send the servicemap as traces? Can it be converted somehow? I thought service-maps were supposed to be sent via traces?

orishoshan commented 1 month ago

The data here doesn't match 1:1 with traces, since they don't represent individual connections or requests, but rather the presence of any connection within a given time period.

See the configuration flags for the Helm chart for enabling this feature: https://docs.otterize.com/reference/network-mapper/helm-chart#opentelemetry-exporter-parameters The default metric value should work out of the box with OpenTelemetry Grafana Tempo.

AdaptiveStep commented 1 week ago

@orishoshan Ok! Thank you for your reply!

One last question: are the metrics the same format as the ones produced by the ServiceGraphConnector ?