Network mapper now buffers incoming reports instead of handling them synchronously, and collects statistics on loads and drops

otterize / network-mapper

Map Kubernetes traffic: in-cluster, to the Internet, and to AWS IAM and export as text, intents, or an image

Apache License 2.0

612 stars 23 forks source link

Network mapper now buffers incoming reports instead of handling them synchronously, and collects statistics on loads and drops #196

Closed orishoshan closed 7 months ago

orishoshan commented 7 months ago

Previous to the PR, network sniffers and the Istio and Kafka watchers would report their data to the network mapper, which would then handle them synchronously. The network mapper now buffers a limited amount of reports in-memory (using a channel), and rejects more reports when the channel is full. This enables the network mapper to absorb peaks in reports.