Kafka watcher reads logs since last read, instead of following logs

otterize / network-mapper

Map Kubernetes traffic: in-cluster, to the Internet, and to AWS IAM and export as text, intents, or an image

Apache License 2.0

612 stars 23 forks source link

Kafka watcher reads logs since last read, instead of following logs #90

Closed orishoshan closed 1 year ago

orishoshan commented 1 year ago

Previously, the Kafka watcher would follow logs, and if the connection was interrupted, it would fail to detect it and just hang forever. It now reads a small amount of logs at a time and continues from where it left off each time, with a short timeout to detect dead connections.