skupperproject / skupper-router

An application-layer router for Skupper networks
https://skupper.io
Apache License 2.0
14 stars 18 forks source link

Vanflow: Duplicate message delivery per distinct router path #1365

Open c-kruse opened 8 months ago

c-kruse commented 8 months ago

As discussed in the Skupper Team g chat, I am observing repeated delivery of vanflow messages. This was uncovered by an unrelated skupper collector bug. Thanks for following along @ted-ross! I suspect this issue is in the router, but I didn't know where to start trying to reproduce it without the control plane.

To reproduce:

skupper link create --namespace b token-a.yaml skupper token create --namespace b token-b.yaml

skupper link create --namespace c token-a.yaml skupper link create --namespace c token-b.yaml


* Deploy this rough draft vanflow logging utility to each namespace to tail the logs. [source](https://github.com/c-kruse/skupper/tree/vanflow-tool/cmd/vanflow-tool).

apiVersion: apps/v1 kind: Deployment metadata: name: vanflow-logging labels: app: vanflow-logging spec: replicas: 1 selector: matchLabels: app: vanflow-logging template: metadata: labels: app: vanflow-logging spec: containers:

jiridanek commented 8 months ago

This is probably a workaround for this?

c-kruse commented 8 months ago

This is probably a workaround for this?

* [Fixes phantom process records observed in the console UI skupper#1341](https://github.com/skupperproject/skupper/pull/1341)

They are related @jiridanek - but I'd hesitate to call either a workaround. The flow collector should be idempotent (fix in skupper/pull/1341), and from what I understand vanflow messages should be delivered only once to each consumer with some reliability regardless of van topology (the topic brought up in this issue.)

Karen-Schoener commented 3 months ago

Hi, I'm interested in investigating this ticket. If there's any concern / issue with me investigating this ticket, please do not hesitate to let me know. Thanks, Karen