numaproj / numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs
https://numaflow.numaproj.io
Apache License 2.0
1.01k stars 98 forks source link

chore: log vertex and pod name when raptor throws #1772

Closed KeranYang closed 1 week ago

KeranYang commented 1 week ago

Raptor relies on the total read metric to calculate the message processing rate. There is a case when a vertex never receives any messages and hence never emits the total read metric, making the metric unavailable. We need the log to confirm the root cause by including vertex/pod name.