snowplow / snowbridge

For replicating streams across clouds, accounts and regions
Other
15 stars 7 forks source link

Add E2E latency metrics #379

Closed pondzix closed 5 days ago

pondzix commented 1 week ago

ref: PDP-1549

New E2E latency is calculated based on collector_tstamp field coming from Snowplow enriched data. It means E2E can be obtain from valid Snowplow events:

E2E latency = (target write timestamp) - (collector timestamp)

E2E metric can be enabled/disabled using new top-level confgiuration option metrics.enable_e2e_latency