tulip / oplogtoredis

Publish MongoDB oplog entries to Redis
Apache License 2.0
38 stars 9 forks source link

Add metric for saturation (backlog count) #82

Open eparker-tulip opened 2 months ago

eparker-tulip commented 2 months ago

Adds otr_saturation_delta as a way to measure if OTR is struggling to keep up. It is the number of incoming events - outgoing, i.e., backlog. Once more data is collected, this could be presented in a different way if needed.

torywheelwright commented 1 month ago

As written, is this meaningfully different than the metric that tracks the buffer capacity? In either case it's essentially a measure of the number of messages "in" oplogtoredis. Is there a way that we can measure this in an absolute sense, so that we can see where we're at in utilization even if we haven't started bottlenecking anywhere (which is what would cause us to see some signal in the buffer capacity metric)?