improve observability for subscription and subscription cursor

risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.

https://go.risingwave.com/slack

Apache License 2.0

7k stars 575 forks source link

improve observability for subscription and subscription cursor #17992

Closed hzxa21 closed 3 weeks ago

hzxa21 commented 2 months ago

[ ] improve error logging for subscription cursor
[x] add metrics for subscription and cursor
- num of subscriptions
- num of valid cursors (per subscription)
- num of invalid cursors (per subscription)
- cursor errors
- cursor internal query duration
- declare/fetch/close cursor duration
- cursor lifecycle (e.g. how long the cursor has been created, how long since the last cursor fetch, ...)

hzxa21 commented 2 months ago

Feel free to add more metrics that can help @xxhZs