[SPIKE][OBSERVABILITY][ON-CHAIN] Monitor on-chain events and expose Prometheus metrics

[philipandersson]

Overview

What? Monitor on-chain events and expose Prometheus metrics

How?

• Black box service that monitors on-chain events or events we anticipate to happen
  • Push (default) → We might get a notification/webhook
  • Pull (fallback) → We might need to index and/or query data

Why? We need to have a unified way to monitor what happens on-chain, i.e. when the balance of multisig wallets, Sentinels etc. drops below certain thresholds. Adding monitoring and alerting is currently ad-hoc where we keep reinventing the wheel (Centralizing knowledge of what we have set up)

Deadline: Cycle 1 2024

Technical Design Document (TDD):

Acceptance criteria

• [ ] Full acceptance criteria can be found in https://www.notion.so/superfluidhq/Needs-to-track-all-events-and-be-configurable-for-networks-on-chain-monitoring-0c592077d6bc40f886e02eec39cf3f61?pvs=4
• [ ] Satisfies entire acceptance criteria
• [ ] Is the appetite for the spike exhausted?
• [ ] Documentation updated
• [ ] Presentation to stakeholders
• [ ] Output is a TDD
• [ ] Recommendation on next steps

Links/Resources

• Maintenance task

Readiness criteria

• [ ] Descriptive title
• [ ] What?
• [ ] Why?
• [ ] How?
• [ ] Deadline: If not a part of an epic
• [ ] Priority: Reflected as order on the board, walking the board from the top and right
• [ ] Assignee
• [ ] Labels
• [ ] Link to epic: If belonging to an epic

[mmd-afegbua]

RFC (WIP): https://www.notion.so/superfluidhq/edc1845ec0ef4b83a2d27fb767f992d2?v=5a9ee2b933ec4bc0988ee80fa7adaffa&p=7759aeb4e1d340ea957de46cd6b6fb03&pm=s