chore(cprovider): next steps to gain confidence

[arajasek]

https://github.com/omni-network/omni/pull/1289 gave the relayer (through the cprovider) the ability to query historical state as needed in order to fetch attestations. This code is currently minimally exercised, since we store 14 days worth of attestations in a single state (#1343 proposes changing this). In order to gain full confidence in this code, we need to:

• [x] - add visualizations of the metrics collected in #1289 to our Grafana dashboards
• [x] - add alerts that would be triggered if the historical query code hits any BUGs, or has a very long lookback
• [x] - implement #1384 and see if things break :eyes:

[arajasek]

Next steps:

• Improve the collected metrics by:
  • splitting over chain version
  • specifying buckets
• Update visualizations & alerts to be based on chain version
• Pause the relayer to observe catchup