feat: track & display information about unconfirmed block pool & confirmation latency

[mistakia]

display the following information:

• [ ] Number of unconfirmed blocks per account
• [x] Number of accounts with unconfirmed blocks
• [x] Number of unconfirmed blocks by bucket
• [ ] Number of unconfirmed blocks by type
• [x] Confirmation latency for each bucket
• [ ] Confirmation latency for each account
• [ ] Sort accounts by number of unconfirmed blocks
• [ ] Sort accounts by oldest unconfirmed block

Core Tasks

• [x] https://github.com/mistakia/nanodb/pull/9
• [x] https://github.com/mistakia/nanodb/pull/8
• [x] https://github.com/mistakia/nanodb/pull/11
• [ ] feat: add nanodb endpoint for confirmation latency for each account?
• [x] https://github.com/mistakia/nano-community/pull/104
• [ ] add metrics to network section on homepage
• [ ] add tooltips for each bucket explaining the balance ranges
• [ ] add tooltips for each row in the bucket table with a detailed description
• [ ] use balance tier instead of buckets
• [ ] collapse balance tier ranges with relatively low number of unconfirmed blocks and confirmed blocks

Future Tasks

• [ ] set up redis (or similar) for improved performance for certain queries
• [ ] set up websocket to update page in real time
• [ ] split & filter metrics by tags
  • [ ] create account tags (https://github.com/mistakia/nano-community/discussions/100)

[mistakia]

I’m now saving confirmation latency for all confirmed blocks. I’ve added median confirmation latency to the nano.community network section as a first attempt at a simple single metric to describe confirmation latency (https://github.com/mistakia/nano-community/commit/e14ffb9ee7ab1429c47868449eb3ed1025ddbe2c). Also spun up a few endpoints to explore confirmation latency and the unconfirmed block pool, will follow up with a page to explore all this data.

Some work will be needed to improve the stability and performance of some queries. I also need to ensure that the bucketization is in parity with the reference implementation

API Endpoints:

Unconfirmed Accounts Summary

nano.community/api/nanodb/accounts/unconfirmed/summary

Returns the total number of accounts that have at least one unconfirmed block.

Filtered Unconfirmed Accounts

nano.community/api/nanodb/accounts/unconfirmed?[limit&offset&balance_min&balance_max&sort_by=unconfirmed_blocks&sort_order=desc]

Returns a list of accounts with unconfirmed blocks, filter by account balance with balance_min and balance_max, and sort by the number of unconfirmed_blocks or oldest_unconfirmed_block_timestamp.

Unconfirmed Blocks Summary

nano.community/api/nanodb/blocks/unconfirmed/summary

Returns the count of unconfirmed blocks by type/subtype as well as count by bucket

Confirmed Blocks Statistics

nano.community/api/nanodb/blocks/confirmed/summary?period=[1h|24h|7d|30d]

Returns median, minimum, and maximum confirmation latency statistics on all confirmed blocks over specified periods (1 hour, 24 hours, 7 days, 30 days), as well as the count of confirmed blocks, categorized into different balance buckets.