CORTX-29930: Enhance monitoring capability for control node

[mariyappanp]

Problem Statement

Add control node cluster cardinality and watch control node events

Design

CORTX-29930 - Enhance monitoring capability for control node

Coding

• [x] Coding conventions are followed and code is consistent

Testing

• [x] Unit and System Tests are added
• [x] Test Cases cover Happy Path, Non-Happy Path and Scalability
• [x] Testing was performed with RPM

test_results.txt

Review Checklist

• [x] PR is self reviewed
• [x] JIRA number/GitHub Issue added to PR
• [x] Jira and state/status is updated and JIRA is updated with PR link
• [x] Check if the description is clear and explained
• [ ] Is there a change in filename/package/module or signature? [Y/N]:
• [ ] If yes for above point, is a notification sent to all other cortx components? [Y/N]
• [ ] Side effects on other features (deployment/upgrade)? [Y/N]
• [ ] Dependencies on other component(s)? [Y/N]
• If yes for above point, post link to the corresponding PR.

Review Checklist

• [ ] Is perfline test run and the report with and without the changes updated in the PR? [Y/N]:

Documentation

Checklist for Author

• [ ] Changes done to WIKI / Confluence page / Quick Start Guide

[mariyappanp]

cortx>ha>v1>cluster_cardinality:{"num_nodes": 8, "node_list": ["d5bd40a41da44c8dbf90ce418453f711", "645fe1d98a774b0a9b1a5972c6857741", "2434adbe55f046c2a3ec219d04b720d3", "cad486c5d73d44de9413ebaf8e16c6b8", "099d7bf619e24591a3f01b00324ce18a", "4c38e91086d745cf9104798a2e96785b", "926e2fb713924aa8a5b156695206364c", "dd8d2ceb64444e6caeb5532753306263", "04539dd8be544c428c56d9b22baec91a"]}

Please check why num_nodes count is mismatched. it should be 9.

Looks like data/key was already there. And again mini provision was performed. And consul update happened(consul kv put) which I think overwrites the data. Initially, I have updated control node in cardinality and tested monitoring functionality. This test result file is not updated later. Before posting this PR, I have tested thoroughly and count is 9. I will update the test result file. @akash2144