shatteredsilicon / ssm-submodules

GNU Affero General Public License v3.0
0 stars 2 forks source link

When monitoring RDS nodes, having one node without Enhanced Monitoring prevents ALL RDS telemetry from being gathered for ALL monitored nodes #204

Closed gordan-bobic closed 9 months ago

gordan-bobic commented 9 months ago

Setup:

Result:

Additional:

If I purge and re-set everything, I can re-add the other nodes to make things work again, but that isn't a workable solution because we lose all accumulated telemetry.

Enabling enhanced monitoring on that one node, makes everything start working again, so there is a check somewhere that is global for enhanced monitoring when it should be per monitored server.

oblitorum commented 9 months ago

The problem "one enhanced-monitoring-disabled node prevents all nodes' temlemetry" was fixed with this PR -> https://github.com/shatteredsilicon/rds_exporter/pull/9

And I added another patch https://github.com/shatteredsilicon/ssm-managed/pull/34 to make sure the further node deletion operations on the "Monitored instances" page works if previous operation somehow failed.