search

NOAA-GSL / VxIngest

Other
2 stars 0 forks source link

Fix the ingest metrics scraper so that we get alerted when imports fail #290

Closed randytpierce closed 7 months ago

randytpierce commented 8 months ago

Issue 289 shows that imports were failing since Dec 19 and we did not get alerted. This is because the alerts are not working at the moment (there is a scraper problem). We need to fix this.

randytpierce commented 7 months ago

This is working now. The latest problem was that the metrics name used to include the hostname but when we are running from a temporary container the host name always changes. This caused the metrics .prom files to be uniq and it overwhelmed the textfile collector that the node exporter uses to collect the metrics. I removed the hostname part of the metrics name.