SidestreamIsNotRunning - Githubissues

m-lab / scraper

Scrape experiment data off of MLab nodes and upload it to Google Cloud Storage

Apache License 2.0

5 stars 5 forks source link

SidestreamIsNotRunning #290

Closed measurementlab closed 6 years ago

measurementlab commented 6 years ago

Alertmanager URL: https://alertmanager.mlab-oti.measurementlab.net

firing https://prometheus.mlab-oti.measurementlab.net/graph?g0.expr=sum_over_time%28up%7Bservice%3D%22sidestream%22%7D%5B10m%5D%29+%3D%3D+0+and+ON%28machine%29+sum_over_time%28probe_success%7Bservice%3D%22ssh806%22%7D%5B20m%5D%29+%2F+20+%3E%3D+0.9+unless+ON%28machine%29+lame_duck_node+%3D%3D+1&g0.tab=1

Labels:
- alertname = SidestreamIsNotRunning
- experiment = npad.iupui
- instance = npad.iupui.mlab1.iad01.measurement-lab.org:9090
- job = legacy-targets
- machine = mlab1.iad01.measurement-lab.org
- service = sidestream
- severity = page
Annotations:
- description =
- summary =

TODO: add graph url from annotations.

pboothe commented 6 years ago

iad01 is having problems. The root cause is unclear, but the alerts from it have been silenced for a few days.