golang / oscar

[mirror] Open source contributor agent architecture repo.
BSD 3-Clause "New" or "Revised" License
117 stars 15 forks source link

gaby: monitor timed.Watcher progress #3

Open rsc opened 1 month ago

rsc commented 1 month ago

Known timed.Watchers should advance their "latest" time in the database. We should have a health check endpoint that reports whether the known watchers are too old. This will help diagnose cron-based jobs getting stuck, like when GitHub got stuck due to the non-issue issue event.

jba commented 3 weeks ago

I set up a metric for watcher latest times.

To be done: an alert based on the metric.