JustFixNYC / nycdb-k8s-loader

Loading and updating of NYC-DB data via containerized batch processing.
6 stars 2 forks source link

Add support for notifications on dataset loading failures #6

Closed toolness closed 5 years ago

toolness commented 5 years ago

It would be nice if we could be notified when a dataset fails to load.

One way to do this is by wrapping the actual Python code in a try...except clause and sending a Slack message in the except. However, this won't catch hard crashes (e.g. out-of-memory errors) or situations where the app couldn't even start in the first place.

Another option might be to wire up AWS to sending Amazon Simple Notification Service Alerts for Task Stopped Events , although this is AWS-specific and won't help if we move to k8s someday.