Monitor and restore datahub.io server modules (web, specstore, rawstore, etc)

[AcckiyGerman]

The server could hang for different reasons Once we notice that after 3 hours after the accident. (Redis failded) Today we notice that server is down, when I can't get any data while writing a blog-post

So we are not controlling either server is running OK or it is DOWN until somebody try to get some data and fail.

Acceptance criteria

• [x] there is a monitoring system that check if the server and all related daemons are running well
  • Specstore
  • Rawstore
  • web-server
  • ... what else?
• [x] monitoring system notifies administrator if something crashes
• [ ] monitoring system tries to restore failed daemons or docker instances or whatever

Tasks

• [ ] chose the proper server monitoring system
• [ ] implement monitoring

Tests:

• [ ] try to break the server with
  • DDOS (multi-requests to dataset-pages)
  • data push HUGE data in several threads
• [ ] get a proper message from monitoring
• [ ] server should be restored automatically

Analysis

[zelima]

Partially FIXED. We heave datahub-health repo that monitors and reports with results every 24 hours. Though does not try to recover https://travis-ci.org/datahq/datahub-health