Monitor and restore datahub.io server modules (web, specstore, rawstore, etc)

[AcckiyGerman]

Issue in the Frontend repo

The server could hang for different reasons Once we notice that after 3 hours after the accident. (Redis failded) Today we notice that server is down, when I can't get any data while writing a blog-post

As a Admin I want to control the server status and to have a auto-restore system, so I'm sure my users are happy.

Acceptance criteria

• [x] there is a monitoring system that check if the server and all related daemons are running well
  • Specstore
  • Rawstore
  • web-server
  • ... what else?
• [x] monitoring system notifies administrator if something crashes
• [ ] monitoring system tries to restore failed daemons or docker instances or whatever

Tasks

• [ ] chose the proper server monitoring system
• [ ] implement monitoring

Tests:

• [ ] try to break the server with
  • DDOS (multi-requests to dataset-pages)
  • data push HUGE data in several threads
• [ ] get a proper message from monitoring
• [ ] server should be restored automatically

Analysis

[zelima]

FIXED all servers and their endpoint are tested and run daily on Travis for now