WIP: Distributed RADAR-Docker stack

[yatharthranjan]

This breaks up the RADAR-base stack into different sets of components which can be deployed individually on separate hosts.

Some other changes from the single host RADAR-Docker:

• Updated to Confluent version 5.2.0
• Added Multi-host monitoring using Netdata.

Please see the README for more info.

TODO:

• [ ] configure Portainer for using multiple docker remotes.
• [x] add a health check to commons for alerting.
• [ ] Abstract out the duplicate code shared in some components to /commons
• [x] Add authentication to netdata.
• [x] properly configure all the components to relay through the SMTP server provided.
• [x] Add monitoring for HDFS and Data components.
• [ ] Add README file to each component for docs on component level usage and configuration.
• [ ] Investigate adding a separate instance of Nginx webserver to frontend and admin components so can still access if proxies component is down.
• [ ] Investigate adding a load balancer config to Nginx for stateless services like gateway, rest-proxy and schema-registry.

[afolarin]

What is the status of this PR?

[yatharthranjan]

Hi @afolarin, the components are stable and are working well and being used in production for quite some time. However, the documentation is incomplete (for individual components), thus this is not ready to be merged.