[FEATURE] Deploy an execution engine based on modern Cloud Native Infra

[kantale]

I am creating this very generic issue to point out that we need to deploy a "professional" execution environment based on modern open source software.

Right now the execution is based on over-simplistic python native thread-workers.

We need to deploy:

• Prometheus
• Kubernetes
• Grafana

[kantale]

See also:

• https://code-maze.com/top-docker-monitoring-tools/ for a collection of Docker monitoring tools

[manoskout]

Collect docker metrics using Prometheus https://docs.docker.com/config/thirdparty/prometheus/

[manoskout]

Suggestion: https://www.influxdata.com/blog/getting-started-python-influxdb/

We already take the stats using docker-py. Maybe another one good idea is save the data in database (influxdb or prometheus) and visualize them in Grafana. I think its the easiest way

[kantale]

See also: #7

[manoskout]

I have already started tests using Docker Compose. But in monitoring it's different because it reads as different containers the tools.