Operator improvements before publishing it on operatorhub.io

[slopezz]

Why?

We want to publish prometheus-exporter-operator on OperatorHub.io through OLM, so anyone can easily deploy it without manually managing yamls, so anyone can monitor databases and AWS services (cloudwatch_exporter) with prometheus, can have useful grafana dashboards and some prometheus alerts examples. 3scale make usage of different DBs, and its monitoring is very important. At least a 3scale API management instance has:

• a mysql db for system
• a postgresql db for zync
• a redis db for system
• a redis db for backend
• a memcached for system
• a sphinx for system

With our experience using prometheus, grafana, and different exporters, we want to apply some improvements to the operator before publishing it on OperatorHub.io

How?

It is required to:

• Update operator-sdk version from 0.13.0 to v0.18.1 (last one)
• Integrate dashboards into operator:
  • Having a way to detect if not-default api like ServiceMonitor/GrafanaDashboard exists on the cluster (to not have an failing task)
  • Implement dashboards per operator instance (namespace), so it is possible to deploy the operator on a different namespace (different version), having possibly different dashboards version, without collision on dashboards names
• Parametrize liveness/readiness probes per exporter, with possibility to override values
• Fix cloudwatch_exporter (is not working at the moment), and provide more examples
• Add cloudwatch dashboard with monitoring at least of ElastiCache, RDS, ALB, NLB, ELB, ElasticSearchDomain
• Add cloudwatch prometheusrules examples
• Add more redis prometheusrules examples
• Replace elasticsearch exporter by https://github.com/justwatchcom/elasticsearch_exporter
• Add elasticsearch dashboard
• Add elasticsearch prometheusrules examples
• Add CRD fields validation: var types (string, boolean, integer), required fields (type), or enum choices on type var
• Add circleci image generation
• Add OLM management
• Improve current dashboards
• Improve current prometheusrules
• Improve docs

Requirements

• [x] Update operator-sdk version from 0.12.0 to v0.18.1
• [x] Integrate grafana dashboards management on operator
• [x] Parametrize liveness/readiness probes per exporter
• [x] Fix cw_exporter implementation
• [x] Add cloudwatch dashboard (ElastiCache, RDS, ALB, NLB, ELB, ElasticSearchDomain)
• [x] Add more redis prometheusrules examples
• [x] Replace elasticsearch exporter by https://github.com/justwatchcom/elasticsearch_exporter
• [x] Add elasticsearch dashboard
• [x] Add elasticsearch prometheusrules examples
• [x] Add CRD fields validation
• [x] Add circleci image generation
• [x] Add OLM management
• [x] Improve current dashboards
• [x] Improve current prometheusrules
• [x] Improve docs

Acceptance Criteria

N/A

Notes

N/A