edgi-govdata-archiving / web-monitoring-ops

Documentation and configuration files for EDGI’s deployment of Web Monitoring tools.
GNU General Public License v3.0
1 stars 1 forks source link

Add metricbeat-kubernetes. #20

Closed danielballan closed 5 years ago

danielballan commented 5 years ago

This should report system metrics about each of the nodes and metrics about the state of the cluter itself.

Per instructions: https://www.elastic.co/guide/en/beats/metricbeat/current/running-on-kubernetes.html

I have deployed this like so:

$ kubectl create -f /keybase/team/edgi_wm_kube/elasticsearch-secrets.yaml 
secret/elasticsearch-secrets created
$ kubectl create -f templates/kube-system/metricbeat-kubernetes.yaml 
configmap/metricbeat-daemonset-config created
configmap/metricbeat-daemonset-modules created
daemonset.extensions/metricbeat created
configmap/metricbeat-deployment-config created
configmap/metricbeat-deployment-modules created
deployment.apps/metricbeat created
clusterrolebinding.rbac.authorization.k8s.io/metricbeat created
clusterrole.rbac.authorization.k8s.io/metricbeat created
serviceaccount/metricbeat created

But no corresponding elasticsearch indexes have appeared just yet, so there is more debugging to be done.

This relies on secrets from elasticsearch-secrets.yaml, which I have added to the keybase directory where other secrets are stored.

Mr0grog commented 5 years ago

Does this obviate the work in #11? (Also, wow, I didn’t realize that was still sitting unmerged.)

Mr0grog commented 5 years ago

Only had a chance for a suuuuper quick skim here; I think either @jsnshrmn or @ibuys should take a closer look, as they have been doing much more than me with the Kubernetes cluster. My expertise is pretty limited.

danielballan commented 5 years ago

Sounds good to me. Thanks for taking a look.

stale[bot] commented 5 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in seven days if no further activity occurs. If it should not be closed, please comment! Thank you for your contributions.