influxdata / tick-charts

A repository for Helm Charts for the full TICK Stack
Apache License 2.0
90 stars 72 forks source link

Telegraph-DS, Chronograf K8S dashboards not working #64

Closed MaxDiOrio closed 5 years ago

MaxDiOrio commented 5 years ago

I must be doing something not quite right. I deployed Telegraph-DS to my cluster, and in my host list in Chronograf, I can see my cluster worker nodes (status and cpu/load is not displaying). I can click on a node and see the metrics associated with it just fine.

If I go to the dashboard in Chronograf and try to view any of the K8S dashboards, I'm greeted with: To enable this graph, you will need to configure the Telegraf Kubernetes Input plugin.

I thought Telegraph-DS enables the Kubernetes Input Plugin by default.

My config map for telegraph-ds has the input: [[inputs.kubernetes]] bearer_token = "/var/run/secrets/kubernetes.io/serviceaccount/token" insecure_skip_verify = true url = "https://$HOSTIP:10250"

And from the pod console, $HOSTIP resolves properly an an environment variable.

Any thoughts on what I'm missing? Thanks.

MaxDiOrio commented 5 years ago

This was on me and not understanding how it works. I was having Telegraf dump metrics into a different database just for itself. So when I logged into Chronograf, it was using my cluster metrics that were coming into InfluxDB from Prometheus, not from Telegraf.

Since the measurements from Telegraf didn't overlap measurements from Prometheus, I moved Telegraf data into the same database as Prometheus metrics so when I change data sources, it's all relevant data to the Cluster I'm looking at.