infinityworks / Guide_Rancher_Monitoring

Easy to follow guide on how to deploy and make the best use of the Rancher community catalog template for Prometheus.
112 stars 9 forks source link

Monitor multiple hosts #13

Closed apertureless closed 7 years ago

apertureless commented 7 years ago

It seems, that I can't really monitor multiple hosts.

I have 3 Servers. Ergo 3 hosts

main server

do droplet 1

do droplet 2

After adding the digital ocean droplets, the node_exporter and cadvisor were automatically deployed by rancher.

On the host stats dashboards, I can only select 1 host. And under the host health rancher widget, there is also only one visible.

So it seems the node_exporter seems not to work properly.

However I can access them with the rancher exporter over

rancher_host_state{state="active"}

Rucknar commented 7 years ago

Somewhat of a hunch, but if the server name doesn't match the regex for hosts, this could in theory happen. If your sure that Prometheus its-self can see the nodes:

In Grafana, click the settings icon and choose 'Templating', click edit on the nodes/host template. You should see a regex field and below that, the matches that are captured, it might be worth adjusting the regex if it doesn't grab the match.

Failing that, if you send me the server names, i'll take a look why they've not matched up.

apertureless commented 7 years ago

Found the issue. Seems to be related to rancher/agents if they run on same host as rancher server

cianiandreadev commented 5 years ago

@apertureless I am experiencing the same issue. I can only see only one of the two node running. How had you fixed that?