search

GSI-HPC / lustre_exporter

Prometheus exporter for use with the Lustre parallel filesystem
GNU General Public License v3.0
18 stars 20 forks source link

Setup information #27

Closed Francesko90 closed 2 years ago

Francesko90 commented 2 years ago

Hi @gabrieleiannetti

Thank you for this work, very nice and interesting. Just a question, is necessary install the exporter in any node? I'm not really expert of lustre so I don't if exist a management node that collect all this information where is possible setup this exporter.

Thanks in advance

gabrieleiannetti commented 2 years ago

Hi @Francesko90

It depends, which metrics you are interested.

We do not have an exported metrics overview yet, but you can get the exported metrics per component here: https://github.com/GSI-HPC/lustre_exporter/blob/ed6cce1743c797c43847339f9413d99af2c0cfac/lustre_exporter_test.go#L213

Honestly, I would at least install that exporter on all server machines.
Here you would get the most information of it.

There exist also dashboards for Grafana:
https://grafana.com/grafana/dashboards/?search=lustre

Best

Francesko90 commented 2 years ago

Hi @gabrieleiannetti

Thanks you for the answer. So I need of an exporter for any node and Grafana need to read data from all exporter (a dashboard for any node, or is possible have a drop list that use different exporter?).

Maybe can be usefully create a middleware that collect the data of all exporter.

gabrieleiannetti commented 2 years ago

Hi @Francesko90

Yes, you should install the exporter on all nodes of interest with the appropriate exporter you want to collect specific data.

I would suggest to install on all nodes at least the Node Exporter for exposing general metrics.

For the start I would install the Lustre Exporter on the Lustre Server only.

To collect all the data you need Prometheus up and running.

For visualization it is common to use Grafana.

I suggest you to learn how to setup a monitoring system with Prometheus+Grafana and Node exporter. Installing and configuring Prometheus for the Lustre exporter will be similar to the Node exporter.

Best Gabriele