plz / E-Series-Graphite-Grafana

Collect Metrics from NetApp E-Series Storage appliances and dispatch them to graphite.
Apache License 2.0
13 stars 6 forks source link

How do you monitor multiple systems? #15

Open reuvygroovy opened 4 years ago

reuvygroovy commented 4 years ago

How do you modify the api-config.conf file to monitor/pull data from multiple hosts/systems?

plz commented 4 years ago

hey @reuvygroovy ,

In my environment I have one file per storage system (=~ 50 ) and that's the preferred means.

Otherwise if you have a webservices proxy instance that knows about all your systems you can point the config against that one, and it should be able to pull metrics for all the systems. I haven't tried this feature at scale, so I can't give you an estimation on how many systems you can pull metrics for from the proxy in a reasonable amount of time.

In my use case, which is for which I created the tool for, I have e-series deployed in multiple datacenters, so i have separate servers where I run the collection script, and all of them push to the same graphite endpoint.

You can also take a look at https://github.com/NetApp/eseries-perf-analyzer which is a tool published by NetApp for this same purpose.

reuvygroovy commented 4 years ago

So I need to then configure a separate service as well for each host?

Also, as another point. You mentioned there is a new tool: https://github.com/NetApp/eseries-perf-analyzer

Question 1: Will the existing version we are currently discussing be retired? Question 2: is the new version collecting newer/different metrics? We are using a brand new system/hardware and want to make sure we are utilizing the correct version

From: Pablo Luis Zorzoli notifications@github.com Sent: Monday, October 7, 2019 2:57 PM To: plz/E-Series-Graphite-Grafana E-Series-Graphite-Grafana@noreply.github.com Cc: ראובן סינגר (LREUVEN) reuvens@land.gov.il; Mention mention@noreply.github.com Subject: Re: [plz/E-Series-Graphite-Grafana] How do you monitor multiple systems? (#15)

hey @reuvygroovyhttps://github.com/reuvygroovy ,

In my environment I have one file per storage system (=~ 50 ) and that's the preferred means.

Otherwise if you have a webservices proxy instance that knows about all your systems you can point the config against that one, and it should be able to pull metrics for all the systems. I haven't tried this feature at scale, so I can't give you an estimation on how many systems you can pull metrics for from the proxy in a reasonable amount of time.

In my use case, which is for which I created the tool for, I have e-series deployed in multiple datacenters, so i have separate servers where I run the collection script, and all of them push to the same graphite endpoint.

You can also take a look at https://github.com/NetApp/eseries-perf-analyzer which is a tool published by NetApp for this same purpose.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/plz/E-Series-Graphite-Grafana/issues/15?email_source=notifications&email_token=AAKDQZSHIBTZS7S7ZA3MBD3QNMPXDA5CNFSM4I6BPXTKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAQBPFA#issuecomment-538974100, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAKDQZT4YXOXTEBBZUR45LTQNMPXDANCNFSM4I6BPXTA.

plz commented 4 years ago

On Mon, Oct 7, 2019 at 2:14 PM reuvygroovy notifications@github.com wrote:

So I need to then configure a separate service as well for each host?

Yes, that's how I run it.

Also, as another point. You mentioned there is a new tool: https://github.com/NetApp/eseries-perf-analyzer

Question 1: Will the existing version we are currently discussing be retired?

Nope, the main difference is that I'm not a netapp employee, and the other tool is published by netapp.

Question 2: is the new version collecting newer/different metrics? We are using a brand new system/hardware and want to make sure we are utilizing the correct version

From what I saw, they are much similar, but you can check the screenshots to compare.

From: Pablo Luis Zorzoli notifications@github.com Sent: Monday, October 7, 2019 2:57 PM To: plz/E-Series-Graphite-Grafana < E-Series-Graphite-Grafana@noreply.github.com> Cc: ראובן סינגר (LREUVEN) reuvens@land.gov.il; Mention < mention@noreply.github.com> Subject: Re: [plz/E-Series-Graphite-Grafana] How do you monitor multiple systems? (#15)

hey @reuvygroovyhttps://github.com/reuvygroovy ,

In my environment I have one file per storage system (=~ 50 ) and that's the preferred means.

Otherwise if you have a webservices proxy instance that knows about all your systems you can point the config against that one, and it should be able to pull metrics for all the systems. I haven't tried this feature at scale, so I can't give you an estimation on how many systems you can pull metrics for from the proxy in a reasonable amount of time.

In my use case, which is for which I created the tool for, I have e-series deployed in multiple datacenters, so i have separate servers where I run the collection script, and all of them push to the same graphite endpoint.

You can also take a look at https://github.com/NetApp/eseries-perf-analyzer which is a tool published by NetApp for this same purpose.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub< https://github.com/plz/E-Series-Graphite-Grafana/issues/15?email_source=notifications&email_token=AAKDQZSHIBTZS7S7ZA3MBD3QNMPXDA5CNFSM4I6BPXTKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAQBPFA#issuecomment-538974100>, or mute the thread< https://github.com/notifications/unsubscribe-auth/AAKDQZT4YXOXTEBBZUR45LTQNMPXDANCNFSM4I6BPXTA>.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/plz/E-Series-Graphite-Grafana/issues/15?email_source=notifications&email_token=AABFD5RV3MPMY3GGCXCLSSDQNMR27A5CNFSM4I6BPXTKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAQDD3Y#issuecomment-538980847, or mute the thread https://github.com/notifications/unsubscribe-auth/AABFD5RARYY2R45NE34GVVTQNMR27ANCNFSM4I6BPXTA .