opensearch-project / opensearch-benchmark

OpenSearch Benchmark - a community driven, open source project to run performance tests for OpenSearch
https://opensearch.org/docs/latest/benchmark/
Apache License 2.0
103 stars 74 forks source link

Prometheus Metrics for Key Performance Indicators #582

Open yooav opened 1 month ago

yooav commented 1 month ago

Is your feature request related to a problem? Please describe

I've been operating OpenSearch for a few months now and I'm trying to get better observability into the performance of my cluster. So far, I've been using the Prometheus Plugin, but I haven't been able to get really granular metrics like p90 query latency or query error rate. The Benchmark utility seems like it only provides metrics on workload performance. It would be great if we could somehow provide access to more granular metrics that aren't available in the prometheus exporter plugin.

Describe the solution you'd like

A prometheus metrics endpoint with more granular, key metrics like query latency by percentile, query success rate, total queries, etc.

Describe alternatives you've considered

No response

Additional context

No response

IanHoang commented 1 month ago

@yooav I believe what you're looking for is the performance-analyzer plugin for OpenSearch. Have you given this a try?

OSB is not a plugin to keep track of granular metrics of your OpenSearch cluster but rather a tool that is commonly used to determine how one's OpenSearch cluster performs under specific types of workloads. More information about OSB can be found in our official documentation: https://opensearch.org/docs/latest/benchmark/