iter8-tools / iter8

Kubernetes release optimizer
https://iter8.tools
Apache License 2.0
254 stars 34 forks source link

For SDK based A/B/n tests, enable visualization of result in Grafana #1501

Closed kalantar closed 1 year ago

kalantar commented 1 year ago

Consider exposing raw metrics (instead of just summary metrics) and doing summary metric/best computations in Grafana if possible.

Issues related to Grafana

Supporting storage client changes

Supporting Metrics Service

Issues related to Iter8

sriumcp commented 1 year ago

Assume there is a way to get JSON data for an app, specifically, summary metrics for an app. Display this in a Grafana dashboard.

For starts, it can reflect the information in Iter8 report for ABn testing experiments. Going a step further, may be, for each metric, we can also get the raw values, and plot histograms.

For each metric, histograms, and summaries can be computed at both the user level and transaction.


In this exercise, for Grafana data source: create a gist, and use simple JSON plugin/Infinity plugin in Grafana as a way to get to this data.


Go beyond this exercise, once we nail the Grafana viz panels, we can start creating service APIs in Iter8 that supply this JSON data.