Backing Up and Open Source benchmarking data

stratum-mining / benchmarking-tool

Benchmarking tool to measure Stratum V2 and Stratum (V1) protocol performances in different contexts

Other

11 stars 8 forks source link

Backing Up and Open Source benchmarking data #45

Open average-gary opened 2 months ago

average-gary commented 2 months ago

It would be nice to have a mechanism for tool runners to export their data in a shareable way that can be imported into a Prometheus/Grafana setup to view the raw data itself for additional analysis/review.

[ ] Easy export Prometheus data to a "backup"
[ ] Import Prometheus data to new instance

PS: Maybe we provide a way to OTS the data set

Shourya742 commented 2 months ago

Sure thing! We can do that. Prometheus has a snapshot API that lets you save your data and restore it later, making it portable. cc: @GitGab19

GitGab19 commented 2 months ago

That's great, I wasn't aware of this feature! Do you want to take this up @Shourya742 ?

Shourya742 commented 2 months ago

I can give it a try once done with my other assigned task.

That's great, I wasn't aware of this feature! Do you want to take this up @Shourya742 ?

GitGab19 commented 2 months ago

Regarding the UX, I see the following as a possible behavior:

export-benchmarks-data.sh script which allows user to export prometheus data for a specific timeframe
- the script should be able to ask user the selected timeframe and use that input
verify/import-benchmarks-data.sh script which takes the prometheus snapshot as input and mounts it in prometheus
- this script should not override other prometheus volumes

This is the first thing which came up in my mind, but feel free to expand more and comment on that!