Beuth-Erdelt / Benchmark-Experiment-Host-Manager

This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.
GNU Affero General Public License v3.0
6 stars 0 forks source link

Monitoring when PVC is active #239

Open perdelt opened 9 months ago

perdelt commented 9 months ago
perdelt commented 9 months ago

inside benchmarker: metrics length 0 (because subsecond?) outside benchmarker: length ok, but empty

perdelt commented 9 months ago

because of shuffling: last query executed is not last query in ordered list

perdelt commented 9 months ago

still only working sometimes (?)

perdelt commented 9 months ago

stream metrics are collected twice: per stream and per parallel set of streams:

-rw-rw-r--. 1 perdelt perdelt 1726 31. Jan 11:22 /home/perdelt/benchmarks/1706695001/query_stream_metric_total_cpu_memory_cached.csv
-rw-rw-r--. 1 perdelt perdelt  134 31. Jan 11:22 /home/perdelt/benchmarks/1706695001/query_stream_metric_total_cpu_memory_cached_MonetDB-BHT-8-1-1.csv
-rw-rw-r--. 1 perdelt perdelt  338 31. Jan 11:22 /home/perdelt/benchmarks/1706695001/query_stream_metric_total_cpu_memory_cached_MonetDB-BHT-8-1.csv
-rw-rw-r--. 1 perdelt perdelt  768 31. Jan 11:22 /home/perdelt/benchmarks/1706695001/query_stream_metric_total_cpu_memory_cached_MonetDB-BHT-8-2-1.csv
-rw-rw-r--. 1 perdelt perdelt  753 31. Jan 11:22 /home/perdelt/benchmarks/1706695001/query_stream_metric_total_cpu_memory_cached_MonetDB-BHT-8-2-2.csv
-rw-rw-r--. 1 perdelt perdelt 1319 31. Jan 11:22 /home/perdelt/benchmarks/1706695001/query_stream_metric_total_cpu_memory_cached_MonetDB-BHT-8-2.csv

Do we need metrics of SUT per stream?

perdelt commented 4 months ago