Parallel streams in 2 benchmarker instances - Githubissues

Beuth-Erdelt / DBMS-Benchmarker

DBMS-Benchmarker is a Python-based application-level blackbox benchmark tool for Database Management Systems (DBMS). It connects to a given list of DBMS (via JDBC) and runs a given list of parametrized and randomized (SQL) benchmark queries. Evaluations are available via a Python interface and on an interactive multi-dimensional dashboard.

GNU Affero General Public License v3.0

13 stars 3 forks source link

Parallel streams in 2 benchmarker instances #165

Closed perdelt closed 5 months ago

perdelt commented 5 months ago

dbmsbenchmarker run -f tpc-h -e yes -b -sd csv -c PostgreSQL -cs -sf PostgreSQL -r 12345 -sd csv -s 123 -sid 1
dbmsbenchmarker run -f tpc-h -e yes -b -sd csv -c PostgreSQL -cs -sf PostgreSQL -r 12345 -sd csv -s 123 -sid 2
python .\merge.py -c 12345 -r ./
dbmsbenchmarker read -e yes -r 12345

perdelt commented 5 months ago

improvement: synch start time via -st

perdelt commented 5 months ago

Test runs:

dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pp -pn 1 -p 2 -cs -sf PostgreSQL
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2 -cs -sf PostgreSQL
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2
# missing -r, if -cs and -sf, but not -pp
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pn 1 -p 1
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL

python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pp -pn 1 -p 2 -cs -sf PostgreSQL
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2 -cs -sf PostgreSQL
# missing -r, if -cs and -sf, but not -pp
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pn 1 -p 1
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL

perdelt commented 5 months ago

Open tasks

[x] bexhoma dev
[x] loop over all connections, if -c missing
[x] -sf sets -c?
[x] missing -r, if -cs and -sf, but not -pp
[x] test MySQL
[x] compute total throughput
[x] set connectionmanagement for main file
[x] run -e for -pp shows evaluation?
[x] arbitrary -r for any parallel execution

perdelt commented 5 months ago

now all processes automatically wait till 5 second after initial start