Parallel streams in 2 benchmarker instances

Beuth-Erdelt / DBMS-Benchmarker

DBMS-Benchmarker is a Python-based application-level blackbox benchmark tool for Database Management Systems (DBMS). It connects to a given list of DBMS (via JDBC) and runs a given list of parametrized and randomized (SQL) benchmark queries. Evaluations are available via a Python interface and on an interactive multi-dimensional dashboard.

GNU Affero General Public License v3.0

12 stars 2 forks source link

Parallel streams in 2 benchmarker instances #165

Open perdelt opened 3 days ago

perdelt commented 3 days ago

dbmsbenchmarker run -f tpc-h -e yes -b -sd csv -c PostgreSQL -cs -sf PostgreSQL -r 12345 -sd csv -s 123 -sid 1
dbmsbenchmarker run -f tpc-h -e yes -b -sd csv -c PostgreSQL -cs -sf PostgreSQL -r 12345 -sd csv -s 123 -sid 2
python .\merge.py -c 12345 -r ./
dbmsbenchmarker read -e yes -r 12345

perdelt commented 3 days ago

improvement: synch start time via -st

perdelt commented 2 days ago

Test runs:

dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pp -pn 1 -p 2 -cs -sf PostgreSQL
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2 -cs -sf PostgreSQL
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2
# missing -r, if -cs and -sf, but not -pp
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL -pn 1 -p 1
dbmsbenchmarker run -f tpc-h -e yes -b -c PostgreSQL

python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pp -pn 1 -p 2 -cs -sf PostgreSQL
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2 -cs -sf PostgreSQL
# missing -r, if -cs and -sf, but not -pp
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pn 2 -p 2
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL -pn 1 -p 1
python ./benchmark.py run -f tpc-h -e yes -b -c PostgreSQL

perdelt commented 2 days ago

Open tasks

[ ] bexhoma dev
[x] loop over all connections, if -c missing
[x] -sf sets -c?
[x] missing -r, if -cs and -sf, but not -pp
[x] test MySQL
[x] compute total throughput
[x] set connectionmanagement for main file
[x] run -e for -pp shows evaluation?
[x] arbitrary -r for any parallel execution

perdelt commented 1 day ago

now all processes automatically wait till 5 second after initial start