search

faclc4 / HTAPBench

Benchmark suite to evaluate HTAP database engines
Other
21 stars 7 forks source link

Question about execute #5

Open dshjoshi opened 5 years ago

dshjoshi commented 5 years ago

This is more of a question on documentation: When you give the following command to run the HTAP benchmark queries, how many iterations of queries does it run ? java -cp .:target/htapbench-0.95-jar-with-dependencies.jar pt.haslab.htapbench.core.HTAPBench -b database_name -c config/htapb_config_postgres.xml --create false --load false --execute true --s 120 --calibrate false

faclc4 commented 5 years ago

Dear Dipti Joshi,

First we need to clear out an aspect regarding to the workload. TPC-C (OLTP part) is composed by 5 transactions. TPC-H (OLAP part) is composed by 22 analytical queries.

The workload on the benchmark works as follows: First you setup the target tpm you want to test your database with and the test time. The OLTP part (5 transactions) runs since the start of the workload until the end. The number of executed transactions is established trough the standard mix. The OLAP part (22 queries) runs from the first minute onwards, until the end of the workload. At each evaluation period (60 secs by default), the benchmark tries to scale the OLAP activity by launching further OLAP clients.

Specifically: YOUR QUESTION: What I want to know is does it do many iterations of this set, or only one? It does as many iterations as possible during the test time. It randomly choses OLTP queries (according to tpc-c transaction mix) and random OLAP from the set of 22 queries.

If you further questions, please contact me (I will answer faster) or consult the paper: https://research.spec.org/icpe_proceedings/2017/proceedings/p293.pdf

Best, Fábio André Coelho

On Mon, 26 Nov 2018 at 03:54, Dipti Joshi notifications@github.com wrote:

This is more of a question on documentation: When you give the following command to run the HTAP benchmark queries, how many iterations of queries does it run ? java -cp .:target/htapbench-0.95-jar-with-dependencies.jar pt.haslab.htapbench.core.HTAPBench -b database_name -c config/htapb_config_postgres.xml --create false --load false --execute true --s 120 --calibrate false

  • I understand TPCH has about 5 transactions and TPCC has 22 queries - What I want to know is does it do many iterations of this set, or only one?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/faclc4/HTAPBench/issues/5, or mute the thread https://github.com/notifications/unsubscribe-auth/ACckVdqVZuLXpI77pVgcoRkFAd4B6sPgks5uy1fQgaJpZM4YyPJf .