search

faclc4 / HTAPBench

Benchmark suite to evaluate HTAP database engines
Other
21 stars 7 forks source link

Does this benchmark tool support MySQL? #2

Open shenli opened 5 years ago

shenli commented 5 years ago

Hello, glad to see this interesting tool.

I have two questions:

  1. Does it support benching MySQL? We are developing an HTAP database named TiDB which support MySQL protocol. If yes, I will test TiDB with it.

  2. Is there any use case for this tool? I can not find any benchmark result in this repo.

Thanks!

faclc4 commented 5 years ago

Good morning, first of all I would like to send you my apologies, I was in vacation.

I appreciate the interest shown in our benchmark. Regarding your questions:

  1. It supports any DB with JDBC connector. For the MySQL protocol you'll have to change the configuration file (URL and driver) and possible perform some minor adjustments on the SQL syntax of OLAP queries, as the SQL flavour might change/ the underlying DB may not support some of the aggregations. The OLTP transactions should smoothly.
  2. We have not any results in the repo, Just the tool. You can look at the paper that supports this tool at https://dl.acm.org/citation.cfm?id=3030207.3030228 for results and their understanding.

If you have further questions just email us back.

Best regards,

Fábio André Coelho

On 10 August 2018 at 04:23, Shen Li notifications@github.com wrote:

Hello, glad to see this interesting tool.

I have two questions:

1.

Does it support benching MySQL? We are developing an HTAP database named TiDB https://github.com/pingcap/tidb which support MySQL protocol. If yes, I will test TiDB with it. 2.

Is there any use case for this tool? I can not find any benchmark result in this repo.

Thanks!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/faclc4/HTAPBench/issues/2, or mute the thread https://github.com/notifications/unsubscribe-auth/ACckVVLwWvw3VupfCqYxER2oV18yUHCuks5uPPy8gaJpZM4V3hze .

parampawar07 commented 5 years ago

Hello,

I wish to put forth another query :

I performed tests on MYSQL and the results were somehow different than mentioned in the above comment, the OLAP queries were smooth but the OLTP transactions were looped into roll backs. I guess the reason for this lies with the data loading. The # of New Timestamps : #90500, this is nearly half of the # TS : 180000.

Could you please let me know if the problem is indeed in the data load stage and the #new timestamps loaded has to be 180000.

If so could also suggest a fix to this. Below is the load statistics.

Thanks.

Benchmark: HTAPB {pt.haslab.htapbench.core.HTAPBench} Configuration: config/htapb_config_mysql.xml Type: MYSQL Driver: com.mysql.cj.jdbc.Driver URL: jdbc:mysql://127.0.0.1:3306/htapb?seUnicode=yes&characterEncoding=UTF-8&serverTimezone=Europe/Helsinki Isolation: TRANSACTION_READ_COMMITTED Scale Factor: 3.0

17:01:11,018 (HTAPBench.java:337) INFO - ** 17:01:11,142 (HTAPBench.java:611) INFO - Loading data into HTAPB database...

TS: 180000

17:05:20,811 (HTAPBLoader.java:1523) INFO - 17:05:20,811 (HTAPBLoader.java:1524) INFO - ------------- LoadJDBC Statistics -------------------- 17:05:20,811 (HTAPBLoader.java:1525) INFO - Start Time = Sat Jun 29 17:01:11 CEST 2019 17:05:20,812 (HTAPBLoader.java:1526) INFO - End Time = Sat Jun 29 17:05:20 CEST 2019 17:05:20,812 (HTAPBLoader.java:1527) INFO - Run Time = 249 Seconds 17:05:20,813 (HTAPBLoader.java:1528) INFO - Rows Loaded = 1427797 Rows 17:05:20,813 (HTAPBLoader.java:1529) INFO - Rows Per Second = 5734 Rows/Sec 17:05:20,814 (HTAPBLoader.java:1530) INFO - Total # of New Timestamps (Load Stage): 90500 17:05:20,814 (HTAPBLoader.java:1531) INFO - ------------------------------------------------------ 17:05:20,886 (HTAPBench.java:613) INFO - Finished! 17:05:20,887 (HTAPBench.java:614) INFO - **

bryanosborne commented 4 years ago

When I attempt to run against MySQL the load script gives a "Failed to initialize JDBC driver 'com.mysql.jdbc.Driver' error. Happens on two different machines. The MySQL connector has been installed on both, and I have been running oltpbench on the machines w/o incident.

What might I be missing in the setup/config?

faclc4 commented 4 years ago

Good afternoon, from what you report it seems like a miss conf with the path for the MySQL driver.

Try to pass the fully path to it when you start de bench.

java -cp .:target/htapbench-0.95-jar-with-dependencies.jar:/pathToMySQLdriver.jar pt.haslab.htapbench.core.HTAPBench -b database_name -c config/htapb_config_postgres.xml --create false --load false --execute true --s 120 --calibrate false

If this did not solve your problem, pease send me the conf file you are using and the output produced, so that I can take a look at it.

Look forward for a reply from you. Best, Fábio André Coelho

On Fri, 22 Nov 2019 at 19:02, bryanosborne notifications@github.com wrote:

When I attempt to run against MySQL the load script gives a "Failed to initialize JDBC driver 'com.mysql.jdbc.Driver' error. Happens on two different machines. The MySQL connector has been installed on both, and I have been running oltpbench on the machines w/o incident.

What might I be missing in the setup/config?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/faclc4/HTAPBench/issues/2?email_source=notifications&email_token=AATSIVLEWSNABNYC2FAIF6TQVAUDZA5CNFSM4FO6DTPKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEE6R3IA#issuecomment-557653408, or unsubscribe https://github.com/notifications/unsubscribe-auth/AATSIVJJNOCDYF6AENA3GDTQVAUDZANCNFSM4FO6DTPA .