Is there an option to directly run ycsb perf test against an existing hbase server?

GoogleCloudPlatform / PerfKitBenchmarker

PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.

https://googlecloudplatform.github.io/PerfKitBenchmarker/

Apache License 2.0

1.91k stars 516 forks source link

Is there an option to directly run ycsb perf test against an existing hbase server? #3372

Closed sushanb closed 2 years ago

sushanb commented 2 years ago

For the context, ycsb allows to do this through hbase-site.xml file in the class path.

bin/ycsb load hbase10 -P workloads/workloada -cp /home/ycsb-hbase/conf -p table=usertable -p columnfamily=family -threads 100.

Is there a way to do this in perfkitbenchmarker? As i see, the script does the hbase installation and everything. I wonder how hard it will be to force it to use the hbase-site and run the workload?

yuyantingzero commented 2 years ago

I don't think we supports preprovisioned databases at the moment in general. Brandon may have more context.

bvliu commented 2 years ago

Hi sorry for the delayed response. We don't have existing functionality to do this, however it could be implemented with some effort. I recommend taking a look at linux_packages/hbase.py as well as linux_benchmarks/cloud_bigtable_ycsb_benchmark.py, which is able to use preprovisioned bigtable instances.

bvliu commented 2 years ago

Closing this now, feel free to reopen.