rockset / rockbench

Benchmark
Apache License 2.0
15 stars 5 forks source link

Introduce CrateDB to the benchmark [draft] #29

Open widmogrod opened 4 months ago

widmogrod commented 4 months ago

rockbench now can run benchmarks agains https://cratedb.com

Implementation is missing patch mode

PR introduce also docker compose to allow running some of the benchmarks locally

docker compose -f dev/compose.yml up -d

# To test CrateDB part run:
CRATEDB_URI="postgres://crate:@localhost:5432/test?pool_max_conns=10&pool_min_conns=3" go test ./... 

To run some benchmarks on docker compose locally, there is small utility script to help you started

dev/run.sh  

Example output

dev/run.sh
[+] Running 3/3
 ✔ Network dev_default      Created                                                                                                                                                                                                                                                                             0.1s 
 ✔ Container opensearch     Started                                                                                                                                                                                                                                                                             0.4s 
 ✔ Container dev-cratedb-1  Started                                                                                                                                                                                                                                                                             0.4s 
Build rockbench
Wait for 15s for compose containers to start...
Benchmarking Elastic
Generator identifier:  thyb6zEs7J
Initial sleep of 4s and polling period of 25s
Sleep done. Now issuing requests to calculate e2e latency.
Latency: 1.019278s
Latency: 1.026499s
Latency: 1.036756s
Latency: 1.026115s
Latency: 1.023782s
Latency: 1.040088s
Latency: 1.02546s
Latency: 1.026143s
Latency: 1.029186s
^C
signal received: interrupt
2024/07/03 19:42:07 done
Benchmarking CrateDB
Generator identifier:  YkpJ0rknGL
Initial sleep of 2s and polling period of 25s
Sleep done. Now issuing requests to calculate e2e latency.
Latency: 1.050514s
Latency: 106.732ms
Latency: 88.5ms
Latency: 90.912ms
Latency: 95.79ms
Latency: 135.561ms
Latency: 88.375ms
Latency: 100.388ms
Latency: 90.523ms
^C
signal received: interrupt
2024/07/03 19:45:54 done
[+] Running 3/3
 ✔ Container dev-cratedb-1  Removed                                                                                                                                                                                                                                                                             0.8s 
 ✔ Container opensearch     Removed                                                                                                                                                                                                                                                                            10.4s 
 ✔ Network dev_default      Removed