h2oai / db-benchmark

reproducible benchmark of database-like ops
https://h2oai.github.io/db-benchmark
Mozilla Public License 2.0
322 stars 85 forks source link

clickhouse should measure timings for cache=TRUE #151

Closed jangorecki closed 4 years ago

jangorecki commented 4 years ago

Similarly as we did in db-benchmark 1.0.0 for Impala and Presto SQL databases, we should do for ClickHouse.

In short, all the other solutions are capable to keep answers of their queries in a variable (cache=TRUE). On the other hand results of Clickhouse queries are immediately lost (cache=FALSE). Field cache is in time.csv for that purpose, so we can run both scenarios if needed. This issue requests measuring queries with cache=TRUE for ClickHouse, which will need to wrap current queries into CREATE TABLE AS SELECT, so the results are stored in a table.

jangorecki commented 4 years ago

resolved by 0abb7a4af0be3181933a78b5d7ac8fefce8ef8f4 and 0b8e9718e5ed5e8e07d4e39f4e15b09406193e4b