search

ClickHouse / ClickBench

ClickBench: a Benchmark For Analytical Databases
https://benchmark.clickhouse.com/
Other
671 stars 153 forks source link

Update Apache Doris #226

Closed Gabriel39 closed 1 month ago

Gabriel39 commented 2 months ago

This PR updates the grades of Apache Doris on ClickBench.

Previously I have another PR (#185) to update Apache Doris but it is not an official RC version and reverted in #201. To make it more persuasive, I use the official RC version [Doris 2.1.7] to re-submit this PR.

Regarding the several questions raised in #201, I need to explain here for this PR.

Query Cache

In order to completely prevent cache impact, internal data cache in Apache Doris will be cleared each time before cold run.

Wrong Query Response

Previously I used a developing branch in #185 so it has an unexpected error. Now I change it to Doris 2.1.7 which is a stable version and has passed all CI/CD pipelines we used.

Specialized Build

This PR used Apache Doris 2.1.7 which is an official RC version. The binary could be found : https://apache-doris-releases.oss-accelerate.aliyuncs.com/apache-doris-2.1.7-rc01-bin-x64.tar.gz The information could be found : https://github.com/apache/doris/releases/tag/2.1.7-rc01

Gabriel39 commented 2 months ago

@chhetripradeep PTAL

rschu1ze commented 1 month ago

@Gabriel39 Thanks for this contribution.

I wanted to double-check but noticed that "benchmark.sh" uses yum and dnf. Virtually all "benchmark.sh" scripts in ClickBench are based on an Ubuntu environment, i.e. they assume "apt" as a package manger. For convenience and better comparability with other databases within the same environment, would it be possible to rewrite the script to run on Ubuntu?

Gabriel39 commented 1 month ago

Hi @rschu1ze , I have changed it to Ubuntu 20.04 and re-run this benchmark. PTAL again.