databendlabs / databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.85k stars 750 forks source link

There is no date on when the TPC-H benchmark was run #16486

Open alberttwong opened 1 month ago

alberttwong commented 1 month ago

on https://docs.databend.com/guides/benchmark/tpch there is no date on when the TPC-H benchmark was run

dosubot[bot] commented 1 month ago

Hey @alberttwong, I'm here to help you with any bugs, questions, or becoming a contributor. Let's tackle this together!

The date of the TPC-H benchmark is recorded in the result.json file using the following line in the benchmark script:

yq -i ".date = \"$(date -u +%Y-%m-%d)\"" -o json result.json

This line sets the date in the result.json file to the current date in UTC format [1].

Additionally, there are references to the TPC-H benchmark in the project's main documentation that include dates:

To continue talking to Dosu, mention @dosu.

alberttwong commented 1 month ago

Unfortunately that doesn't answer the question

BohuTANG commented 1 month ago

@alberttwong Thanks for the advice, we will add it soon. By the way, each night release will run the TPC-H 100: https://benchmark.databend.com/clickbench/release/tpch.html#eyJzeXN0ZW0iOnsiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzOS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYyMy1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxOC1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzMy1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzMi1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzMS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYwNS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYwNi1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzNC1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYwOC1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYzNS1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxMi1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxMy1uaWdodGx5KSI6dHJ1ZSwiRGF0YWJlbmQoUmVsZWFzZUB2MS4yLjYxNSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTUtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjktbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDEtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjAtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTktbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTUtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTEtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTItbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjEtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjItbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzgtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzctbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MzAtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjgtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi41OTMtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDktbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjYtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjUtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MjQtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MTAtbmlnaHRseSkiOnRydWUsIkRhdGFiZW5kKFJlbGVhc2VAdjEuMi42MDkpIjp0cnVlfSwidHlwZSI6eyJzMyI6dHJ1ZX0sIm1hY2hpbmUiOnsiU21hbGwiOnRydWUsIkxhcmdlIjpmYWxzZX0sImNsdXN0ZXJfc2l6ZSI6eyIxNiI6dHJ1ZSwiNjQiOnRydWV9LCJtZXRyaWMiOiJob3QiLCJxdWVyaWVzIjpbdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlXX0=

alberttwong commented 1 month ago

Tpch by itself is not interesting. I'm more interested in your comparison with other olap like snowflake.

wubx commented 1 month ago

Yeah, comparison with snowflake: https://docs.databend.com/guides/benchmark/tpch

alberttwong commented 1 month ago

the comparison with snowflake doesn't seem like a nightly.

BohuTANG commented 1 month ago

the comparison with snowflake doesn't seem like a nightly.

Databend currently only offers a nightly release (as used by Databend Cloud), with no additional release versions available. You can refer to the NOTE section and reproduce the benchmark using the public guide here: https://docs.databend.com/guides/benchmark/tpch#reproduce-the-benchmark

alberttwong commented 1 month ago

I didn't understand the comment. So it tests against snowflake nightly?