search

duckdblabs / db-benchmark

reproducible benchmark of database-like ops
https://duckdblabs.github.io/db-benchmark/
Mozilla Public License 2.0
143 stars 27 forks source link

Incorrect timings in groupby 50 GB charts #10

Closed tsghtst closed 1 year ago

tsghtst commented 1 year ago

Data in this chart (groupby 50 GB) is incorrect. Timings for each question seem way too small (smaller that for 5 GB) and do not add up to the timing at the top of the chart. E.g. DuckDB top timing is 143s, but for each question timings are less than 0.5s.

Tmonster commented 1 year ago

Timings for each query are by the minute in the chart linked. So a timing of 0.01 is 0.6 seconds.

The reported results in the chart represent the addition of all query timings of a system to complete both query runs for all 5 queries.

tsghtst commented 1 year ago

My bad, didn't notice x axis units are minutes. However, a bit confusing as top chart units are seconds, but lower chart units are minutes.