search

h2oai / db-benchmark

reproducible benchmark of database-like ops
https://h2oai.github.io/db-benchmark
Mozilla Public License 2.0
322 stars 85 forks source link

better performance regression tracking #138

Closed jangorecki closed 3 years ago

jangorecki commented 4 years ago

It is tricky to address well different cardinalties and it may happens that when fixing on regression the other one is introduced. It seems to be a good time to review current history.html report and improve the information it convey to readers. Then we can eventually link it from main report.

jangorecki commented 4 years ago

initial version just published, no plots yet, but tables that presents timings for last run, previous one, a week ago run, month ago run and year ago run. https://h2oai.github.io/db-benchmark/history.html

jangorecki commented 3 years ago

https://h2oai.github.io/db-benchmark/history.html is not being rendered anymore as of today. It is a result of dropping a workaround for clickhouse requirement for primary keys, which is no longer needed. History report need to be revised.

jangorecki commented 3 years ago

History report is back again, simplified, but I think it is easier to read now. Probably more difficult to get exact numbers, but for that time.csv can be used directly. Note that this report is internally used, not linked from anywhere. No further improvements to this are planned as of now so closing as resolved.