h2oai / db-benchmark

reproducible benchmark of database-like ops
https://h2oai.github.io/db-benchmark
Mozilla Public License 2.0
323 stars 85 forks source link

ensure sync of version/revision metadata #101

Closed jangorecki closed 5 years ago

jangorecki commented 5 years ago

Based on version/revision we skip run of a solution, so we can benchmark only when solution got upgrade.

It just happened that

cat datatable/REVISION
a8e926a48a87cd669ffe2ee310a73173be652f2b

and

Rscript -e 'data.table:::.git()'                   
[1] "96be5a9ab00e94504db61b2690fd466737a01366"

as a result

skip run: data.table groupby G1_1e7_1e2_0_0: a8e926a run on 20190821

So launcher script thinks we are still on a8e926a and we don't need to refresh DT.