validation of chk should have tolerance within single solution

h2oai / db-benchmark

reproducible benchmark of database-like ops

https://h2oai.github.io/db-benchmark

Mozilla Public License 2.0

323 stars 85 forks source link

validation of chk should have tolerance within single solution #95

Closed jangorecki closed 4 years ago

jangorecki commented 5 years ago

Currently we validation chk (check sum of answers from queries) to be matching between solution using tolerance. There is also a validation of chk within a single solution, but this does not have any tolerance as of now. As a result cuDF is failing that validation due to https://github.com/rapidsai/cudf/issues/2494 We should provide tolerance for validation also within single solution.

jangorecki commented 4 years ago

this should also resolve https://github.com/h2oai/db-benchmark/issues/136