h2oai / db-benchmark

reproducible benchmark of database-like ops
https://h2oai.github.io/db-benchmark
Mozilla Public License 2.0
322 stars 85 forks source link

cudf groupby q6 median #121

Closed jangorecki closed 4 years ago

jangorecki commented 4 years ago

median was added in cudf (https://github.com/rapidsai/cudf/pull/2905), when it will get published (0.11) and we will move to this release, we should also add q6.

jangorecki commented 4 years ago

also we should use this https://github.com/rapidsai/cudf/issues/2468 after upgrade to 0.11

jangorecki commented 4 years ago

upgrade to 0.11.0 did not solve this issue because median and std are not yet supported in groupby: https://github.com/rapidsai/cudf/issues/3429 https://github.com/rapidsai/cudf/issues/3736 also required https://github.com/rapidsai/cudf/issues/3737

jangorecki commented 4 years ago

@rnyak I am not developing cudf, just using it, please see linked issues for status and if needed ask question in cudf repo. For now cudf is not even run on benchmark because it can very easily corrupt memory driver context. Once that happens machine needs a full reboot. For details see https://github.com/h2oai/db-benchmark/issues/129. To address that I am waiting for cudf documentation of dask-cudf.

jangorecki commented 4 years ago

It was already implemented, should be released as 0.13.