search

coiled / benchmarks

BSD 3-Clause "New" or "Revised" License
32 stars 17 forks source link

[TPC-H] Set `split_out=True` in groupby-aggregations in Q11, Q13, Q17 and Q18 #1377

Closed hendrikmakait closed 9 months ago

hendrikmakait commented 9 months ago

Workaround for https://github.com/coiled/benchmarks/issues/1376. In the future, this should be superseded by https://github.com/dask-contrib/dask-expr/issues/867.

phofl commented 9 months ago

pre-commit is broken and I think you can update query 11 as well

hendrikmakait commented 9 months ago

It looks like this causes memory pressure for Q18 at scale 10, but I'm inclined to merge anyways.

phofl commented 9 months ago

thx