Choosing the right combination of query and config to achieve high perf with constant mem usage. This gives a 50% improvement over single and multi stream benchmarks.
Type of change
[x] Bug fix (non-breaking change which fixes an issue)
How has this change been tested?
Ran benchmarks and smaller tests in experiments repo^1. The best combination is no order by clause and turning off repartitioning.
Pull Request
Choosing the right combination of query and config to achieve high perf with constant mem usage. This gives a 50% improvement over single and multi stream benchmarks.
Type of change
How has this change been tested?
Ran benchmarks and smaller tests in experiments repo^1. The best combination is no order by clause and turning off repartitioning.