Initial provision is made to re-use a shared GroupByChunkedOperator in FormulaMultiColumnChunkedOperator and FormulaChunkedOperator but more work is needed before this can be fully used.
1) We need to optimize the operator order in AggregationOptimizer to look for GroupByChunkedOperator instances from group aggs or that may be created for other formulas.
2) For FormulaMultiColumnChunkedOperator, we need to update GroupByChunkedOperator to keep two sets of output columns: public columns for requested GroupBy aggs and "hidden" ones only exposed to internal operators.
Initial provision is made to re-use a shared
GroupByChunkedOperator
inFormulaMultiColumnChunkedOperator
andFormulaChunkedOperator
but more work is needed before this can be fully used.1) We need to optimize the operator order in
AggregationOptimizer
to look forGroupByChunkedOperator
instances from group aggs or that may be created for other formulas. 2) ForFormulaMultiColumnChunkedOperator
, we need to updateGroupByChunkedOperator
to keep two sets of output columns: public columns for requestedGroupBy
aggs and "hidden" ones only exposed to internal operators.