For the DoWhileOperator and LoopOperator, Rheem requires an expected number of iterations and then uses this as a basis to estimate the processing time of a plan with loops. However, the produced estimates are also used to (i) provide additional information to ExecutionOperators (e.g., current iteration, CardinalityEstimates) and to (ii) compare actual execution times to time estimates.
In consequence, Rheem crashes when there are more actual than estimated iterations. In turn, Rheem needs to extend the required data structure on-the-fly, as soon as the number of expected iterations increases.
From @sekruse on August 28, 2016 10:0
For the
DoWhileOperatorandLoopOperator, Rheem requires an expected number of iterations and then uses this as a basis to estimate the processing time of a plan with loops. However, the produced estimates are also used to (i) provide additional information toExecutionOperators (e.g., current iteration,CardinalityEstimates) and to (ii) compare actual execution times to time estimates.In consequence, Rheem crashes when there are more actual than estimated iterations. In turn, Rheem needs to extend the required data structure on-the-fly, as soon as the number of expected iterations increases.
Copied from original issue: daqcri/rheem#19