Multi Query Optimization Rules (Issue #5)

[stefan-grafberger]

Issue #, if available: #5

Description of changes:

• Implemented the multi-query optimization techniques we discussed:
  • Projection Push-Up
  • Filter Addition Push-Up
  • Filter Removal Push-Up
  • UDF Split Reuse
  • All of them work for all the mlinspect example pipelines, but more extensive testing needs to be done in the future. But once we do the optimization experiments, we can use the experiment code to also build some unit tests

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[stefan-grafberger]

Codecov Report

Merging #17 (8626213) into main (7b5817a) will increase coverage by 0.86%. The diff coverage is 97.93%.

@@            Coverage Diff             @@
##             main      #17      +/-   ##
==========================================
+ Coverage   94.08%   94.95%   +0.86%     
==========================================
  Files          29       35       +6     
  Lines        3367     3807     +440     
==========================================
+ Hits         3168     3615     +447     
+ Misses        199      192       -7     

Impacted Files	Coverage Δ
mlwhatif/analysis/_operator_fairness.py	96.53% <95.08%> (-0.73%)	:arrow_down:
mlwhatif/analysis/_analysis_utils.py	93.00% <95.12%> (+29.89%)	:arrow_up:
.../optimization/_operator_deletion_filter_push_up.py	95.49% <95.49%> (ø)
mlwhatif/execution/_patches.py	81.87% <98.03%> (-11.57%)	:arrow_down:
mlwhatif/analysis/_cleaning_methods.py	74.84% <100.00%> (ø)
mlwhatif/analysis/_data_cleaning.py	95.23% <100.00%> (ø)
mlwhatif/analysis/_data_corruption.py	98.18% <100.00%> (+0.08%)	:arrow_up:
mlwhatif/analysis/_patch_creation.py	100.00% <100.00%> (ø)
mlwhatif/analysis/_what_if_analysis.py	80.00% <100.00%> (ø)
mlwhatif/execution/_multi_query_optimizer.py	100.00% <100.00%> (ø)
... and 7 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.