Code Cleanup (Issue #20, Issue #22)

[stefan-grafberger]

Issue #, if available: #20, #22, also implements some features from #16

Description of changes:

• Cleaned up data corruption API by using enums and directly integrating support for several Jenga corruptions
• Fixed: the runtime of our current ModelPatches (cleanlab and shapley filtering and retraining) is not updated to reflect the repeated training. Because the models are already fairly expensive, this can result in highly inaccurate predictions for the DataCleaning what-if analysis.
• Fixed: For filter removal, the runtime of children nodes is not increased according to the selectivity of the removed filter
• Fixed: For filter removal push-up, all selectivities between the old and new location need to be updated as well.
• Removed the DAG visualization from the main code path and added it to separate utility function. Future todo: see #23
• Switched to networkx utility function for generating new node ids for nodes needing recomputation.
• Added an option to reuse the extracted DAG from an earlier instrumented pipeline run.
• For the original pipeline execution, I also extract all score results so we can provide that comparison for free as part of the what-if analyses.
• Updated all what-if analyses to include the free original score results for comparison purposes.
• Added runtime info data class to final result data class in preparation for the experiments, containing the same info that is currently logged only.
• Minor code cleanup in some places.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[stefan-grafberger]

Codecov Report

Merging #24 (55840db) into main (e6507a2) will increase coverage by 0.13%. The diff coverage is 98.86%.

@@            Coverage Diff             @@
##             main      #24      +/-   ##
==========================================
+ Coverage   95.05%   95.18%   +0.13%     
==========================================
  Files          36       36              
  Lines        3940     4134     +194     
==========================================
+ Hits         3745     3935     +190     
- Misses        195      199       +4     

Impacted Files	Coverage Δ
mlwhatif/optimization/_query_optimization_rules.py	100.00% <ø> (ø)
mlwhatif/visualisation/_visualisation.py	89.28% <25.00%> (-10.72%)	:arrow_down:
mlwhatif/analysis/_data_cleaning.py	95.08% <94.44%> (-0.16%)	:arrow_down:
mlwhatif/__init__.py	100.00% <100.00%> (ø)
mlwhatif/_analysis_results.py	100.00% <100.00%> (ø)
mlwhatif/_pipeline_analyzer.py	92.30% <100.00%> (-0.68%)	:arrow_down:
mlwhatif/analysis/_data_corruption.py	98.56% <100.00%> (+0.37%)	:arrow_up:
...f/analysis/_data_corruption_with_model_variants.py	98.03% <100.00%> (+0.29%)	:arrow_up:
mlwhatif/analysis/_operator_fairness.py	96.72% <100.00%> (+0.18%)	:arrow_up:
mlwhatif/execution/_multi_query_optimizer.py	100.00% <100.00%> (ø)
... and 12 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.