Data Skipping Index Part 1: Refactoring - Githubissues

microsoft / hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

https://aka.ms/hyperspace

Apache License 2.0

423 stars 115 forks source link

Data Skipping Index Part 1: Refactoring #481

Closed clee704 closed 3 years ago

clee704 commented 3 years ago

Replace CoveringIndexFilter with a generic IndexTypeFilter so that it can be reused for DataSkippingIndex.
Rename RuleUtils to CoveringIndexRuleUtils and extract methods not specific to CoveringIndex into RuleUtils so that DataSkippingIndex can use them.
Move ExtractRelation from index.covering to index.rules because it is a general extractor that can be used by DataSkippingIndex.

What is the context for this pull request?

Tracking Issue: #441
Parent Issue: N/A
Dependencies:
- 485

What changes were proposed in this pull request?

Reorganize code so that code duplication is minimized when new index types are added later.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Existing unit tests