Deterministic index selection for filter rule with no hybrid scan - Githubissues

microsoft / hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

https://aka.ms/hyperspace

Apache License 2.0

424 stars 115 forks source link

Deterministic index selection for filter rule with no hybrid scan #428

Closed apoorvedave1 closed 3 years ago

apoorvedave1 commented 3 years ago

What is the context for this pull request?

Deterministic index selection for FilterIndexRule with hybrid scan disabled.

Dependent PRs: https://github.com/microsoft/hyperspace/pull/386

What changes were proposed in this pull request?

This PR changes the filter index rule selection from picking the head of the eligible indexes to picking the index which has

the minimum size in terms of index file sizes
lexicographically smallest index name (if there are multiple indexes with minimum size)

Does this PR introduce any user-facing change?

no

How was this patch tested?

unit tests

sezruby commented 3 years ago

LGTM Thanks!