microsoft / hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
https://aka.ms/hyperspace
Apache License 2.0
424 stars 115 forks source link

Investigate using partition columns as indexed/partition columns in index #108

Open apoorvedave1 opened 4 years ago

apoorvedave1 commented 4 years ago

Describe the issue

Can we simulate partition like behavior on indexes using partition columns (from original data) as the first index column.

Can we simulate partition pruning using such "partitioned Indexes"

To Reproduce

na

Expected behavior

na

Environment

na

rapoth commented 4 years ago

@apoorvedave1 Can you add more details + pros/cons to this issue? And can you convert this issue into the Feature Request template please?