search

eto-ai / rikai

Parquet-based ML data format optimized for working with unstructured data
https://rikai.readthedocs.io/en/latest/
Apache License 2.0
137 stars 19 forks source link

ModelType Design: implicit schema pruning #558

Open da-liii opened 2 years ago

da-liii commented 2 years ago

The schema pruning impl is the same with #557 .

The different part is that we can add Rules and Strategies to get the optimized and "schema pruned" LogicalPlan.

Schema pruning may need interface change in ModelType.