search

apache / incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
https://gluten.apache.org/
Apache License 2.0
1.22k stars 437 forks source link

[GLUTEN-7267][CORE][CH] Move schema pruning optimization of HiveTableScan to an individual post-transform rule #8008

Closed zhztheplayer closed 1 day ago

zhztheplayer commented 1 day ago

Following https://github.com/apache/incubator-gluten/pull/7268, move the new code to an individual rule PruneNestedColumnsInHiveTableScan.

The reason is HiveTableScanNestedColumnPruning actually matches on a project + hive scan pattern so is not simply offloading a project. Move the code out from OffloadSingleNode which targets to handle one single query plan node.

github-actions[bot] commented 1 day ago

https://github.com/apache/incubator-gluten/issues/7267

zhztheplayer commented 1 day ago

Hi @KevinyhZou @rui-mo Would you help review this, thanks.

github-actions[bot] commented 1 day ago

Run Gluten Clickhouse CI on x86

KevinyhZou commented 1 day ago

LGTM