does arrow2 support filter pushdown in parquet reader

jorgecarleitao / arrow2

Transmute-free Rust library to work with the Arrow format

Apache License 2.0

1.06k stars 222 forks source link

does arrow2 support filter pushdown in parquet reader #1543

Open zinking opened 1 year ago

zinking commented 1 year ago

not seeing any generic expression related filter here, is it supported?

ritchie46 commented 1 year ago

Arrow2 doesn't support it directly, but it can be implemented by libraries that use arrow2. For instance polars supports it and uses arrow2 for parquet reading.