Support to transfer the parquet file SeekableInputStream when build ParquetFileReader

apache / parquet-java

Apache Parquet Java

https://parquet.apache.org/

Apache License 2.0

2.65k stars 1.41k forks source link

Support to transfer the parquet file SeekableInputStream when build ParquetFileReader #3031

Closed turboFei closed 3 weeks ago

turboFei commented 1 month ago

Describe the enhancement requested

For our use case, we cache the parquet file input stream when reading the parquet file footer. And then, when reading the parquet file, we reuse the SeekableInputStream to reduce the RPC to HDFS.

Component(s)

No response