[FEA] Replace `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

789 stars 228 forks source link

[FEA] Replace `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter #2082

Open nartal1 opened 3 years ago

nartal1 commented 3 years ago

Is your feature request related to a problem? Please describe. ParquetFileReader.readFooter related methods has been identified as Deprecated and Apache Parquet suggests replace it with the combination of ParquetFileReader.open() and getFooter() methods.

commit: https://github.com/apache/spark/commit/43f355b

We have readFooter in GpuParquetScan.scala. Need to update the file.

abellina commented 2 years ago

Please see: https://github.com/NVIDIA/spark-rapids/pull/5051.