[Kernel] Refactor ParquetBatchReader converter APIs

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

6.98k stars 1.6k forks source link

[Kernel] Refactor ParquetBatchReader converter APIs #1859

Open allisonport-db opened 11 months ago

allisonport-db commented 11 months ago

As noted in the comments here https://github.com/delta-io/delta/pull/1856#discussion_r1239171329 https://github.com/delta-io/delta/pull/1856#discussion_r1239172398 refactor the changes in that PR.

Change moveToNextRow() --> moveToNextRow(long index) everywhere
Update FileRowIndexColumnConverter to not extend LongColumnConverter

Adityamalik123 commented 2 weeks ago

@allisonport-db Can this be assigned to me?