anthoRx / parquet-sql

Apache License 2.0
3 stars 1 forks source link

Rework parquet schema definition on partitioned files #22

Open guillaumer63 opened 3 years ago

guillaumer63 commented 3 years ago

As mentioned by @anthoRx, the partition files may have different schemas, so in SQLParquetReaderWrapper we need to merge all partitioned files schemas instead of taking the first file schema.