Open fabiotakaki opened 5 years ago
I think you've already found the solution, but it would be useful for everyone else to note that the problem is probably around DATA_PAGE/DATA_PAGE_V2 specifications (see at https://github.com/ZJONSSON/parquetjs/issues/24#issuecomment-416009322) and the solution is this: https://github.com/ZJONSSON/parquetjs#notes
I don't know why, when reading the file generated by parquetjs with pyspark works fine, but when reading from pyarrow returns a empty dataframe.
In this example using spark return the table normally:
When I try by pyarrow:
Just return Empty Dataframe with the header's columns. Anyone with that problem?