Introduces experimental RecordFilter which allows filtering Parquet records based on their index in the file.
Series of improvements in a listing partitioned directory. The most prominent change is an eager filtering of the partition directory during the traversal of the directory tree. Thanks to that we can avoid redundant listings of directories wich do not match the filter.
RecordFilterwhich allows filtering Parquet records based on their index in the file.