search

apache / parquet-java

Apache Parquet Java
https://parquet.apache.org/
Apache License 2.0
2.64k stars 1.41k forks source link

parquet.thrift refers to wrong releases for the new compressions #2143

Closed asfimport closed 6 years ago

asfimport commented 6 years ago

parquet.thrift contains the following:

/**  * Supported compression algorithms.  *  * Codecs added in {color:red}2.3.2{color} can be read by readers based on {color:red}2.3.2{color} and later.  * Codec support may vary between readers based on the format version and  * libraries available at runtime. Gzip, Snappy, and LZ4 codecs are  * widely available, while Zstd and Brotli require additional libraries.  */ enum CompressionCodec {   UNCOMPRESSED = 0;   SNAPPY = 1;   GZIP = 2;   LZO = 3;   BROTLI = 4; // Added in {color:red}2.3.2{color}   LZ4 = 5; // Added in {color:red}2.3.2{color}   ZSTD = 6; // Added in {color:red}2.3.2{color} ``}

In reality, there was no 2.3.2 release. These compression codecs were added in version 2.4.

Reporter: Zoltan Ivanfi / @zivanfi Assignee: Zoltan Ivanfi / @zivanfi

Related issues:

Note: This issue was originally created as PARQUET-1242. Please see the migration documentation for further details.

asfimport commented 6 years ago

Zoltan Ivanfi / @zivanfi: Issue resolved by pull request 87 https://github.com/apache/parquet-format/pull/87