Compressing the metadata json file.

Netflix / iceberg

Iceberg is a table format for large, slow-moving tabular data

Apache License 2.0

476 stars 59 forks source link

Compressing the metadata json file. #79

Closed Parth-Brahmbhatt closed 5 years ago

rdblue commented 5 years ago

@Parth-Brahmbhatt, because this is a forward-incompatible change, we need to have an option that enables compression. That way, you can deploy this version safely and only enable the breaking change once all infrastructure has been updated to read compressed metadata files.

Parth-Brahmbhatt commented 5 years ago

Added a system property.

rdblue commented 5 years ago

Looks good. I'll merge when tests are passing.