AMReX-Codes / amrex

AMReX: Software Framework for Block Structured AMR
https://amrex-codes.github.io/amrex
Other
503 stars 336 forks source link

HDF5: expose ZLIB compression without SZ or ZFP flags #4015

Open arnav-singhal opened 2 days ago

arnav-singhal commented 2 days ago

Summary

Allow existing functionality to compress HDF5 output with ZLIB/GZIP to be used without the unnecessary SZ/ZFP flags (and their corresponding external packages). Updated documentation to reflect this.

Fixed bug where chunk size could exceed dataset size in the process.

Additional background

The shuffle filter allows for much greater compression at low time cost, both at read and write time, when using GZIP.

Checklist

The proposed changes: