background: netCDF file writing (iteratively, per variable) and compression take place in pytesmo.validation_framework.results_manager(). the compression was implemented via pynetcf library, leveraging all tools possible (compression: zlib, complevel: 4, autoscaling: true). though, it was found, that by opening the just-written netCDF file and writing it to a new file, this new file may require considerably less disc space. even if both complevel and compression were kept the same.
Therefore, I added a function re_compressor(), which opens the output netCDF file after it was written, compresses it according to (hardcoded) parameters and writes it again to a file. the old file is then deleted and the new file renamed to match the original qa4sm output
further, qa4sm output files now contain the qa4sm-reader.__version__ as global attr
pytesmo.validation_framework.results_manager()
. the compression was implemented via pynetcf library, leveraging all tools possible (compression: zlib, complevel: 4, autoscaling: true). though, it was found, that by opening the just-written netCDF file and writing it to a new file, this new file may require considerably less disc space. even if both complevel and compression were kept the same.Therefore, I added a function
re_compressor()
, which opens the output netCDF file after it was written, compresses it according to (hardcoded) parameters and writes it again to a file. the old file is then deleted and the new file renamed to match the original qa4sm outputfurther, qa4sm output files now contain the
qa4sm-reader.__version__
as global attr