search

C2SM / spack-c2sm

Repository for c2sm spack config and repo files
https://c2sm.github.io/spack-c2sm/latest
MIT License
7 stars 19 forks source link

Exploit zstandard compression support of NetCDF v4.9.0 #554

Closed leuty closed 7 months ago

leuty commented 2 years ago

In COSMO we currently use zlib for compressing NetCDF4 output, which is too slow when using the standard system implementation. To circumvent this performance issue we now exploit the more performant zlib-ng implementation as a replacement. Since netcdf-c 4.9.0 and netcdf-fortran 4.6.0 NetCDF provides support for the zstandard which is about as performant as zlib-ng. These new options allow removing the zlib-ng option and retiring the corresponding package.

dominichofer commented 7 months ago

COSMO becomes irrelevant soon. No more features for now.