NasjonaltBakkeSegment / safe_to_netcdf

Python scripts for converting specific Copernicus Sentinel products in Standard Archive Format for Europe (SAFE) to NetCDF/CF
GNU General Public License v3.0
6 stars 5 forks source link

NetCDF file size has doubled for Sentinel 2 data #12

Open ElodieFZ opened 3 years ago

ElodieFZ commented 3 years ago

Since March 2021, the average size for the Sentinel 2 products has gone from ~0.7G to ~1.5G. When looking at the reference products, there are numerically identical (in the sense np.close) and their headers are identical. But I can now see that centos_v0 files are half the size of centos_v1 files.

It is most likely linked to the change from the module system to the conda environment, which has most liketly led to a change in the version of the netcdf module used? As the files are virtually identical except for size, I assume that the problem is with the compression and/or chunksize options.

Somehow, Sentinel1 files are not affected by the problem.