GoGoDuck should pack output files to reduce their size

[dnahodil]

Reported by @rogerpoctor

Selecting 3 files as per report below

Aggregation will use only the following variables for srs: 'time,lat,lon,dt_analysis,l2p_flags,quality_level,satellite_zenith_angle,sea_surface_temperature,sses_bias,sses_count,sses_standard_deviation,sst_dtime,wind_speed,wind_speed_dtime_from_sst', any other variable will be omitted!!
Applying subset 'TIME,2015-10-29T03:20:00.000Z,2015-11-01T03:20:00.000999Z;LATITUDE,-90.0,90.0;LONGITUDE,-180.0,180.0'
Processing file '20151031032000-ABOM-L3S_GHRSST-SSTskin-AVHRR_D-1d_day-v02.0-fv01.0.nc'
Processing file '20151030032000-ABOM-L3S_GHRSST-SSTskin-AVHRR_D-1d_day-v02.0-fv01.0.nc'
Processing file '20151101032000-ABOM-L3S_GHRSST-SSTskin-AVHRR_D-1d_day-v02.0-fv01.0.nc'
Your aggregation was successful!

results in a downloaded file size of 546 MB (573,041,346 bytes) IMOS-Aggregation-20151105T091550.740+1100.nc

whereas on THREDDS the filesizes are: 20151101032000-ABOM-L3S_GHRSST-SSTskin-AVHRR_D-1d_day-v02.0-fv01.0.nc 67.19 Mbytes 2015-11-04T02:35:35Z 20151031032000-ABOM-L3S_GHRSST-SSTskin-AVHRR_D-1d_day-v02.0-fv01.0.nc 62.89 Mbytes 2015-11-03T02:38:30Z 20151030032000-ABOM-L3S_GHRSST-SSTskin-AVHRR_D-1d_day-v02.0-fv01.0.nc 57.43 Mbytes 2015-11-02T02:34:40Z

i.e. a total (67.19+62.89+57.43MB) of less than 190MB. Why the huge discrepancy?

@danfruehauf responded:

The SRS files are "packed" (ncpdq), the result file is not packed, hence the size difference.

So the request is that GoGoDuck packs the output files to reduce their size.

[anguss00]

lock and load @dnahodil ;-)

[dnahodil]

Just doing some housekeeping while I wait for a VM to start up ;)