search

Unidata / thredds

THREDDS Data Server v4.6
https://www.unidata.ucar.edu/software/tds/v4.6/index.html
266 stars 179 forks source link

Add streaming response to NCSS #795

Open lesserwhirls opened 7 years ago

lesserwhirls commented 7 years ago

Currently, the NetcdfSubset Service will satisfy a request by returning a file in one of the following formats:

netCDF
netCDF-4
xml
csv
geocsv
WaterML (PointFeature Collections only)

One of the biggest users of NCSS on our TDS is our python client, Siphon. Siphon requests are only made to NCSS due to the ability to subset in geospatial coordinates, and having a file returned is not actually the point. In fact, the typical user of Siphon may not even be aware that a file has been returned, as it's done in a transparent way to the library end-user.

What would be nice is to enable a streaming protocol response to NCSS, such as cdmRemote or dap4. As a bonus, this would also help alleviate backlogs we are seeing on our TDS due to the serialized nature of writing netCDF4 files to disk, when the most popular NCSS client does not actually need a file to be returned to work.

This is something to look into for v5.x, and not 4.x.

DennisHeimbigner commented 7 years ago

Should this be targeted at thredds 4.x or 5.x?

lesserwhirls commented 7 years ago

I think 5.x would be best.