Allow all protocols supported by the netcdf java library to be aggregated

aodn / geoserver-build

Configures a GeoServer war containing extensions and configuration required by AODN instances

Other

2 stars 4 forks source link

Allow all protocols supported by the netcdf java library to be aggregated #265

Closed jonescc closed 6 years ago

jonescc commented 6 years ago

by the core aggregator library.

local filename (with a file: prefix or no prefix) for netCDF (version 3), hdf5 files etc
OpenDAP dataset URL (with a dods:, dap4:, or http: prefix).
NcML file or URL if the location ends with .xml or .ncml
NetCDF file through an HTTP server (http: prefix)
thredds dataset (thredds: prefix)

Build a standalone executable that can be used to aggregate files using the aggregator (I've been using this to test http aggregations)

jonescc commented 6 years ago

Pull request updated. Allows aggregation of local files, opendap datasets, ncml files, netcdf files over http and thredds datasets via the core aggregation library and the command line. Used this for testing performance of aggregations over http and from s3.

gsatimos commented 6 years ago

@jonescc I grabbed this from the board to PR. Is there an associated backlog or issue to do with this?

jonescc commented 6 years ago

Was done for a backlog item some time ago which required some benchmarking to be performed on AWS of different options. Its a command line utility for aggregating files using the core library used by javaduck.