search

fsspec / GSoC-kechunk-2022

MIT License
2 stars 2 forks source link

Develop code to convert NcML to Kerchunk JSON? #7

Open rsignell-usgs opened 2 years ago

rsignell-usgs commented 2 years ago

The NetCDF Markup Language (NcML) has been widely used for decades to create virtual NetCDF datasets that point to collections of NetCDF files and add/modify global and variable metadata and/or values.

It would be very useful to have a package that parses this info from an NcML XML file and generates the equivalent Kerchunk JSON virtual dataset.

A fairly complicated example of NcML that aggregates a collection of ROMS NetCDF files and makes them CF and SGRID compliant is here:

https://github.com/rsignell-usgs/xml/blob/master/THREDDS/geoport/COAWST_catalog.xml

martindurant commented 2 years ago

Starting with the easy example!

Worth saying, is that this would allow us to make use of the effort already put into these NcML prescriptions, to provide aggregate (multi-file) datasets without needing a thredds or any other server.