Closed jjk-code-otter closed 1 year ago
I added a simple summary file which contains all the data for a zip file in one simple csv file. It's not ideal though, because it doesn't contain the metadata and breaks the traceability.
A better solution would take each of the files, and merge them using the BADC format, but the format isn't really set up for that.
I put together a jinja2 template which will output BADC metadata for multiple data sets in a single file, but I haven't yet added the data writing component of that. Once complete this will replace the simple summary file. The header will be a monster, so we'll see how that goes with users.
As a user of the data, I want to have all the data in one file, so that I can read it in and plot it easily.
Currently, there is one data file per dataset which is awkward for anyone using the data. The reason for this was that the BADC format is set up that way and doesn't really work well for multiple datasets because the headers get very long and complex. Netcdf format is not an option for the regular user.