search

asascience-open / nextgen-dmac

Public repository describing the prototyping efforts and direction of the Next-Gen DMAC project, "Reaching for the Cloud: Architecting a Cloud-Native Service-Based Ecosystem for DMAC"
MIT License
18 stars 4 forks source link

Generate metadata json example files #14

Closed jonmjoyce closed 5 months ago

jonmjoyce commented 1 year ago

The schema doesn't matter right now but should have the basic elements like name, time, dimensions, variables - basically what you see in a netcdf file. Also anything important encoded in the filename, and any other metadata elements that you think are important to users. A generic extraction script for netcdf would be nice down the line but for now whatever is easiest to produce those is fine.

These files will be used to prove out some of the other services.

rsignell-usgs commented 1 year ago

@jonmjoyce @benjwadams, for capturing metadata, I would recommend checking out xstac, which can generate STAC metadata from xarray datasets. (@TomAugspurger is one of the lead developers on Microsoft's Plantetary Computer)

Here's a good recent article about STAC and Cloud-Native Geospatial.

Once we've captured all our content as STAC catalog items, we should make that metadata searchable using the STAC API (we should set up a STAC API endpoint and ingest process)