leap-stc / data-management

Collection of code to manually populate the persistent cloud bucket with data
https://catalog.leap.columbia.edu/
Apache License 2.0
0 stars 5 forks source link

Automatically add 'latest' PGF datasets to catalog page #25

Closed jbusecke closed 4 months ago

jbusecke commented 1 year ago

Is there a way we could parse the information from the feedstock meta.yaml automatically into the data catalog somehow?

cc @andersy005

The one thing I have not figured out is how to provide the zarr url from the latest run of a recipe, but populating the metadata would already be a big step.

jbusecke commented 4 months ago

This is being solved by the new bakery design (see #98 and forthcoming docs).