search

leap-stc / data-management

Collection of code to manually populate the persistent cloud bucket with data
https://catalog.leap.columbia.edu/
Apache License 2.0
0 stars 5 forks source link

Add Google ARCO ERA5 data #132

Closed jbusecke closed 4 days ago

jbusecke commented 1 week ago

I just got this error and am a bit confused by it. I assume it has something to do with the fact that I removed the recipe object in meta.yaml here (this is supposed to simply link an existing arco dataset.

Secondly could we have caught this on the repo CI checks @andersy005? Could you explain what is different between 'validate-and-generate' and 'validate' which ran successfully on the feedstock?

norlandrhagen commented 1 week ago

I think this lint PR https://github.com/leap-stc/arco-era5_feedstock/pull/3 to the yaml should fix the catalog validation error.

norlandrhagen commented 5 days ago

I think this should be G2G @jbusecke

andersy005 commented 5 days ago

Secondly could we have caught this on the repo CI checks @andersy005? Could you explain what is different between 'validate-and-generate' and 'validate' which ran successfully on the feedstock?

i just checked, and there are some small differences in the validation script when validating a single feedstock (which is what happens in validate) versus a list of feedstocks (in validate-and-generate). i can look into merging both approaches in a consistent manner at a latter time.