New Dataset: GPM IMERG Zarr Pyramid

abarciauskas-bgse commented 1 month ago

Contact Details

aimee@developmentseed.org

URL/DOI

No response

Data License Identifier

No response

Data Location

s3://nasa-eodc-public/GPM_3IMERGDF.07

Size Estimate

19.3 MiB

Number of Items

797

Description

Zarr pyramid for GPM IMERG dataset subset (June 1-8, 2000)

Collection Creation Notebook

https://github.com/developmentseed/stac-explorer/blob/main/notebooks/create-stac-for-cmr-collections.ipynb

Item Creation Notebook

n/a

Checklist

This is zarr data so these items do not apply

~Files are valid COGs. Use rio cogeo validate~
~COGs appear to be correct~

Any additional info you think is relevant, possibly including spatial or temporal subset if applicable?

Metadata: The notebook for collection creation creates metadata for GPM IMERG itself. They pyramid metadata has important modifications:

temporal extent in both the data cube extension and collection metadata is only for June 1-8, 2000
"multiscale": true, is a part of each renders object
The URL should be included in each renders object: "url": "s3://nasa-eodc-public/GPM_3IMERGDF.07"

Data files (zarr store):

s3://nasa-eodc-public/ is a public bucket (in the SMCE VEDA AWS account). We could in theory publish the data from that bucket but I would assume there are or could be some configurations for s3://veda-data-store-staging which we want use for this data (such as monitoring and access controls) if we are to publish it to the VEDA STAC API.

To Do

[ ] Open PR for publishing those datasets to the Staging API
[ ] Notify QA / move ticket to QA state
[ ] Once approved, merge and close

ividito commented 4 weeks ago

@abarciauskas-bgse This collection is available in our staging catalog: ~~- https://staging-stac.delta-backend.com/collections/combined_CMIP6_daily_GISS-E2-1-G_tas_kerchunk_TEST~~

https://staging-stac.delta-backend.com/collections/GPM_3IMERGDF_zarr

Let me know if there are any changes that need to be made.

abarciauskas-bgse commented 3 weeks ago

@ividito thank you for working on this - that link is to the existing CMIP6 kerchunk dataset, is there another link for s3://nasa-eodc-public/GPM_3IMERGDF.07?

ividito commented 3 weeks ago

Sorry about that @abarciauskas-bgse, it was the wrong link. Correct link here: https://staging-stac.delta-backend.com/collections/GPM_3IMERGDF_zarr

abarciauskas-bgse commented 2 weeks ago

@ividito sorry for the additional work but could we actually remove this dataset? We have decided to deprioritize the zarr pyramid support for now, as it's not a current request of VEDA.

NASA-IMPACT / veda-data