NASA-IMPACT / veda-data

4 stars 0 forks source link

New Dataset: GPM IMERG Zarr Pyramid #128

Open abarciauskas-bgse opened 5 months ago

abarciauskas-bgse commented 5 months ago

Contact Details

aimee@developmentseed.org

URL/DOI

No response

Data License Identifier

No response

Data Location

s3://nasa-eodc-public/GPM_3IMERGDF.07

Size Estimate

19.3 MiB

Number of Items

797

Description

Zarr pyramid for GPM IMERG dataset subset (June 1-8, 2000)

Collection Creation Notebook

https://github.com/developmentseed/stac-explorer/blob/main/notebooks/create-stac-for-cmr-collections.ipynb

Item Creation Notebook

n/a

Checklist

This is zarr data so these items do not apply

Any additional info you think is relevant, possibly including spatial or temporal subset if applicable?

Metadata: The notebook for collection creation creates metadata for GPM IMERG itself. They pyramid metadata has important modifications:

Data files (zarr store):

s3://nasa-eodc-public/ is a public bucket (in the SMCE VEDA AWS account). We could in theory publish the data from that bucket but I would assume there are or could be some configurations for s3://veda-data-store-staging which we want use for this data (such as monitoring and access controls) if we are to publish it to the VEDA STAC API.

To Do

ividito commented 5 months ago

@abarciauskas-bgse This collection is available in our staging catalog: - https://staging-stac.delta-backend.com/collections/combined_CMIP6_daily_GISS-E2-1-G_tas_kerchunk_TEST

Let me know if there are any changes that need to be made.

abarciauskas-bgse commented 5 months ago

@ividito thank you for working on this - that link is to the existing CMIP6 kerchunk dataset, is there another link for s3://nasa-eodc-public/GPM_3IMERGDF.07?

ividito commented 5 months ago

Sorry about that @abarciauskas-bgse, it was the wrong link. Correct link here: https://staging-stac.delta-backend.com/collections/GPM_3IMERGDF_zarr

abarciauskas-bgse commented 4 months ago

@ividito sorry for the additional work but could we actually remove this dataset? We have decided to deprioritize the zarr pyramid support for now, as it's not a current request of VEDA.