search

pangeo-data / pangeo-datastore

Pangeo Cloud Datastore
https://catalog.pangeo.io
48 stars 16 forks source link

Accessing Pangeo data on AWS storage #120

Closed charlesbluca closed 3 years ago

charlesbluca commented 3 years ago

I am trying to consolidate the metadata of hydro.nldas_hru_forcing and hydro.usgs_streamflow_observations as part of #119, but both reside in S3 and I do not have access to Pangeo's AWS project.

@scottyhq, are you able to give access to the project? If I know the steps to getting set up on AWS I can also document them in this repo's README and elsewhere.

scottyhq commented 3 years ago

Hi @charlesbluca If you need access to aws-uswest2.pangeo.io, you just need to fill out the form here https://pangeo.io/cloud.html#sign-up

If you need an IAM account with credentials on AWS that could probably be arranged, but I'm not sure we want to support these datasets in the long term, so we should consider moving them to some other storage system or different account.

@jhamman or @rsignell-usgs might have ideas about where these USGS datasets should ultimately reside

charlesbluca commented 3 years ago

That's good to know! I'll fill out the form, and hopefully we can work out a different location - if we are comfortable with cross platform access, maybe these could be put in the CMIP6 buckets on Google Cloud and S3, in a similar fashion to our GFDL CM 2.6 products.

github-actions[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.