NCAR / cesm-lens-aws

Examples of analysis of CESM LENS data publicly available on Amazon S3 (us-west-2 region) using xarray and dask
https://doi.org/10.26024/wt24-5j82
BSD 3-Clause "New" or "Revised" License
43 stars 23 forks source link

[Data Request]: V (meridional wind) #80

Closed cjcardinale closed 2 years ago

cjcardinale commented 2 years ago

Meridional wind (V; 3D) is absent from https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.json, despite being included in https://ncar-cesm-lens.s3.us-west-2.amazonaws.com/catalogs/aws-cesm1-le-longNames.json.

I am requesting "V" be added to "hourly6-1990-2005" and "hourly6-2071-2080" frequencies. I realize that this request is similar to #65, but that issue is closed as it appears the user was able to access the data outside of AWS.

Thank you!

jeffdlb commented 2 years ago

Chris-

Thank you for your interest in the data. I agree, we need to add the V fields -- we should not have only U without V! I will see what can be done in short order.

Regards, Jeff

J-F de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Wed, Sep 29, 2021 at 11:44 AM Chris Cardinale @.***> wrote:

Meridional wind (V; 3D) is absent from https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.json http://url, despite being included in https://ncar-cesm-lens.s3.us-west-2.amazonaws.com/catalogs/aws-cesm1-le-longNames.json http://url.

I am requesting "V" be added to "hourly6-1990-2005" and "hourly6-2071-2080" frequencies. I realize that this request is similar to

65 https://github.com/NCAR/cesm-lens-aws/issues/65, but that issue is

closed as it appears the user was able to access the data outside of AWS.

Thank you!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/NCAR/cesm-lens-aws/issues/80, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABF4W4RUDZSLYPL6B4YZP4TUENF7HANCNFSM5FAN6GBQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

mgrover1 commented 2 years ago

I can go ahead and process this - I noticed that within the config file used to generate the stores, the variable for v was v and not V, which I think is cause of this issue.

mgrover1 commented 2 years ago

@cjcardinale I had a chance to process these data this week. The data are currently being transferred to AWS. The catalog should be updated by the end of the day today/early tomorrow! Thank you for pointing out this issue.

jeffdlb commented 2 years ago

Max, thank you so much for processing these data.

-Jeff

J-F de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Thu, Oct 14, 2021 at 3:08 PM Max Grover @.***> wrote:

@cjcardinale https://github.com/cjcardinale I had a chance to process these data this week. The data are currently being transferred to AWS. The catalog should be updated by the end of the day today/early tomorrow! Thank you for pointing out this issue.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/NCAR/cesm-lens-aws/issues/80#issuecomment-943734128, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABF4W4TJNVIU5HOPP6BX7LTUG5BEVANCNFSM5FAN6GBQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

cjcardinale commented 2 years ago

Thank you so much! I was able to access the data.

import intake
cat_url = 'https://ncar-cesm-lens.s3.us-west-2.amazonaws.com/catalogs/aws-cesm1-le.json'
coll = intake.open_esm_datastore(cat_url)
cat_le = coll.search(frequency='hourly6-1990-2005', variable = 'V')
dset_dict = cat_le.to_dataset_dict(zarr_kwargs={"consolidated": True}, storage_options={"anon": True})
ds = dset_dict[list(dset_dict.keys())[0]]