Notebook(s) reconstructing 2 figures from Kay et al. (2015) paper (Figs 2 & 4)

[andersy005]

Paper: https://journals.ametsoc.org/doi/full/10.1175/BAMS-D-13-00255.1

• Fig. 2. Global surface temperature anomaly (1961–90 base period) for the 1850 control, individual ensemble members, and observations (HadCRUT4; Morice et al. 2012). NB: w/o pre-1920 for now
• Fig. 4. Global maps of historical (1979–2012) boreal winter (DJF) surface air temperature trends for each of the 30 individual CESM-LE members, the CESM-LE ensemble mean (denoted EM), and observations (denoted OBS based on GISTEMP; Hansen et al. 2010).

NB: w/o obs data for now

TO DO:

Use https://esip.pangeo.io for compute

• [ ] Document the notebook
• [ ] Add Hadcrut4 observations to the intake catalog?
• [ ] Compute weighted spatial means for model data
• [ ] Compute weighted temporal mean for obs data
• [ ] Confirm that after using area weighted average, max temp increase is 5k
• [ ] When computing trends for boreal winter seasons (DJF), include only full seasons from 1979 and 2012??
• [ ] Polish Figure 4

@jhamman, I just wanted to let you know that the intake static catalogs are now available (#3). Let me know how I can help with this task.

Cc @bonnland, @jeffdlb, @sethmcg

[jhamman]

I've gotten a start on this. My goal is to setup a basic notebook creating the two figures listed above. Then hand it off to others for fine tuning. I hope this will be a useful demonstration of tools and a sufficient primer to get others rolling.

[jeffdlb]

Thanks, Joe!

On Tue, Sep 3, 2019, 11:42 Joe Hamman <notifications@github.com wrote:

I've gotten a start on this. My goal is to setup a basic notebook creating the two figures listed above. Then hand it off to others for fine tuning. I hope this will be a useful demonstration of tools and a sufficient primer to get others rolling.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NCAR/cesm-lens-aws/issues/4?email_source=notifications&email_token=ABF4W4SJA3PHNRJOABNAWU3QH2AVJA5CNFSM4ITBTXZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5YUEVI#issuecomment-527516245, or mute the thread https://github.com/notifications/unsubscribe-auth/ABF4W4SISAENYATHHFLJWVTQH2AVJANCNFSM4ITBTXZQ .

[andersy005]

@sethmcg, I just moved your comment here since this issue is still open

Do we have a good sense of who the target audience is for this notebook? I think it may need more commentary about what various bits of code do, but I don't know what we want to assume about what the reader already knows.

Originally posted by @sethmcg in https://github.com/NCAR/cesm-lens-aws/pull/5#issuecomment-528010473

[andersy005]

I could use some feedback on this PR #6. I added functionality to compute:

• weighted spatial means for model data
• weighted temporal mean for obs data

Rendered notebook: https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0

[andersy005]

@jhamman,

TODO: Figure out why dask workers are dying when using the k8s cluster

I didn't experience any issue with dask kubernetes on https://esip.pangeo.io . I am not sure what was wrong on http://icesat2.pangeo.io

[jeffdlb]

Hi Anderson-

Thanks for working on this. I was just putting together a slide for my talk Thursday showing the original figures and your JNB reproductions. Fig 2 matches nicely, but Figure 4 seems different when each globe is inspected in detail. Not sure if that is a data issue or color palette choice or what.

-Jeff

PS. CCing NCAR S@S list because I think your original message only went out to a few of us.

Jeff de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Wed, Sep 4, 2019 at 10:54 PM Anderson Banihirwe notifications@github.com wrote:

I could use some feedback on this PR #6 https://github.com/NCAR/cesm-lens-aws/pull/6. I added functionality to compute:

• weighted spatial means for model data
• weighted temporal mean for obs data

Rendered notebook: https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NCAR/cesm-lens-aws/issues/4?email_source=notifications&email_token=ABF4W4S2TB5XHVVKVWI7OR3QIAN6TA5CNFSM4ITBTXZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD546MVY#issuecomment-528082519, or mute the thread https://github.com/notifications/unsubscribe-auth/ABF4W4TBWNRX5C4VL4NT4ATQIAN6TANCNFSM4ITBTXZQ .

[jeffdlb]

Anderson, Joe et al.-

Thanks again for work done so far on the Jupyter Notebook for CESM LENS on AWS. Given that we have Sept 27 deadline to submit documentation such as this prior to AWS Public Dataset announcement, I have a couple of questions and requests if possible:

• The "rendered notebook" at https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0 is a static document. Is a "live notebook" available somewhere?
• The very first step in the notebook gets observational data from a different source to compare with LENS to reproduce Figure 2. Can we move that to just before the obs data are needed, such that the initial parts of the JNB are clearly about LENS?
• Can we add more text/commentary to the notebook to explain what is being done? I would be happy to help with that but not sure about the procedure.
• Can others modify this JNB if you are short on time?

Finally, I note that we can actually start charging some hours to a new account key for "science at scale" if that helps. I have the equivalent of about 1 FTE of time that I can allocate in CISL.

Best regards, Jeff DLB

Jeff de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Mon, Sep 9, 2019 at 9:52 AM Jeff de La Beaujardiere jeffdlb@ucar.edu wrote:

Hi Anderson-

Thanks for working on this. I was just putting together a slide for my talk Thursday showing the original figures and your JNB reproductions. Fig 2 matches nicely, but Figure 4 seems different when each globe is inspected in detail. Not sure if that is a data issue or color palette choice or what.

-Jeff

PS. CCing NCAR S@S list because I think your original message only went out to a few of us.

Jeff de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Wed, Sep 4, 2019 at 10:54 PM Anderson Banihirwe < notifications@github.com> wrote:

I could use some feedback on this PR #6 https://github.com/NCAR/cesm-lens-aws/pull/6. I added functionality to compute:

• weighted spatial means for model data
• weighted temporal mean for obs data

Rendered notebook: https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NCAR/cesm-lens-aws/issues/4?email_source=notifications&email_token=ABF4W4S2TB5XHVVKVWI7OR3QIAN6TA5CNFSM4ITBTXZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD546MVY#issuecomment-528082519, or mute the thread https://github.com/notifications/unsubscribe-auth/ABF4W4TBWNRX5C4VL4NT4ATQIAN6TANCNFSM4ITBTXZQ .

[andersy005]

@jeffdlb,

here's the new version of the notebook: https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0?flush_cache=true

[andersy005]

@jeffdlb

• The very first step in the notebook gets observational data from a different source to compare with LENS to reproduce Figure 2. Can we move that to just before the obs data are needed, such that the initial parts of the JNB are clearly about LENS?

This is fixed

• Can we add more text/commentary to the notebook to explain what is being done? I would be happy to help with that but not sure about the procedure.

It would be nice to document the notebook

I would be happy to help with that but not sure about the procedure.

I suggest:

• Forking this repo

• Heading over to https://esip.pangeo.io, authenticating to get a JupyterLab interface

• Once you are authenticated, you will be presented with three option of cluster configurations to choose from, choose the first option

  

• Once you are logged in, open the terminal: File -> New -> Terminal

• Clone your fork: git clone https://github.com/username/cesm-lens-aws.git

• Click on the File Browser icon at the top left corner, the cesm-lens-aws directory should be available after the cloning, and you are good to go

Let me know if you have any question.

[jeffdlb]

Originally posted by: @andersy005

Hi all,

Joe and I were wondering whether someone knows if, included in the main LENS archive, there was a 2d field of grid cell areas for the atmosphere, and land components? As far as I can remember, I've only seen these grid cell area fields for the T grid, and U grid used in cice and ocean components.

On Thu, Sep 12, 2019 at 2:45 AM Jeff de La Beaujardiere jeffdlb@ucar.edu wrote:

Anderson, Joe et al.-

Thanks again for work done so far on the Jupyter Notebook for CESM LENS on AWS. Given that we have Sept 27 deadline to submit documentation such as this prior to AWS Public Dataset announcement, I have a couple of questions and requests if possible:

• The "rendered notebook" at https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0 is a static document. Is a "live notebook" available somewhere?
• The very first step in the notebook gets observational data from a different source to compare with LENS to reproduce Figure 2. Can we move that to just before the obs data are needed, such that the initial parts of the JNB are clearly about LENS?
• Can we add more text/commentary to the notebook to explain what is being done? I would be happy to help with that but not sure about the procedure.
• Can others modify this JNB if you are short on time?

Finally, I note that we can actually start charging some hours to a new account key for "science at scale" if that helps. I have the equivalent of about 1 FTE of time that I can allocate in CISL.

Best regards, Jeff DLB

Jeff de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Mon, Sep 9, 2019 at 9:52 AM Jeff de La Beaujardiere jeffdlb@ucar.edu wrote:

Hi Anderson-

Thanks for working on this. I was just putting together a slide for my talk Thursday showing the original figures and your JNB reproductions. Fig 2 matches nicely, but Figure 4 seems different when each globe is inspected in detail. Not sure if that is a data issue or color palette choice or what.

-Jeff

PS. CCing NCAR S@S list because I think your original message only went out to a few of us.

Jeff de La Beaujardiere, PhD Director, NCAR/CISL Information Systems Division https://staff.ucar.edu/users/jeffdlb https://orcid.org/0000-0002-1001-9210

On Wed, Sep 4, 2019 at 10:54 PM Anderson Banihirwe < notifications@github.com> wrote:

I could use some feedback on this PR #6 https://github.com/NCAR/cesm-lens-aws/pull/6. I added functionality to compute:

• weighted spatial means for model data
• weighted temporal mean for obs data

Rendered notebook: https://nbviewer.jupyter.org/gist/andersy005/00c2798f9200c3a2a14f8ea845ba15a0

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NCAR/cesm-lens-aws/issues/4?email_source=notifications&email_token=ABF4W4S2TB5XHVVKVWI7OR3QIAN6TA5CNFSM4ITBTXZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD546MVY#issuecomment-528082519, or mute the thread https://github.com/notifications/unsubscribe-auth/ABF4W4TBWNRX5C4VL4NT4ATQIAN6TANCNFSM4ITBTXZQ .

--

Anderson Banihirwe Software Engineer, I/O & Workflow Applications (IOWA)

The National Center for Atmospheric Research Computational and Information Systems Laboratory 1850 Table Mesa Dr Boulder, CO 80305

Phone: (303) 497-2494 Office: ML-494 Web: https://andersonbanihirwe.dev