Data: CESM

[paigem]

• [x] Find high-res atmospheric data
• [x] List available variables
• [ ] Add to cloud

[paigem]

I think that I have found the atmospheric dataset that corresponds to the CESM POP data that is already on Pangeo Cloud (model: hybrid_v5_rel04_BC5_ne120_t12_pop62). All output for the model run can be found here on NCAR's Climate Data Gateway, that allows for direct download.

It looks like we have 3 temporal outputs available: monthly averages, daily averages, and 6-hour snapshots. Unfortunately, the 6-hourly output does not have the variables we want, so it looks like using daily averages is the way to go. Link to the daily averaged output.

I've included a screenshot below that lists all of the available variables at daily output. As far as I can tell, it includes most of the terms we would want, e.g. sensible and latent heat fluxes, radiative heat fluxes, wind speed, wind stress, surface temperature, and humidity.

@cisaacstern This data is from the same data portal that the CESM low-res dataset was from that you added to the cloud last year. I'm hoping that means that adding this dataset will be relatively straightforward! 🙂

@rabernat and @jbusecke - should @cisaacstern get started on this now, or are there other priorities to address first?

[paigem]

Finally making some progress on this! Hit a snag because I was looking at the "atmosphere daily output" and not the "atmosphere re-gridded daily output"... Turns out that the not re-gridded fields are output straight as an unstructured quadrilateral mesh on a cubed sphere, and very difficult to understand the lat/lon values. But the re-gridded output looks much more familiar, so I'm back up and running on this.

[jbusecke]

Is that output regridded on the ocean grid? Or a coarser lat/lon grid? I think using the regridded one is fine for now, but to get the most comparable results, we should probably look into the raw data too at some point. Could you paste an example of the raw data by any chance?

[paigem]

Quick update on the Pangeo Forge recipe for the CESM atmosphere data after a great chat with @cisaacstern 🎉:

• I have a recipe nearly ready to go! 🚀
• Ran into an OSError when trying to run locally (will discuss this with Ryan tonight, likely put in an issue to Pangeo Forge and link to it from here) which Charles can probably fix in the next week or two 💪
• Some of the variables are not available for the full 41 years from year 46 to 86 (see list below). I don't think any of these fields are needed for our first goals in this project, so I plan to leave these out of the recipe for now.
  • ICEFRAC goes from year 51 to 86 (ice fraction)
  • Q850, QREFHT, T850, TREFHT, U200, U850, V200, V850, Z200, Z500 goes from year 77 to 86 (humidity, temperature, velocity, and Geopotential height at 200, 850, ... mbar or at reference height)
  • QBOT, TBOT, Z1000 goes from year 46 to 76 (BOT --> bottom)

[paigem]

Update here: we have 2 years of CESM data through Pangeo Forge! 🎉

I'm keeping this open as a flag to eventually obtain a longer time series. I believe that we have ~10 years of data we could work with.