ECCC-CCCS / CMIP6-CanDCS-Quality-Control

Code and script repository for QAQC work on downscaled CMIP6
1 stars 1 forks source link

Extreme Values for Temperature #32

Open juliettelavoie opened 2 years ago

juliettelavoie commented 2 years ago

The health checks I ran flagged extremely high daily temperature (>60 degC) in HadGEM3-GC31-LL and UKESM1-0-LL (ssp245 and ssp585). The maximum temperature hits 64 degC. The position of the maximum is not the same in both SSPs. The extremes are only present for 1 day.

t1 t2 t3 t4

Any ideas on the cause of the extremes?

How should we handle these extreme values?

Should Ouranos replace the extremely high data by a NaN before calculating their indicators? Was it removed by PCIC before calculating their indicators ? If not, removing it in the Ouranos calculations would lead to non-uniform data for all indicators... Same question as for issue #30.

The code to reproduce the figure is in section Potential Issue 3 of the QAQC-CMIP6-BCCAQv2.ipynb.

juliettelavoie commented 2 years ago

After internal discussions at Ouranos, our plan is to put NaNs on pr>300 mm d-1 and tasmax>60 degC before doing the indicator calculations. Any objections?

laura-vanvliet commented 2 years ago

For each model and SSP I calculated the skew and kurtosis of a 10-year slice (2070-2079) for BCCAQ tasmin and tasmax. The absolute maximum over all models/SSPs is shown in figures below, and indicates that tasmin and tasmax don't have many concerning outliers. The only thing of note, for tasmin, the large range for kurtosis comes from 4 cells (invisible at this scale) on western Vancouver Island that have large tasmin outliers (-30 C), not present on adjacent cells. These are also present in CMIP5 BCCAQ. One caution from this might be NaNing out values based on a single threshold for all of Canada. This would miss the anomalous tasmin values. This analysis also doesn't recognize any abnormal outliers from high tasmax (at least for this time period). I plan to do the same analysis for all Climdex indices to see if the abnormal values are impacting indices. all_mod_abs_max_sk_kurt_tasmin_tasmax

juliettelavoie commented 2 years ago

Interesting, my health checks indeed didn't flag any problem with tasmin (the threshold was -90degC).

laura-vanvliet commented 2 years ago

The tasmin outlier issue is not with the absolute values (only -30 C), but with their value relative to the statistical distribution of data, as well as the location. There shouldn't be temperatures this low on Vancouver Island (and aren't on adjacent cells).

juliettelavoie commented 2 years ago

Yes, I understand! I meant to say that I see the value in your approach, as mine didn't flag something that is clearly wrong. :)

ssobie commented 2 years ago

It looks like the high maximum temperature values originate from the GCMs. These values end up affecting multiple grid cells in the downscaled simulations. They do seem anomalous in the GCM simulations compared to the surrounding cells. The dates from the GCM may not match the downscaled dates exactly due to the reordering step. They will occur in the same month though.

tasmax_day_HadGEM3-GC31-LL_SSP245_2094-07-15_GCM tasmax_day_HadGEM3-GC31-LL_SSP585_2064-07-19_GCM tasmax_day_UKESM1-0-LL_SSP245_2100-08-19_GCM tasmax_day_UKESM1-0-LL_SSP585_2097-08-05_GCM

juliettelavoie commented 2 years ago

Thank you @ssobie for finding the origin of the issue!

JeremyFyke commented 2 years ago

Yes, thanks @ssobie !

juliettelavoie commented 2 years ago

After more discussion, we won't do any masking as we are short on time to do it properly. As the problem is only in a few places and a few models, it should not show up in the 10,50,90 percentiles.

ssobie commented 2 years ago

That should be fine, the only other GCM with temperatures above 60 C in multiple cells within Canada is KACE-1-0-G. There is also one cell of CanESM5 r5i1p2f1 SSP585 on the Manitoba-US border that reaches 60.7 C, but none of the CanESM5 simulations do. None of the other GCMs exceed 60 C in Canada. Interestingly, the UKESM1-0-LL GCM simulates temperatures up to 86.5 C in the US and has a global maximum of 98 C on the west coast of Australia.

JeremyFyke commented 2 years ago

Hi all: we have heard back from UKESM/HadGEM3 folks re: this issue. These spikes are a known/documented problem, see model errata here:

https://errata.es-doc.org/static/view.html?uid=76b3f818-d65f-c76b-bfd8-cae5bc27825c

In short, they assess issue to be sporadic inability of atmospheric subgrid mixing model component to mix away accumulated heat in a surface grid cell by sensible heat transfer, in a particular model timestep. This is a problem that would only impact maximum temperatures, not minimum temperatures.