search

ESMValGroup / ESMValTool

ESMValTool: A community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
https://www.esmvaltool.org
Apache License 2.0
218 stars 128 forks source link

AutoAssess: Add new diagnostic for radiation budget #2209

Closed Jon-Lillis closed 2 years ago

Jon-Lillis commented 3 years ago

Short description of the diagnostic The radiation budget defines which factors have more uncertainties compared with observations and statistics from other models to figure out where the imbalance of fluxes (between the atmosphere and surface of the model) comes from, because it is linked with the hydrological cycle and climate change.

Additional information This will be the first AutoAssess diagnostic converted into an ESMValTool diagnostic by @ehogan and @Jon-Lillis as part of the Met Office ESMValTool Implementation Plan. Since we're documenting this process to support future conversions, we're happy to accept nit-picky review comments. 😉

Branch and pull request radiation_budget_new_diagnostic

valeriupredoi commented 3 years ago

Welcome to ESMValTool! have you guys managed to get full contributors' credentials from @axel-lauer ? (Cheers, Axel BTW!) You can just open a Draft pull request with the branch and while work is being done we can have a look from afar (if need be), and then when it's all good for review, change it from Draft to Ready for Review :beer:

Jon-Lillis commented 2 years ago

Sample output of AutoAssess Radiation Budget scripts (HadGEM3):

Ebudget_AMIP__1981_2008_ann

Sample output of ESMValTool conversion (HadGEM3):

HadGEM3-GC31-LL

Note: Only 4 variables from the CERES dataset are currently listed in the supported dataset documentation. We'll need to add the remaining, but we'll address this in a future issue.

Jon-Lillis commented 2 years ago

Sample output of AutoAssess Radiation Budget scripts (UKESM):

Ebudget_AMIP__1981_2008_ann

Sample output of ESMValTool conversion (UKESM):

UKESM1-0-LL

Note: Only 4 variables from the CERES dataset are currently listed in the supported dataset documentation. We'll need to add the remaining, but we'll address this in a future issue.

Jon-Lillis commented 2 years ago

AutoAssess Seasonal Radiation Budget metrics

HadGEM3: Surface downwelling longwave flux in air ann,339.09822 Surface downwelling longwave flux in air djf,331.26307 Surface downwelling longwave flux in air jja,347.39699 Surface downwelling longwave flux in air mam,338.5007 Surface downwelling longwave flux in air son,339.23211 Surface downwelling shortwave flux in air ann,192.32674 Surface downwelling shortwave flux in air djf,198.75036 Surface downwelling shortwave flux in air jja,185.13546 Surface downwelling shortwave flux in air mam,191.25571 Surface downwelling shortwave flux in air son,194.16544 Surface net downward longwave flux ann,-57.53877 Surface net downward longwave flux djf,-55.9871 Surface net downward longwave flux jja,-58.68717 Surface net downward longwave flux mam,-57.44101 Surface net downward longwave flux son,-58.03981 Surface net downward shortwave flux ann,166.67668 Surface net downward shortwave flux djf,171.69825 Surface net downward shortwave flux jja,162.16218 Surface net downward shortwave flux mam,164.04489 Surface net downward shortwave flux son,168.80139 Surface upward latent heat flux ann,89.80324 Surface upward latent heat flux djf,89.37994 Surface upward latent heat flux jja,91.96428 Surface upward latent heat flux mam,90.01994 Surface upward latent heat flux son,87.8488 Surface upward sensible heat flux ann,17.9326 Surface upward sensible heat flux djf,16.84482 Surface upward sensible heat flux jja,18.96854 Surface upward sensible heat flux mam,18.81665 Surface upward sensible heat flux son,17.10038 TOA incoming shortwave flux ann,340.42053 TOA incoming shortwave flux djf,350.60595 TOA incoming shortwave flux jja,330.51954 TOA incoming shortwave flux mam,338.21396 TOA incoming shortwave flux son,342.34269 TOA outgoing longwave flux ann,239.67505 TOA outgoing longwave flux assuming clear sky ann,262.68827 TOA outgoing longwave flux assuming clear sky djf,259.69418 TOA outgoing longwave flux assuming clear sky jja,266.14227 TOA outgoing longwave flux assuming clear sky mam,262.04368 TOA outgoing longwave flux assuming clear sky son,262.87295 TOA outgoing longwave flux djf,237.29634 TOA outgoing longwave flux jja,242.70192 TOA outgoing longwave flux mam,238.80261 TOA outgoing longwave flux son,239.89933 TOA outgoing shortwave flux ann,100.13965 TOA outgoing shortwave flux assuming clear sky ann,55.49381 TOA outgoing shortwave flux assuming clear sky djf,57.01343 TOA outgoing shortwave flux assuming clear sky jja,52.43564 TOA outgoing shortwave flux assuming clear sky mam,57.71931 TOA outgoing shortwave flux assuming clear sky son,54.80688 TOA outgoing shortwave flux djf,104.15722 TOA outgoing shortwave flux jja,95.07294 TOA outgoing shortwave flux mam,101.31182 TOA outgoing shortwave flux son,100.01662

UKESM: Surface downwelling longwave flux in air ann,338.26279 Surface downwelling longwave flux in air djf,330.11261 Surface downwelling longwave flux in air jja,347.01784 Surface downwelling longwave flux in air mam,337.45886 Surface downwelling longwave flux in air son,338.4619 Surface downwelling shortwave flux in air ann,191.95991 Surface downwelling shortwave flux in air djf,198.517 Surface downwelling shortwave flux in air jja,184.48814 Surface downwelling shortwave flux in air mam,191.84459 Surface downwelling shortwave flux in air son,192.98989 Surface net downward longwave flux ann,-57.70878 Surface net downward longwave flux djf,-56.02452 Surface net downward longwave flux jja,-58.61872 Surface net downward longwave flux mam,-58.12366 Surface net downward longwave flux son,-58.06828 Surface net downward shortwave flux ann,165.50906 Surface net downward shortwave flux djf,170.56613 Surface net downward shortwave flux jja,160.82728 Surface net downward shortwave flux mam,163.68438 Surface net downward shortwave flux son,166.95845 Surface upward latent heat flux ann,88.83297 Surface upward latent heat flux djf,88.46074 Surface upward latent heat flux jja,91.18319 Surface upward latent heat flux mam,88.78758 Surface upward latent heat flux son,86.90039 Surface upward sensible heat flux ann,17.69321 Surface upward sensible heat flux djf,16.61398 Surface upward sensible heat flux jja,18.61541 Surface upward sensible heat flux mam,18.54003 Surface upward sensible heat flux son,17.00343 TOA incoming shortwave flux ann,340.42051 TOA incoming shortwave flux djf,350.60592 TOA incoming shortwave flux jja,330.51952 TOA incoming shortwave flux mam,338.21394 TOA incoming shortwave flux son,342.34266 TOA outgoing longwave flux ann,239.31148 TOA outgoing longwave flux assuming clear sky ann,261.88622 TOA outgoing longwave flux assuming clear sky djf,258.69772 TOA outgoing longwave flux assuming clear sky jja,265.38637 TOA outgoing longwave flux assuming clear sky mam,261.31355 TOA outgoing longwave flux assuming clear sky son,262.14732 TOA outgoing longwave flux djf,236.77508 TOA outgoing longwave flux jja,242.32881 TOA outgoing longwave flux mam,238.53509 TOA outgoing longwave flux son,239.60702 TOA outgoing shortwave flux ann,100.6812 TOA outgoing shortwave flux assuming clear sky ann,55.74559 TOA outgoing shortwave flux assuming clear sky djf,57.34758 TOA outgoing shortwave flux assuming clear sky jja,52.6587 TOA outgoing shortwave flux assuming clear sky mam,57.6927 TOA outgoing shortwave flux assuming clear sky son,55.28339 TOA outgoing shortwave flux djf,104.76919 TOA outgoing shortwave flux jja,95.65314 TOA outgoing shortwave flux mam,101.07171 TOA outgoing shortwave flux son,101.23077

ESMValTool Seasonal Radiation Budget metrics

HadGEM3 Surface Downwelling Longwave Radiation djf,331.26465 Surface Downwelling Longwave Radiation mam,338.50418 Surface Downwelling Longwave Radiation jja,347.33484 Surface Downwelling Longwave Radiation son,339.41678 Surface Downwelling Longwave Radiation ann,339.1301 Surface Downwelling Shortwave Radiation djf,198.7923 Surface Downwelling Shortwave Radiation mam,191.3596 Surface Downwelling Shortwave Radiation jja,185.23924 Surface Downwelling Shortwave Radiation son,194.18407 Surface Downwelling Shortwave Radiation ann,192.39381 Net Longwave Surface Radiation djf,-55.93768 Net Longwave Surface Radiation mam,-57.375576 Net Longwave Surface Radiation jja,-58.70484 Net Longwave Surface Radiation son,-57.96392 Net Longwave Surface Radiation ann,-57.495506 Net Shortwave Surface Radiation djf,171.74553 Net Shortwave Surface Radiation mam,164.06825 Net Shortwave Surface Radiation jja,162.21092 Net Shortwave Surface Radiation son,168.83652 Net Shortwave Surface Radiation ann,166.7153 Surface Upward Latent Heat Flux djf,89.20938 Surface Upward Latent Heat Flux mam,89.85607 Surface Upward Latent Heat Flux jja,91.82161 Surface Upward Latent Heat Flux son,87.835945 Surface Upward Latent Heat Flux ann,89.680756 Surface Upward Sensible Heat Flux djf,16.832123 Surface Upward Sensible Heat Flux mam,18.809256 Surface Upward Sensible Heat Flux jja,18.987701 Surface Upward Sensible Heat Flux son,17.13678 Surface Upward Sensible Heat Flux ann,17.941465 TOA Incident Shortwave Radiation djf,350.63434 TOA Incident Shortwave Radiation mam,338.21814 TOA Incident Shortwave Radiation jja,330.53513 TOA Incident Shortwave Radiation son,342.3544 TOA Incident Shortwave Radiation ann,340.4355 TOA Outgoing Longwave Radiation djf,237.19638 TOA Outgoing Longwave Radiation mam,238.70547 TOA Outgoing Longwave Radiation jja,242.62747 TOA Outgoing Longwave Radiation son,239.96294 TOA Outgoing Longwave Radiation ann,239.62306 TOA Outgoing Clear-Sky Longwave Radiation djf,259.59467 TOA Outgoing Clear-Sky Longwave Radiation mam,261.9147 TOA Outgoing Clear-Sky Longwave Radiation jja,266.05798 TOA Outgoing Clear-Sky Longwave Radiation son,262.91876 TOA Outgoing Clear-Sky Longwave Radiation ann,262.62152 TOA Outgoing Shortwave Radiation djf,104.052536 TOA Outgoing Shortwave Radiation mam,101.28547 TOA Outgoing Shortwave Radiation jja,94.927956 TOA Outgoing Shortwave Radiation son,99.780174 TOA Outgoing Shortwave Radiation ann,100.011536 TOA Outgoing Clear-Sky Shortwave Radiation djf,56.79663 TOA Outgoing Clear-Sky Shortwave Radiation mam,57.63309 TOA Outgoing Clear-Sky Shortwave Radiation jja,52.260437 TOA Outgoing Clear-Sky Shortwave Radiation son,54.398838 TOA Outgoing Clear-Sky Shortwave Radiation ann,55.272247

UKESM Surface Downwelling Longwave Radiation djf,330.2742 Surface Downwelling Longwave Radiation mam,337.4784 Surface Downwelling Longwave Radiation jja,347.15225 Surface Downwelling Longwave Radiation son,338.7595 Surface Downwelling Longwave Radiation ann,338.41608 Surface Downwelling Shortwave Radiation djf,198.58768 Surface Downwelling Shortwave Radiation mam,191.90312 Surface Downwelling Shortwave Radiation jja,184.5296 Surface Downwelling Shortwave Radiation son,193.03403 Surface Downwelling Shortwave Radiation ann,192.01361 Net Longwave Surface Radiation djf,-55.86896 Net Longwave Surface Radiation mam,-58.11469 Net Longwave Surface Radiation jja,-58.571674 Net Longwave Surface Radiation son,-57.96923 Net Longwave Surface Radiation ann,-57.63114 Net Shortwave Surface Radiation djf,170.6438 Net Shortwave Surface Radiation mam,163.77988 Net Shortwave Surface Radiation jja,160.97575 Net Shortwave Surface Radiation son,167.06389 Net Shortwave Surface Radiation ann,165.61583 Surface Upward Latent Heat Flux djf,88.35136 Surface Upward Latent Heat Flux mam,88.74899 Surface Upward Latent Heat Flux jja,91.09126 Surface Upward Latent Heat Flux son,86.9554 Surface Upward Latent Heat Flux ann,88.78674 Surface Upward Sensible Heat Flux djf,16.526377 Surface Upward Sensible Heat Flux mam,18.575691 Surface Upward Sensible Heat Flux jja,18.63157 Surface Upward Sensible Heat Flux son,16.912748 Surface Upward Sensible Heat Flux ann,17.661596 TOA Incident Shortwave Radiation djf,350.63434 TOA Incident Shortwave Radiation mam,338.21814 TOA Incident Shortwave Radiation jja,330.53513 TOA Incident Shortwave Radiation son,342.3544 TOA Incident Shortwave Radiation ann,340.4355 TOA Outgoing Longwave Radiation djf,236.61859 TOA Outgoing Longwave Radiation mam,238.46312 TOA Outgoing Longwave Radiation jja,242.209 TOA Outgoing Longwave Radiation son,239.62466 TOA Outgoing Longwave Radiation ann,239.22885 TOA Outgoing Clear-Sky Longwave Radiation djf,258.5374 TOA Outgoing Clear-Sky Longwave Radiation mam,261.19415 TOA Outgoing Clear-Sky Longwave Radiation jja,265.3136 TOA Outgoing Clear-Sky Longwave Radiation son,262.17038 TOA Outgoing Clear-Sky Longwave Radiation ann,261.8039 TOA Outgoing Shortwave Radiation djf,104.62816 TOA Outgoing Shortwave Radiation mam,101.0082 TOA Outgoing Shortwave Radiation jja,95.47453 TOA Outgoing Shortwave Radiation son,100.9364 TOA Outgoing Shortwave Radiation ann,100.511826 TOA Outgoing Clear-Sky Shortwave Radiation djf,57.212593 TOA Outgoing Clear-Sky Shortwave Radiation mam,57.6425 TOA Outgoing Clear-Sky Shortwave Radiation jja,52.285423 TOA Outgoing Clear-Sky Shortwave Radiation son,54.901295 TOA Outgoing Clear-Sky Shortwave Radiation ann,55.510452

valeriupredoi commented 2 years ago

@Jon-Lillis nice plots and results, I'd add these to the recipe#s documentation maybe? @alistairsellar what do you think?