search

E3SM-Project / e3sm_diags

E3SM Diagnostics package
https://e3sm-project.github.io/e3sm_diags
BSD 3-Clause "New" or "Revised" License
39 stars 32 forks source link

Add new aci and aerosol activation metrics from ARM Diags v3 #679

Closed chengzhuzhang closed 1 year ago

chengzhuzhang commented 1 year ago

This PR is to update the ARM diagnostics data and modules (released in ARM Diags v3) by including the aerosol cloud interaction (aci) and aerosol activation diagnostics and metrics based on ARM observation, developed by Xiaojian Zheng @lannyzxj and Cheng Tao @EmmyChengTao.

Todo list:

chengzhuzhang commented 1 year ago

Hi Xiaojian @lannyzxj and Cheng@EmmyChengTao I have implemented the v3 updates of ARM diags in E3SM Diags. Below is the newly added diagnostics running with the v3 smoke test. The results only show available variables from the simulation output. One thing I'm not sure about is the units conversion for so4 mass concentration. I will add some comments in the code and tag you. Let me know if you see any problem in the plots. Thank you.

https://portal.nersc.gov/cfs/e3sm/zhang40/tests/arm_diags_v3_m2o_aerosol_act/viewer/arm_diags/index.html

chengzhuzhang commented 1 year ago

Some updates in https://github.com/ARM-DOE/arm-gcm-diagnostics/pull/29 will be included at a later time after ARM D release v3.1.

I also made some changes in the v3.0 datasets regarding to properly set time bounds. I will share the data to @lannyzxj and @EmmyChengTao for potentially considering releasing a new version of the data.

chengzhuzhang commented 1 year ago

Reference runs: Results from e3sm diags with arm diags v3 (compare against v3 NGD smoke test) Results from e3sm diags with arm diags v2 (compare against an earlier run)

chengzhuzhang commented 1 year ago

@EmmyChengTao and @lannyzxj thank you for working on releasing v3.1 of ARM Diags data. I tested with E3SM Diags and both the time bounds problem and inconsistency in convection onset metrics are resolved! Thank you.

I'm just documenting the results here: Results from e3sm diags with arm diags v3.1 (compare against v3 NGD smoke test)

VS

Reference runs: Results from e3sm diags with arm diags v3 (compare against v3 NGD smoke test) Results from e3sm diags with arm diags v2 (compare against an earlier run)

EmmyChengTao commented 1 year ago

Thank you for the check, Chengzhu! I will work on the release of this v3.1 data. Will keep you updated.

Best, Cheng

From: Jill Chengzhu Zhang @.> Date: Tuesday, May 23, 2023 at 1:52 PM To: E3SM-Project/e3sm_diags @.> Cc: Tao, Cheng @.>, Mention @.> Subject: Re: [E3SM-Project/e3sm_diags] Add new aci and aerosol activation metrics from ARM Diags v3 (PR #679)

@EmmyChengTaohttps://urldefense.us/v3/__https:/github.com/EmmyChengTao__;!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWkJ-Y8v1Q$ and @lannyzxjhttps://urldefense.us/v3/__https:/github.com/lannyzxj__;!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWkMrPMcb0$ thank you for working on releasing v3.1 of ARM Diags data. I tested with E3SM Diags and both the time bounds problem and inconsistency in convection onset metrics are resolved! Thank you.

I'm just documenting the results here: Results from e3sm diags with arm diags v3.1https://urldefense.us/v3/__https:/portal.nersc.gov/cfs/e3sm/zhang40/tests/arm_diags_v3_m2o_v3NGD_v3.1/viewer/arm_diags/index.html__;!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWkVJeAsBA$

VS

Reference runs: Results from e3sm diags with arm diags v3https://urldefense.us/v3/__https:/portal.nersc.gov/cfs/e3sm/zhang40/tests/arm_diags_v3_m2o_v3NGD/viewer/arm_diags/index.html__;!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWk2asRM7Q$ (compare against v3 NGD smoke test) Results from e3sm diags with arm diags v2https://urldefense.us/v3/__https:/portal.nersc.gov/cfs/e3sm/zhang40/tests/arm_diags_v2_m2o/viewer/arm_diags/index.html__;!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWkRHPainc$ (compare against an earlier run)

— Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/E3SM-Project/e3sm_diags/pull/679*issuecomment-1560109085__;Iw!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWkpi6gyiM$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/AMSQQKJ5BOD66ZK64ULDI7TXHUPQXANCNFSM6AAAAAAV7DDSEM__;!!G2kpM7uM-TzIFchu!zpKTreYjkMb_JWZapTcD0hOtNxdQW2RaJv706_DaSZh6lblMTZleCnkluHJH-x_prrKLx7-62QEi0QWkw14BY9Y$. You are receiving this because you were mentioned.Message ID: @.***>

chengzhuzhang commented 1 year ago

CI/CD tests were fixed by updated input data for integration tests. ARM data on LCRC also updated.

chengzhuzhang commented 1 year ago

Thank you for the check, Chengzhu! I will work on the release of this v3.1 data. Will keep you updated. Best, Cheng

Thank you!

lannyzxj commented 7 months ago

Hi Jill,

Yes, the ARM observation only accounts PM1 for the chemical components, so I use the closest representation in the model for comparison purposes.

Best, Xiaojian

On Tue, Mar 26, 2024 at 11:48 Jill Chengzhu Zhang @.***> wrote:

@.**** commented on this pull request.

In e3sm_diags/derivations/acme.py https://github.com/E3SM-Project/e3sm_diags/pull/679#discussion_r1539722692 :

  • Aerosol concentration from Aitken, Accumu., and Coarse mode

  • (
  • (
  • "num_a1",
  • "num_a2",
  • "num_a3",
  • ),
  • lambda a1, a2, a3: a_num_sum(a1 + a2 + a3),
  • ),
  • ]
  • ),

  • total so4 mass concentration (ng/m3)

  • "so4_mass": OrderedDict(
  • [
  • (("sulfate",), rename),

  • Aerosol concentration from Aitken, Accumu., and Coarse mode

@lannyzxj https://github.com/lannyzxj Cheng and I are working on clearing up some documentation in preparation for E3SM Tutorial. When working on ARM Diags, I noticed that when computing so4 mass concentration, only Aitken and Accumu. mode are taking account. Could you remind me why is the case? Is it to make the model data comparable to obs?

— Reply to this email directly, view it on GitHub https://github.com/E3SM-Project/e3sm_diags/pull/679#discussion_r1539722692, or unsubscribe https://github.com/notifications/unsubscribe-auth/AONPBWW6ZWIAAXCZ43DLAHDY2GRE5AVCNFSM6AAAAAAV7DDSEOVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMYTSNRRGEYTQMRZGI . You are receiving this because you were mentioned.Message ID: @.***>

chengzhuzhang commented 7 months ago

Hi Jill, Yes, the ARM observation only accounts PM1 for the chemical components, so I use the closest representation in the model for comparison purposes. Best, Xiaojian … On Tue, Mar 26, 2024 at 11:48 Jill Chengzhu Zhang @.> wrote: @*.*** commented on this pull request. ------------------------------ In e3sm_diags/derivations/acme.py <#679 (comment)> : > + # Aerosol concentration from Aitken, Accumu., and Coarse mode + ( + ( + "num_a1", + "num_a2", + "num_a3", + ), + lambda a1, a2, a3: a_num_sum(a1 + a2 + a3), + ), + ] + ), + # total so4 mass concentration (ng/m3) + "so4_mass": OrderedDict( + [ + (("sulfate",), rename), + # Aerosol concentration from Aitken, Accumu., and Coarse mode @lannyzxj https://github.com/lannyzxj Cheng and I are working on clearing up some documentation in preparation for E3SM Tutorial. When working on ARM Diags, I noticed that when computing so4 mass concentration, only Aitken and Accumu. mode are taking account. Could you remind me why is the case? Is it to make the model data comparable to obs? — Reply to this email directly, view it on GitHub <#679 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AONPBWW6ZWIAAXCZ43DLAHDY2GRE5AVCNFSM6AAAAAAV7DDSEOVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMYTSNRRGEYTQMRZGI . You are receiving this because you were mentioned.Message ID: @.>

Thank you for confirming, Xiaojian!