NOAA-SWPC / GSMWAM-IPE

Coupled NEMS app for WAM-IPE
5 stars 11 forks source link

TEC of opr WAM-IPE & its opr bias ratio against GloTEC checking for period of storm Apr.24 this week #79

Closed ZhuxiaoLi66 closed 1 year ago

ZhuxiaoLi66 commented 1 year ago

The new parameter set (skeddy0=70, skeddy_semiann=-10) of eddy mixing has been applied to the operational WAM-IPE for about 2 weeks. The recent operational TEC bias ratio plots (by daily email) have been monitored closely, it has been found that the bias ratio began to climb up from Apr.21, while there is a sudden jump up on the latest storm day of Apr.24 2023, from 0.8 to about 1.2, the ratio jumped back to about 0.8 on the day after, Apr.25.
With Tim's suggestion, I checked the TEC maps of opr WAM-IPE and GloTEC separately and have done some comparisons to seek the reason for the sudden jump in the bias ratio on Apr.24, and give a further investigation of the TEC performance of both of the opr WAM-IPE and the opr GloTEC.
On the other hand, the free WAM-IPE annual run with the new parameters is extended to the current time to get a baseline for the operational performance after the parameter reset.

ZhuxiaoLi66 commented 1 year ago

The following plot is the recent bias ratio performance of the opr WAM-IPE against GloTEC. daily_TEC_bias_ratio_WAM-IPE_GloTEC_20230428 Let us put the jump aside and pay attention to the recent ratios after the parameter-set change. The new parameter is supposed to kick in after about 10-20 days. so far it seems that the ratio has not changed much before and after the reset of parameters. In theory, we think it is acceptable so far. based on the formula of semiannual variation, on Mar.21 and Sep.21 (Equinox) the skeddy arrive at its 'minimum'. For the new eddy parameters, skeddy = 70- (-10) = 80 For the original eddy parameters, skeddy = 140 - 60 = 80 So in theory, the skeddy is the same at Equinox, the following former validation figure shows that the ratio should increase a little bit after that. bias_ratio_dayno_para5_20221214_CONOPS12_std we will have a close eye on the ratio change hereafter.

ZhuxiaoLi66 commented 1 year ago

Now let us go back to the TEC & bias ratio checking for the period of Apr.20-Apr.25, especially paying attention to the bias ratio jump on Apr. 24. The following are the TEC maps of operational WAM-IPE during this period. TEC_wfs_20230420_6hrly TEC_wfs_20230421_6hrly TEC_wfs_20230422_6hrly TEC_wfs_20230423_6hrly TEC_wfs_20230424_6hrly TEC_wfs_20230425_6hrly

ZhuxiaoLi66 commented 1 year ago

This section shows the GloTEC maps (30mins time window method) of the area with the quality flag values equal to or above 4. They are the area where we define more effective & valid and use them to calculate the opr bias ratio values.

TEC_glotec_20230420_6hrly TEC_glotec_20230421_6hrly TEC_glotec_20230422_6hrly TEC_glotec_20230423_6hrly TEC_glotec_20230424_6hrly TEC_glotec_20230425_6hrly

ZhuxiaoLi66 commented 1 year ago

For getting a general view & whole picture of the GloTEC data and having a further pattern comparison with the opr WAM-IPE TEC, I used all of the GloTEC data without the quality flag filter, to get the following GloTEC maps for this period. TEC_glotec_all_flag_20230420_6hrly TEC_glotec_all_flag_20230421_6hrly TEC_glotec_all_flag_20230422_6hrly TEC_glotec_all_flag_20230423_6hrly TEC_glotec_all_flag_20230424_6hrly TEC_glotec_all_flag_20230425_6hrly

ZhuxiaoLi66 commented 1 year ago

The following re-arranged plots for TEC comparison between WFS, all GloTEC, quality-flag filtered GloTEC (more reliable) are helpful for further investigation, especially give us a detailed idea about the performance of both opr WAM-IPE and GloTEC, and the reason why the bias ratio jumped up on the storm day of Apr.24. TEC_wfs_glotec_all_flag_3P_20230423

TEC_wfs_glotec_all_flag_3P_20230424

TEC_wfs_glotec_all_flag_3P_20230425

ZhuxiaoLi66 commented 1 year ago

The following plots for the other 3 days(Apr.22, 21, 20) when are relatively quiet before the storm, maybe will check some other days e.g. Apr.17 and Apr.18 for more quiet time later. Please pay attention to the GloTEC maps of Apr.20 (last plot), it seems that the data is on the wrong map, I mean the longitude should switch 180 degrees. This happened before. Since I use the same code for calculations and plotting for all these days, so should be a problem with the GloTEC data itself.

TEC_wfs_glotec_all_flag_3P_20230422 TEC_wfs_glotec_all_flag_3P_20230421 TEC_wfs_glotec_all_flag_3P_20230420

ZhuxiaoLi66 commented 1 year ago

Any comments on this checking are welcome. Screenshot from 2023-07-06 12-21-51

twfang commented 1 year ago

@ZhuxiaoLi66 The jump is associated with the geomagnetic storm, I don't think that's where the issue is. We want to make sure our ratio doesn't continue to decrease for the quiet days. The GloTEC plot on 4/20 looks wrong. The TEC distribution doesn't look right. Could you please double-check?

ZhuxiaoLi66 commented 1 year ago

Tzu-Wei, thanks for looking about this. We are checking the both issues now, it seems that WAM-IPE overestimates TEC during the storm time, will check some other events to clarify this. And yes, we are keeping a close eye on the tendency of the quite days ratios. Based on our free WAM-IPE annual run with the new parameters, the ratios should mildly goes up somewhat recently. you are right, the 4/20 maps looks wrong. I also notice that, please have a look at my comments with the last plots. After the double check, I think there is something wrong with the saving of the operational GloTEC data that day, the longitude seems needs to switch 180 degree. This happened before, will send an e-mail to Dom to discuss about it.

ZhuxiaoLi66 commented 1 year ago

TEC_30min_bias_ratio_opr_202304

ZhuxiaoLi66 commented 1 year ago

daily_TEC_bias_ratio_WAM-IPE_GloTEC

ZhuxiaoLi66 commented 1 year ago

Screenshot from 2023-07-06 12-21-51