search

OneArgo / ADMT

A repository for Argo Data Management Team activities
7 stars 1 forks source link

Detailed index : issue in ad_psal_adjustment_mean computation #76

Open tcarval opened 21 hours ago

tcarval commented 21 hours ago

For D-profiles with PSAL values (i.e. not profile QC F), I expect that the ad_psal_adjustment_mean to be filled in with a value. However, for some wmo/cycle where definitely there should be a value, it is missing : A very quick estimate made from the 20230712022801 index yields: grep "profiles/D" /home/ref-argo/gdac/etc/argo_profile_detailled_index.txt | grep "A,,,," | wc -l

153633 missing adjustment information

The same kind of command was made for other profile QCs, for coriolis only, and not accounting for DO floats (i.e. profile_doxy_qc void):

  for QC A: 39613/309521

  for QC B: 7092/25755

  for QC C: 1143/1730

  for QC D: 171/554

  for QC E: 59/136

On the other hand, and this is expected, all PSAL adjustments for PSAL_profile_QC F are "void". As an exemple, the first line concerning coriolis is the following: coriolis/1900067/profiles/D1900067_068.nc,20040121045100,26.031,-25.636,A,842,IF,20221121131544,A,A,,,,20121106213921,20221121160506,92 A ncdump command on the profile file yields: ncdump -v PSAL,PSAL_ADJUSTED /home/ref-argo/gdac/dac/coriolis/1900067/profiles/D1900067068.nc PSAL = 37.375, 37.371, 37.367, 37.380, 37.376, 37.374, 37.370, 37.375, 37.382, 37.380, 37.380, 37.389, 37.371, 37.293, 37.006, 36.898, 36.807, 36.702, 36.646, 36.560, 36.456, 36.386, 36.291, 36.176, 36.091, 36.002, 35.936, 35.887, 35.856, 35.784, 35.695, 35.648, 35.601, 35.575, 35.556, 35.502, 35.460, 35.415, 35.382, 35.363, 35.330, 35.294, 35.267, 35.225, 35.206, 35.179, 35.162, 35.145, 35.158, 35.152, 35.167, 35.185, 35.169, 35.187, 35.214, 35.229, 35.234, 35.233, 35.248, 35.250, 35.253, 35.268, 35.264, 35.270, 35.273, 35.264, 35.262, 35.248, 35.255, 35.260, 35.264, 35.244, 35.226, 35.214, 35.212, 35.198, 35.190, 35.183, 35.165, 35.167, 35.159, 35.161, 35.159, 35.157, 35.148, 35.130, 35.136, 35.126, 35.114, 35.107, 35.101, 35.110, 37.379, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ; PSALADJUSTED = 37.317, 37.313, 37.309, 37.322, 37.318, 37.316, 37.312, 37.317, 37.324, 37.322, 37.322, 37.331, 37.313, 37.236, 36.949, 36.841, 36.750, 36.646, 36.590, 36.504, 36.400, 36.330, 36.235, 36.121, 36.036, 35.947, 35.881, 35.832, 35.801, 35.729, 35.640, 35.594, 35.547, 35.521, 35.502, 35.448, 35.406, 35.361, 35.328, 35.309, 35.276, 35.240, 35.213, 35.171, 35.152, 35.126, 35.109, 35.092, 35.105, 35.099, 35.114, 35.132, 35.116, 35.134, 35.160, 35.175, 35.180, 35.179, 35.194, 35.196, 35.199, 35.214, 35.210, 35.216, 35.219, 35.210, 35.208, 35.194, 35.201, 35.206, 35.210, 35.191, 35.173, 35.161, 35.159, 35.145, 35.137, 35.130, 35.112, 35.114, 35.106, 35.108, 35.106, 35.104, 35.095, 35.077, 35.083, 35.073, 35.061, 35.054, 35.048, 35.057, 37.371, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ; Another one: coriolis/3901978/profiles/D3901978_179.nc,20191214062730,40.234,17.424,A,844,IF,20200128102737,A,A,,,,20200203114353,20200203114353,132 ncdump -v PSAL,PSAL_ADJUSTED /home/ref-argo/gdac/dac/coriolis/3901978/profiles/D3901978_179.nc PSAL = 38.678, 38.678, 38.679, 38.678, 38.680, 38.681, 38.680, 38.679, 38.678, 38.679, 38.677, 38.677, 38.677, 38.677, 38.677, 38.677, 38.677, 38.678, 38.677, 38.676, 38.678, 38.682, 38.679, 38.680, 38.679, 38.679, 38.679, 38.681, 38.685, 38.692, 38.751, 38.810, 38.818, 38.824, 38.833, 38.839, 38.845, 38.849, 38.851, 38.856, 38.861, 38.863, 38.865, 38.888, 38.895, 38.898, 38.903, 38.914, 38.920, 38.918, 38.917, 38.919, 38.931, 38.937, 38.941, 38.946, 38.953, 38.961, 38.960, 38.963, 38.971, 38.976, 38.981, 38.981, 38.980, 38.977, 38.975, 38.974, 38.975, 38.979, 38.980, 38.984, 38.987, 38.989, 38.992, 38.993, 38.994, 38.998, 38.999, 39.000, 39.000, 39.003, 39.005, 39.005, 39.006, 39.005, 39.005, 39.005, 39.006, 39.005, 39.005, 39.006, 39.006, 39.006, 39.007, 39.008, 39.008, 39.009, 39.011, 39.012, 39.012, 39.013, 39.012, 39.014, 39.016, 39.015, 39.015, 39.016, 39.017, 39.017, 39.017, 39.016, 39.016, 39.017, 39.017, 39.018, 39.018, 39.019, 39.022, 39.019, 39.016, 39.010, 39.006, 38.995, 38.991, 38.996, 39.012, 39.010, 39.009, 39.007, 39.006, 39.003 ; PSAL_ADJUSTED = 38.678, 38.678, 38.679, 38.678, 38.680, 38.681, 38.680, 38.679, 38.678, 38.679, 38.677, 38.677, 38.677, 38.677, 38.677, 38.677, 38.677, 38.678, 38.677, 38.676, 38.678, 38.682, 38.679, 38.680, 38.679, 38.679, 38.679, 38.681, 38.685, 38.692, 38.751, 38.810, 38.818, 38.824, 38.833, 38.839, 38.845, 38.849, 38.851, 38.856, 38.861, 38.863, 38.865, 38.888, 38.895, 38.898, 38.903, 38.914, 38.920, 38.918, 38.917, 38.919, 38.931, 38.937, 38.941, 38.946, 38.953, 38.961, 38.960, 38.963, 38.971, 38.976, 38.981, 38.981, 38.980, 38.977, 38.975, 38.974, 38.975, 38.979, 38.980, 38.984, 38.987, 38.989, 38.992, 38.993, 38.994, 38.998, 38.999, 39.000, 39.000, 39.003, 39.005, 39.005, 39.006, 39.005, 39.005, 39.005, 39.006, 39.005, 39.005, 39.006, 39.006, 39.006, 39.007, 39.008, 39.008, 39.009, 39.011, 39.012, 39.012, 39.013, 39.012, 39.014, 39.016, 39.015, 39.015, 39.016, 39.017, 39.017, 39.017, 39.016, 39.016, 39.017, 39.017, 39.018, 39.018, 39.019, 39.022, 39.019, 39.016, 39.010, 39.006, 38.995, 38.991, 38.996, 39.012, 39.010, 39.009, 39.007, 39.006, 39.003 ;

tcarval commented 21 hours ago

Only QC "1" was used to calculate ad_psal_adjustment_mean in the detailed index file. Since 04/10/2024 all PSAL data with "good" QC are used : 1, 2, 5, 8

The ad_psal_adjustment_mean will be entirely reprocessed. When comlete, this ticket will be closed. @delphinedobler for info