search

NOAA-EMC / GDASApp

Global Data Assimilation System Application
GNU Lesser General Public License v2.1
15 stars 31 forks source link

Modify atm_jjob_var and atm_jjob_ens ctests to work with radiance bias correction tarballs #1264

Closed RussTreadon-NOAA closed 1 month ago

RussTreadon-NOAA commented 2 months ago

Global-workflow issue #2862 modifies g-w ush/python/pygfs/task scripts analysis.py and atm_analysis.py to move, copy, and link JEDI radiance bias correction files as a single tarball instead of multiple _satellitesensor based files. This change necessitates changes to the atmospheric variational and local ensemble atmospheric DA ctests.

This issue is opened to document the required changes to these ctests.

RussTreadon-NOAA commented 2 months ago

Work for this issue will be done in RussTreadon-NOAA:feature/radbcor.

RussTreadon-NOAA commented 2 months ago

Hera ctest

Build GDASApp feature/radbcor at 6d0f9bc inside g-w feature/radbcor at 20fb88c. Run test_gdasapp ctests with following results

Test project /scratch1/NCEPDEV/da/Russ.Treadon/git/global-workflow/test/sorc/gdas.cd/build
      Start 1531: test_gdasapp_util_coding_norms
 1/47 Test #1531: test_gdasapp_util_coding_norms ........................   Passed    2.64 sec
      Start 1532: test_gdasapp_util_ioda_example
 2/47 Test #1532: test_gdasapp_util_ioda_example ........................   Passed    4.58 sec
      Start 1533: test_gdasapp_util_prepdata
 3/47 Test #1533: test_gdasapp_util_prepdata ............................   Passed    1.33 sec
      Start 1534: test_gdasapp_util_rads2ioda
 4/47 Test #1534: test_gdasapp_util_rads2ioda ...........................   Passed    0.18 sec
      Start 1535: test_gdasapp_util_ghrsst2ioda
 5/47 Test #1535: test_gdasapp_util_ghrsst2ioda .........................   Passed    0.14 sec
      Start 1536: test_gdasapp_util_rtofstmp
 6/47 Test #1536: test_gdasapp_util_rtofstmp ............................   Passed    1.00 sec
      Start 1537: test_gdasapp_util_rtofssal
 7/47 Test #1537: test_gdasapp_util_rtofssal ............................   Passed    0.79 sec
      Start 1538: test_gdasapp_util_smap2ioda
 8/47 Test #1538: test_gdasapp_util_smap2ioda ...........................   Passed    0.14 sec
      Start 1539: test_gdasapp_util_smos2ioda
 9/47 Test #1539: test_gdasapp_util_smos2ioda ...........................   Passed    0.16 sec
      Start 1540: test_gdasapp_util_viirsaod2ioda
10/47 Test #1540: test_gdasapp_util_viirsaod2ioda .......................   Passed    0.15 sec
      Start 1541: test_gdasapp_util_icecamsr2ioda
11/47 Test #1541: test_gdasapp_util_icecamsr2ioda .......................   Passed    0.17 sec
      Start 1542: test_gdasapp_util_icecmirs2ioda
12/47 Test #1542: test_gdasapp_util_icecmirs2ioda .......................   Passed    0.15 sec
      Start 1543: test_gdasapp_util_icecjpssrr2ioda
13/47 Test #1543: test_gdasapp_util_icecjpssrr2ioda .....................   Passed    0.14 sec
      Start 1881: test_gdasapp_check_python_norms
14/47 Test #1881: test_gdasapp_check_python_norms .......................   Passed    3.00 sec
      Start 1882: test_gdasapp_check_yaml_keys
15/47 Test #1882: test_gdasapp_check_yaml_keys ..........................   Passed    0.24 sec
      Start 1883: test_gdasapp_jedi_increment_to_fv3
16/47 Test #1883: test_gdasapp_jedi_increment_to_fv3 ....................   Passed    0.98 sec
      Start 1884: test_gdasapp_fv3jedi_fv3inc
17/47 Test #1884: test_gdasapp_fv3jedi_fv3inc ...........................   Passed    8.87 sec
      Start 1885: test_gdasapp_soca_nsst_increment_to_mom6
18/47 Test #1885: test_gdasapp_soca_nsst_increment_to_mom6 ..............   Passed    6.40 sec
      Start 1886: test_gdasapp_soca_prep
19/47 Test #1886: test_gdasapp_soca_prep ................................   Passed    5.05 sec
      Start 1887: test_gdasapp_soca_run_clean
20/47 Test #1887: test_gdasapp_soca_run_clean ...........................   Passed    0.07 sec
      Start 1888: test_gdasapp_soca_setup_obsprep
21/47 Test #1888: test_gdasapp_soca_setup_obsprep .......................   Passed   24.14 sec
      Start 1889: test_gdasapp_soca_JGLOBAL_PREP_OCEAN_OBS
22/47 Test #1889: test_gdasapp_soca_JGLOBAL_PREP_OCEAN_OBS ..............   Passed   43.75 sec
      Start 1890: test_gdasapp_soca_JGLOBAL_MARINE_BMAT
23/47 Test #1890: test_gdasapp_soca_JGLOBAL_MARINE_BMAT .................   Passed   74.82 sec
      Start 1891: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_PREP
24/47 Test #1891: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_PREP ....   Passed   42.83 sec
      Start 1892: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_RUN
25/47 Test #1892: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_RUN .....   Passed   42.34 sec
      Start 1893: test_gdasapp_soca_copy_scratch
26/47 Test #1893: test_gdasapp_soca_copy_scratch ........................   Passed    0.27 sec
      Start 1894: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_CHKPT
27/47 Test #1894: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_CHKPT ...   Passed   74.62 sec
      Start 1895: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_POST
28/47 Test #1895: test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_POST ....   Passed  330.63 sec
      Start 1896: test_gdasapp_snow_create_ens
29/47 Test #1896: test_gdasapp_snow_create_ens ..........................   Passed    1.51 sec
      Start 1897: test_gdasapp_snow_imsproc
30/47 Test #1897: test_gdasapp_snow_imsproc .............................   Passed    4.72 sec
      Start 1898: test_gdasapp_snow_apply_jediincr
31/47 Test #1898: test_gdasapp_snow_apply_jediincr ......................   Passed   15.20 sec
      Start 1899: test_gdasapp_snow_letkfoi_snowda
32/47 Test #1899: test_gdasapp_snow_letkfoi_snowda ......................   Passed    8.54 sec
      Start 1900: test_gdasapp_convert_bufr_adpsfc_snow
33/47 Test #1900: test_gdasapp_convert_bufr_adpsfc_snow .................   Passed    3.37 sec
      Start 1901: test_gdasapp_convert_bufr_adpsfc
34/47 Test #1901: test_gdasapp_convert_bufr_adpsfc ......................   Passed    3.80 sec
      Start 1902: test_gdasapp_convert_gsi_satbias
35/47 Test #1902: test_gdasapp_convert_gsi_satbias ......................   Passed    5.10 sec
      Start 1903: test_gdasapp_setup_atm_cycled_exp
36/47 Test #1903: test_gdasapp_setup_atm_cycled_exp .....................   Passed    1.07 sec
      Start 1904: test_gdasapp_atm_jjob_var_init
37/47 Test #1904: test_gdasapp_atm_jjob_var_init ........................   Passed   79.64 sec
      Start 1905: test_gdasapp_atm_jjob_var_run
38/47 Test #1905: test_gdasapp_atm_jjob_var_run .........................   Passed  106.29 sec
      Start 1906: test_gdasapp_atm_jjob_var_inc
39/47 Test #1906: test_gdasapp_atm_jjob_var_inc .........................   Passed   74.28 sec
      Start 1907: test_gdasapp_atm_jjob_var_final
40/47 Test #1907: test_gdasapp_atm_jjob_var_final .......................   Passed   42.27 sec
      Start 1908: test_gdasapp_atm_jjob_ens_init
41/47 Test #1908: test_gdasapp_atm_jjob_ens_init ........................   Passed   53.55 sec
      Start 1909: test_gdasapp_atm_jjob_ens_letkf
42/47 Test #1909: test_gdasapp_atm_jjob_ens_letkf .......................   Passed  458.73 sec
      Start 1910: test_gdasapp_atm_jjob_ens_obs
43/47 Test #1910: test_gdasapp_atm_jjob_ens_obs .........................   Passed   74.37 sec
      Start 1911: test_gdasapp_atm_jjob_ens_sol
44/47 Test #1911: test_gdasapp_atm_jjob_ens_sol .........................   Passed   74.47 sec
      Start 1912: test_gdasapp_atm_jjob_ens_inc
45/47 Test #1912: test_gdasapp_atm_jjob_ens_inc .........................   Passed  106.29 sec
      Start 1913: test_gdasapp_atm_jjob_ens_final
46/47 Test #1913: test_gdasapp_atm_jjob_ens_final .......................   Passed  106.28 sec
      Start 1914: test_gdasapp_aero_gen_3dvar_yaml
47/47 Test #1914: test_gdasapp_aero_gen_3dvar_yaml ......................   Passed    0.60 sec

100% tests passed, 0 tests failed out of 47

Label Time Summary:
gdas-utils    =  11.57 sec*proc (13 tests)
script        =  11.57 sec*proc (13 tests)

Total Test time (real) = 1892.37 sec