ufs-community / ufs-srweather-app

UFS Short-Range Weather Application
Other
53 stars 114 forks source link

[develop] fix CI scripts to save logfile names that Jenkinsfile needs for pwcloud platform builds #1087

Closed BruceKropp-Raytheon closed 1 month ago

BruceKropp-Raytheon commented 1 month ago

DESCRIPTION OF CHANGES:

Make sure the log file names match what jenkisnfile needs, specifically for PW cloud platforms, Azure, AWS, GCP

Type of change

TESTS CONDUCTED:

  1. Run CI pipeline on Tier1 HPC to verify.
  2. Run on PW cloud platforms to verify PASS of build stage with build log being properly uploaded to S3.

DEPENDENCIES:

latest

DOCUMENTATION:

No change.

ISSUE:

Auto-builds on PW platforms have been disabled dues to various failures. This removes one barrier.

CHECKLIST

LABELS (optional):

A Code Manager needs to add the following labels to this PR:

CONTRIBUTORS (optional):

MichaelLueken commented 1 month ago

The Jenkins tests have successfully passed on Derecho, Gaea, Hera Intel, and Hercules. Retests are currently being conducted on Orion, Jet, and Hera GNU.

MichaelLueken commented 1 month ago

The Orion rerun has successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
custom_ESGgrid_SF_1p1km_20240530122620                             COMPLETE             422.01
deactivate_tasks_20240530122621                                    COMPLETE               1.13
get_from_AWS_ics_GEFS_lbcs_GEFS_fmt_grib2_2022040400_ensemble_2me  COMPLETE            1887.82
grid_CONUS_3km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta_  COMPLETE            1032.53
grid_RRFS_AK_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot_20240  COMPLETE             389.00
grid_RRFS_CONUS_25km_ics_NAM_lbcs_NAM_suite_RRFS_v1beta_202405301  COMPLETE              21.07
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR_20240530122  COMPLETE             881.45
grid_RRFS_CONUScompact_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_  COMPLETE              66.14
grid_RRFS_CONUScompact_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_2  COMPLETE             739.22
grid_SUBCONUS_Ind_3km_ics_FV3GFS_lbcs_FV3GFS_suite_WoFS_v0_202405  COMPLETE              61.91
2020_CAD_20240530122631                                            COMPLETE              70.73
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE            5573.01

The Hera GNU rerun has successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
custom_ESGgrid_Central_Asia_3km_20240530185954                     COMPLETE              62.90
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_nemsio_2019061200_202405  COMPLETE              11.08
get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS_20240530185955              COMPLETE              16.68
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR_2024053018  COMPLETE              72.65
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta_202  COMPLETE              25.56
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_RAP_suite_WoFS_v0_20240530185  COMPLETE              32.26
long_fcst_20240530185958                                           COMPLETE             100.83
MET_verification_only_vx_20240530185959                            COMPLETE               0.26
MET_ensemble_verification_only_vx_time_lag_20240530190001          COMPLETE               9.51
2019_halloween_storm_20240530190004                                COMPLETE              79.83
2020_jan_cold_blast_20240530190004                                 COMPLETE              79.31
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             490.87

The Jet rerun has successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
community_20240530175206                                           COMPLETE              18.34
custom_ESGgrid_20240530175207                                      COMPLETE              25.97
custom_ESGgrid_Great_Lakes_snow_8km_20240530175208                 COMPLETE              20.70
custom_GFDLgrid_20240530175210                                     COMPLETE              11.01
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_nemsio_2021032018_202405  COMPLETE               9.22
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h_20  COMPLETE              87.59
get_from_HPSS_ics_RAP_lbcs_RAP_20240530175212                      COMPLETE              16.43
grid_RRFS_AK_3km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR_20240530175213  COMPLETE             611.05
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot_20  COMPLETE              64.10
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2_20240  COMPLETE               7.82
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta_2024  COMPLETE             927.23
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE            1799.46

Moving forward with merging this work now.