NOAA-EMC / global-workflow

Global Superstructure/Workflow supporting the Global Forecast System (GFS)
https://global-workflow.readthedocs.io/en/latest
GNU Lesser General Public License v3.0
70 stars 161 forks source link

updated Finalize in Jenkinsfile and added try block around scm checkout #2692

Closed TerrenceMcGuinness-NOAA closed 4 days ago

TerrenceMcGuinness-NOAA commented 2 weeks ago

Description

We are updating the Jenkins Pipeline with a try block around checkout to capture errors for the user. Also cleaned up Finalize and added section to clean out workspace on success.

Type of change

Cleaning up output to user on checkout fails of CI runs.

Change characteristics

How has this been tested?

The pipeline script will be tested in place

emcbot commented 2 weeks ago

CI Passed Hercules at
Built and ran in directory /work2/noaa/stmp/CI/HERCULES/2692

emcbot commented 2 weeks ago

CI Passed Hera at
Built and ran in directory /scratch1/NCEPDEV/global/CI/2692



Experiment C48_ATM_f04a47ed Completed 1 Cycles: *SUCCESS* at Sat Jun 15 15:28:16 UTC 2024
Experiment C48mx500_3DVarAOWCDA_f04a47ed Completed 2 Cycles: *SUCCESS* at Sat Jun 15 15:34:21 UTC 2024
Experiment C96_atm3DVar_f04a47ed Completed 3 Cycles: *SUCCESS* at Sat Jun 15 16:35:07 UTC 2024
Experiment C96C48_hybatmDA_f04a47ed Completed 3 Cycles: *SUCCESS* at Sat Jun 15 16:35:16 UTC 2024
Experiment C48_S2SWA_gefs_f04a47ed Completed 1 Cycles: *SUCCESS* at Sat Jun 15 17:27:49 UTC 2024
Experiment C96_atmaerosnowDA_f04a47ed Completed 3 Cycles: *SUCCESS* at Sat Jun 15 17:35:51 UTC 2024
Experiment C48_S2SW_f04a47ed Completed 1 Cycles: *SUCCESS* at Sat Jun 15 18:25:12 UTC 2024
emcbot commented 6 days ago

Experiment C48mx500_3DVarAOWCDA FAILED on Hera in /scratch1/NCEPDEV/global/CI/2692/RUNTESTS/C48mx500_3DVarAOWCDA_898a61ad

emcbot commented 6 days ago

Experiment C96_atmaerosnowDA FAILED on Hera with error logs:

/scratch1/NCEPDEV/global/CI/2692/RUNTESTS/COMROOT/C96_atmaerosnowDA_898a61ad/logs/2021122100/gfsatmos_prod_f075.log
/scratch1/NCEPDEV/global/CI/2692/RUNTESTS/COMROOT/C96_atmaerosnowDA_898a61ad/logs/2021122100/gfsatmos_prod_f078.log
/scratch1/NCEPDEV/global/CI/2692/RUNTESTS/COMROOT/C96_atmaerosnowDA_898a61ad/logs/2021122100/gfsfcst.log

Follow link here to view the contents of the above file(s): (link)

emcbot commented 6 days ago

Experiment C96_atmaerosnowDA FAILED on Hera in /scratch1/NCEPDEV/global/CI/2692/RUNTESTS/C96_atmaerosnowDA_898a61ad

TerrenceMcGuinness-NOAA commented 5 days ago

@WalterKolczynski-NOAA This FAIL is a CI PASS. We are testing the Finalize reporting and scm try catch updates and it work like a charm on failures due to disk quotas on Hera.