search

geoschem / HEMCO

The Harmonized Emissions Component (HEMCO), developed by the GEOS-Chem Support Team.
https://hemco.readthedocs.io
Other
15 stars 31 forks source link

HEMCO does not stop with error upon trying to read a missing EDGARv7 file #258

Closed yantosca closed 5 months ago

yantosca commented 5 months ago

Name and Institution (Required)

Name: Bob Yantosca Institution: Harvard + GCST

Confirm you have reviewed the following documentation

Description of your issue or question

In the CH4 and carbon simulations, the out-of-the-box HEMCO_Config.rc file has these entries to read oil production (PRO_OIL), gas production (PRO_GAS), and coal production (PRO_COAL) emissions.

(((EDGARv7
### Oil ###
0 EDGAR7_CH4_OIL__1B2a          $ROOT/CH4/v2023-04/EDGARv7/$YYYY/v7.0_FT2021_CH4_$YYYY_PRO_OIL.0.1x0.1.nc          emi_ch4 2010-2021/1-12/1/0 C xy kg/m2/s CH4 32 1 1
...

### Gas ###
0 EDGAR7_CH4_OIL__1B2c          $ROOT/CH4/v2023-04/EDGARv7/$YYYY/v7.0_FT2021_CH4_$YYYY_PRO_GAS.0.1x0.1.nc          emi_ch4 2010-2021/1-12/1/0 C xy kg/m2/s CH4 31 2 1

### Coal ###
0 EDGAR7_CH4_COAL__1B1a         $ROOT/CH4/v2023-04/EDGARv7/$YYYY/v7.0_FT2021_CH4_$YYYY_PRO_COAL.0.1x0.1.nc         emi_ch4 2010-2021/1-12/1/0 C xy kg/m2/s CH4 30 3 1

But in the data directory, there are no PRO_OIL, PRO_GAS, PRO_COAL sectorial emissions files, just PRO:

v7.0_FT2021_CH4_2019_AGS.0.1x0.1.nc
v7.0_FT2021_CH4_2019_AWB.0.1x0.1.nc
v7.0_FT2021_CH4_2019_CHE.0.1x0.1.nc
v7.0_FT2021_CH4_2019_ENE.0.1x0.1.nc
v7.0_FT2021_CH4_2019_ENF.0.1x0.1.nc
v7.0_FT2021_CH4_2019_FFF.0.1x0.1.nc
v7.0_FT2021_CH4_2019_IND.0.1x0.1.nc
v7.0_FT2021_CH4_2019_IRO.0.1x0.1.nc
v7.0_FT2021_CH4_2019_MNM.0.1x0.1.nc
v7.0_FT2021_CH4_2019_PRO.0.1x0.1.nc       <=== HERE
v7.0_FT2021_CH4_2019_RCO.0.1x0.1.nc
v7.0_FT2021_CH4_2019_REF_TRF.0.1x0.1.nc
v7.0_FT2021_CH4_2019_SWD_INC.0.1x0.1.nc
v7.0_FT2021_CH4_2019_SWD_LDF.0.1x0.1.nc
v7.0_FT2021_CH4_2019_TNR_Aviation_CDS.0.1x0.1.nc
v7.0_FT2021_CH4_2019_TNR_Aviation_CRS.0.1x0.1.nc
v7.0_FT2021_CH4_2019_TNR_Aviation_LTO.0.1x0.1.nc
v7.0_FT2021_CH4_2019_TNR_Other.0.1x0.1.nc
v7.0_FT2021_CH4_2019_TNR_Ship.0.1x0.1.nc
v7.0_FT2021_CH4_2019_TRO_noRES.0.1x0.1.nc
v7.0_FT2021_CH4_2019_WWT.0.1x0.1.nc

I would expect that HEMCO would stop upon error when trying to read data from nonexistent PRO_GAS, PRO_OIL, PRO_COAL data files, However, HEMCO just skips the missing files without stopping, as evidenced from the log file:

HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_ENF.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_MNM.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_SWD_LDF.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_WWT.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_AGS.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_ENE.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_IND.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_TNR_Aviation_CDS.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_TNR_Aviation_CRS.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_TNR_Aviation_LTO.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_TRO_noRES.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_TNR_Other.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_TNR_Ship.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_RCO.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_CHE.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_IRO.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_AWB.0.1x0.1.nc
HEMCO: Opening /n/holyscratch01/external_repos/GEOS-CHEM/gcgrid/data/ExtData/HEMCO/CH4/v2023-04/EDGARv7/2019/v7.0_FT2021_CH4_2019_SWD_INC.0.1x0.1.nc

Tagging @msulprizio @lizziel.
Also tagging @laestrada, as this might be an issue for the IMI as well.

yantosca commented 5 months ago

Upon further investigation, it seems that the missing entries are superseded by data with a higher hierarchy:

-------------------------------------------------------------------------------
 Register_Base: Checking EDGAR7_CH4_COAL__1B1a
HEMCO: Entering Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Skip container EDGAR7_CH4_COAL__1B1a because of GFEI_CH4_COAL
HEMCO: Leaving Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Container ID     :          100
 Assigned targetID:         -999
-------------------------------------------------------------------------------
 Register_Base: Checking EDGAR7_CH4_OIL__1B2c
HEMCO: Entering Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Skip container EDGAR7_CH4_OIL__1B2c because of GFEI_CH4_GAS
HEMCO: Leaving Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Container ID     :           99
 Assigned targetID:         -999
-------------------------------------------------------------------------------
 Register_Base: Checking EDGAR7_CH4_OTHER__1A1_1B1_1B2
HEMCO: Entering Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Skip container EDGAR7_CH4_OTHER__1A1_1B1_1B2 because of GFEI_CH4_OIL
HEMCO: Leaving Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Container ID     :           98
 Assigned targetID:         -999
-------------------------------------------------------------------------------
 Register_Base: Checking EDGAR7_CH4_OIL__1B2a
HEMCO: Entering Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Skip container EDGAR7_CH4_OIL__1B2a because of GFEI_CH4_OIL
HEMCO: Leaving Get_targetID (HCO_CONFIG_MOD.F90) ( 4)
 Container ID     :           97
 Assigned targetID:         -999

In any case, we should update the HEMCO_Config.rc and ExtData.rc template files to point to the proper EDGARv7 file with the proper scale factors.

yantosca commented 5 months ago

I will close this issue and open a new issue on geoschem/geos-chem, since it deals with configuration files.

yantosca commented 5 months ago

Discussion has been moved to: https://github.com/geoschem/geos-chem/issues/2115