Converting internal netCDF format to input4MIPs

[gidden]

general

• [x] translate year/month to datetime
• [x] remove gas, method, unit dims
• [x] add dataset attributes
• [x] add variable attributes
• after discussion with BCS
  • [x] change fname of global sectors to 'short name' (aircraft, shipping) -> fine
  • [x] ~replace variable names "-" with "_"~. Not possible, need to follow variable template.
  • [x] change fname of openburning shares to drop 'em' and replace 'shares_emissions' -> 'share'
  • [x] add bounds dimensions and bound variables
  • [x] when viewing the ncs, it seems like lat dim is actually cut off (even though it is in the full dataset)
• [x] Align filenames with general input4mips template, where activity_id is "input4MIPS", dataset_category is "emissions", target_mip is "ScenarioMIP

<gas>-em-anthro

• after discussion with BCS
  • [x] missing dim values: Agriculture for CO2
  • [x] missing dim values: Shipping ~(decide to keep shipping sector different or not; this should now be trivial with 'World' added to iso index raster)~. Better to include.
  • [x] translate sector dim to integer (0: Agriculture; 1: Energy; 2: Industrial; 3: Transportation; 4: Residential, Commercial, Other; 5: Solvents production and application; 6: Waste; 7: International Shipping; 8: Negative CO2 Emissions) (decide if needed or not)

<gas>-openburning-share

• remove entirely.
• instead add sector dim to <gas>-em-openburning
• after discussion with BCS
  • [x] translate sector dim to integer ( 0: Agricultural Waste Burning On Fields; 1: Forest Burning; 2: Grassland Burning; 3: Peat Burning) (decide if needed or not)

[gidden]

from @coroa:

translate year/month to datetime

In [34]: def convert_to_datetime(da):
...:     da = da.stack(time=("year", "month"))
...:     dates = pd.DatetimeIndex(da.indexes["time"].map(lambda t: date(t[0], t[1]+1, 1)))
...:     return da.drop_vars(["time", "year", "month"]).assign_coords(time=dates)

[etiennesky]

• translate sector dim to integer (0: Agriculture; 1: Energy; 2: Industrial; 3: Transportation; 4: Residential, Commercial, Other; 5: Solvents production and application; 6: Waste; 7: International Shipping; 8: Negative CO2 Emissions) (decide if needed or not)

Hi @gidden note that sector 8 is only defined for CO2-em , not for the other species. I still think it needs to be there, even if we add the negative emissions separately, for compliance with input4miPS files.

[coroa]

Additional information at Task 1.3 - automated checks meeting notes

[etiennesky]

Hi I think the following is missing, based on our last discussion

• Clean-up reported dimensions (e.g. year, month, gas, unit, method )
• add _FillValue (defaul 1e20)
• Grid definitions (lat/lon)
• Shipping would be good to include in em-anthro
• update filenames, per our discussion in the GA we decided activity_id=input4MIPs, target_mip=RESCUE and source_id=PIK-IIASA-REMIND-MAGPIE-scenariox-versionn

[gidden]

closing this for now as I think most issues have been addressed - let's reopen something specifically with a review tag if it remains.