fossilfuelregistry / portal

3 stars 0 forks source link

Ingest updated GEM oil and gas #86

Open OpenOilUG opened 2 years ago

OpenOilUG commented 2 years ago

GEM_Final_211025_1623.xlsx

As discussed, this file is a spreadsheet which takes original GEM data and filters it in various ways until it reaches the production and reserves data suitable for ingestion. These are in the two sheets with the red tabs - "7b Adj. Dense" for Production and "12 - Sole, Dense, Dups" for reserves. To note: for each sheet we have to add attributes of the record. For production these are columns O, Q and R - Fuel Type, Project and Dense... Fuel Type normalises the GEM entry Fuel Description (column G) which is retained for metadata and use in updates. Column Q is a switch indicating if the data is down to project level, or is instead merely sub-national. Column R is a metadata attribute to allow dynamic calculation of volumes of emissions recorded through either dense or sparse data at any point in time. In the sheet for reserves, columns P, R and S are added. Column P is normalised to oil or gas from the GEM Fuel-Dscription in column G (stored for metadata), column R is again the field indicating dense or sparse data and Column S is a normalisation of the GEM column I "Reserves classification (original)". All extra columns to be ingested have been highlighted in yellow. Intermediate calculation and reference columns are highlighted in grey and original GEM data columns preserves in white.