BEIS-Final-UK-greenhouse-gas-emissions-national-statistics-1990-to-2019

ajtucker commented 3 years ago

[ ] Transform specified
[x] Transform implemented
[x] Codelists created
[x] Column mapping
[x] Additional metadata
[ ] Reviewed
[ ] Periodic build trigger

canwaf commented 3 years ago

Link to info.json

canwaf commented 3 years ago

Straightforward transform (reading a csv is easy).

rossbowen commented 3 years ago

To give a quick steer on what I think is needed here in lieu of a formal spec.

Table 1:

[Gas, Year, Value]

Provide us a .csv of the gas names before and after pathify() for a gas codelist.
Keep total under the gas column.

Table 2:

[Geographic Coverage, "inclusions-exclusions", Gas, Year, Value]

Provide us .csv for Geographic Coverage, "inclusions-exclusions" before and after pathify. Will use the same codelist for gas as above.
Need a better name for "inclusions-exclusions" but it'll do for now.
Possibly some scope to be combined with Table 1.

Table 3:

[Sector, Subsector, Gas = "All", Year, Value]

Would be awesome if you could provide .csv for Sector and Subsector together, linking the "child" subsector in one column to the "parent" in another column. e.g., Energy Supply -> Power Stations and include before and after pathify.

Note that the hierarchy is actually in three bits in some cases, e.g., Transport.

In this case, Passenger Cars would be linked to its parent, Road, and Road would be linked to its parent Transport, and Transport would be linked to its parent Total.

Tables 4 - 7:

Merge with table 3. [Sector, Subsector, Gas, Year, Value]
Set Gas to the gas included in the title, make it consistent with the other codelists for gas, e.g.,
Set Gas = carbon-dioxide for table 4, Gas = methane for table 5 etc.

RedWalters commented 3 years ago

Will need DM attention to determine how to handle NC category stuff, also whether to include gas forms into fuel code list or to have a separate code list; be that local or family.

rossbowen commented 3 years ago

@RedWalters

Gasses are their own codelist imo. NC Category is what I refer to as subsector above, sorry for not being so explicit! I can't run main.py at the moment though happy to talk this through if more direction is needed.

david-hull commented 3 years ago

BA comments Transformation looks fine, notwithstanding known issues and following observations:

A lot of decimal points in Gas Emissions column.
No filter for period.

GSS-Cogs / family-edvp