📊 emissions: Update emissions and energy datasets

[pabloarosado]

• Update GCB data after their latest minor update (they produced some corrected files).
• Improve sanity checks after latest changes.
• Refactor emissions steps to create new release of the CO2 dataset.
• Create an export step to push all files to github.
• Create an export step to push all files to digital ocean.
• Remove all code from the co2-data repos (on a separate PR).
• Minor fix in Anomalist.

~TODO: Wait for confirmation from GCP before doing chart diff. They may update the files in their website.~ I decided to merge this to avoid blocking the update for so long. Once they update the links on their website, I'll create a small PR updating the snapshot files (and I'll check that there were no major changes).

@Marigold no need to review all files, but what do you think about the export steps? The idea with them is to be able to fully eliminate the code in the co2-data repos, so that all pipeline comes from the ETL. Thanks!

[owidbot]

Quick links (staging server): Site Dev	Site Preview	Admin	Wizard	Docs

Login: ssh owid@staging-site-update-emissions-and-energy-data

chart-diff: ✅

• 96/96 reviewed charts
• Modified: 96/96
• New: 0/0
• Rejected: 0

data-diff: ✅ No differences found

```diff + Dataset garden/emissions/2024-11-21/gdp_and_co2_decoupling + + Table gdp_and_co2_decoupling + + Column consumption_emissions_per_capita_change + + Column gdp_per_capita_change + Dataset garden/emissions/2024-11-21/owid_co2 + + Table owid_co2 + + Column iso_code + + Column population + + Column gdp + + Column cement_co2 + + Column cement_co2_per_capita + + Column co2 + + Column co2_growth_abs + + Column co2_growth_prct + + Column co2_including_luc + + Column co2_including_luc_growth_abs + + Column co2_including_luc_growth_prct + + Column co2_including_luc_per_capita + + Column co2_including_luc_per_gdp + + Column co2_including_luc_per_unit_energy + + Column co2_per_capita + + Column co2_per_gdp + + Column co2_per_unit_energy + + Column coal_co2 + + Column coal_co2_per_capita + + Column consumption_co2 + + Column consumption_co2_per_capita + + Column consumption_co2_per_gdp + + Column cumulative_cement_co2 + + Column cumulative_co2 + + Column cumulative_co2_including_luc + + Column cumulative_coal_co2 + + Column cumulative_flaring_co2 + + Column cumulative_gas_co2 + + Column cumulative_luc_co2 + + Column cumulative_oil_co2 + + Column cumulative_other_co2 + + Column energy_per_capita + + Column energy_per_gdp + + Column flaring_co2 + + Column flaring_co2_per_capita + + Column gas_co2 + + Column gas_co2_per_capita + + Column ghg_excluding_lucf_per_capita + + Column ghg_per_capita + + Column land_use_change_co2 + + Column land_use_change_co2_per_capita + + Column methane + + Column methane_per_capita + + Column nitrous_oxide + + Column nitrous_oxide_per_capita + + Column oil_co2 + + Column oil_co2_per_capita + + Column other_co2_per_capita + + Column other_industry_co2 + + Column primary_energy_consumption + + Column share_global_cement_co2 + + Column share_global_co2 + + Column share_global_co2_including_luc + + Column share_global_coal_co2 + + Column share_global_cumulative_cement_co2 + + Column share_global_cumulative_co2 + + Column share_global_cumulative_co2_including_luc + + Column share_global_cumulative_coal_co2 + + Column share_global_cumulative_flaring_co2 + + Column share_global_cumulative_gas_co2 + + Column share_global_cumulative_luc_co2 + + Column share_global_cumulative_oil_co2 + + Column share_global_cumulative_other_co2 + + Column share_global_flaring_co2 + + Column share_global_gas_co2 + + Column share_global_luc_co2 + + Column share_global_oil_co2 + + Column share_global_other_co2 + + Column share_of_temperature_change_from_ghg + + Column temperature_change_from_ch4 + + Column temperature_change_from_co2 + + Column temperature_change_from_ghg + + Column temperature_change_from_n2o + + Column total_ghg + + Column total_ghg_excluding_lucf + + Column trade_co2 + + Column trade_co2_share + + Table owid_co2_codebook + + Column description + + Column unit + + Column source + Dataset garden/gcp/2024-11-21/global_carbon_budget + + Table global_carbon_budget + + Column consumption_emissions + + Column consumption_emissions_as_share_of_global + + Column consumption_emissions_per_capita + + Column consumption_emissions_per_gdp + + Column cumulative_consumption_emissions + + Column cumulative_consumption_emissions_as_share_of_global + + Column cumulative_emissions_from_cement + + Column cumulative_emissions_from_cement_as_share_of_global + + Column cumulative_emissions_from_coal + + Column cumulative_emissions_from_coal_as_share_of_global + + Column cumulative_emissions_from_flaring + + Column cumulative_emissions_from_flaring_as_share_of_global + + Column cumulative_emissions_from_gas + + Column cumulative_emissions_from_gas_as_share_of_global + + Column cumulative_emissions_from_land_use_change + + Column cumulative_emissions_from_land_use_change_as_share_of_global + + Column cumulative_emissions_from_oil + + Column cumulative_emissions_from_oil_as_share_of_global + + Column cumulative_emissions_from_other_industry + + Column cumulative_emissions_from_other_industry_as_share_of_global + + Column cumulative_emissions_total + + Column cumulative_emissions_total_as_share_of_global + + Column cumulative_emissions_total_including_land_use_change + + Column cumulative_emissions_total_including_land_use_change_as_share_of_global + + Column emissions_from_cement + + Column emissions_from_cement_as_share_of_global + + Column emissions_from_cement_per_capita + + Column emissions_from_coal + + Column emissions_from_coal_as_share_of_global + + Column emissions_from_coal_per_capita + + Column emissions_from_flaring + + Column emissions_from_flaring_as_share_of_global + + Column emissions_from_flaring_per_capita + + Column emissions_from_gas + + Column emissions_from_gas_as_share_of_global + + Column emissions_from_gas_per_capita + + Column emissions_from_land_use_change + + Column emissions_from_land_use_change_as_share_of_global + + Column emissions_from_land_use_change_per_capita + + Column emissions_from_oil + + Column emissions_from_oil_as_share_of_global + + Column emissions_from_oil_per_capita + + Column emissions_from_other_industry + + Column emissions_from_other_industry_as_share_of_global + + Column emissions_from_other_industry_per_capita + + Column emissions_total + + Column emissions_total_as_share_of_global + + Column emissions_total_including_land_use_change + + Column emissions_total_including_land_use_change_as_share_of_global + + Column emissions_total_including_land_use_change_per_capita + + Column emissions_total_including_land_use_change_per_gdp + + Column emissions_total_including_land_use_change_per_unit_energy + + Column emissions_total_per_capita + + Column emissions_total_per_gdp + + Column emissions_total_per_unit_energy + + Column gdp + + Column growth_emissions_total + + Column growth_emissions_total_including_land_use_change + + Column pct_growth_emissions_total + + Column pct_growth_emissions_total_including_land_use_change + + Column pct_traded_emissions + + Column population + + Column population_as_share_of_global + + Column primary_energy_consumption + + Column traded_emissions + + Column traded_emissions_per_capita Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-11-22 11:10:28 UTC Execution time: 4.52 seconds