search

owid / co2-data

Data on CO2 and greenhouse gas emissions by Our World in Data
https://ourworldindata.org/co2-and-other-greenhouse-gas-emissions
654 stars 219 forks source link

Fetch data from catalog #31

Closed pabloarosado closed 2 years ago

pabloarosado commented 2 years ago

This repository does not process the CO2 data anymore. Instead, it loads the data from etl, generates the dataset (csv, excel and json) files, and uploads them to S3.

@edomt could you please check the README? @Marigold the script scripts/make_dataset.py is currently not working because the table cannot be found in the catalog, but I believe that it will work once the catalog is updated. Is there any way to check?

Once this PR is approved I will update the files in S3.

Marigold commented 2 years ago

@Marigold the script scripts/make_dataset.py is currently not working because the table cannot be found in the catalog, but I believe that it will work once the catalog is updated. Is there any way to check?

(It works now by the way). If you have the dataset locally you could test it out with LocalCatalog, i.e.

from etl.paths import DATA_DIR
from pathlib import Path

lc = LocalCatalog(Path(DATA_DIR))
lc.reindex()
lc.find("owid_co2", namespace="emissions", channels=["garden"])