search

owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
86 stars 23 forks source link

🔨 archive datasets (lucas) #3551

Closed lucasrodes closed 1 week ago

lucasrodes commented 1 week ago

ref: https://github.com/owid/owid-issues/issues/1740

Archive datasets no longer in use:

owidbot commented 1 week ago
Quick links (staging server): Site Admin Wizard Docs

Login: ssh owid@staging-site-archive-datasets-lucas

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences ```diff = Dataset garden/harvard/2024-07-22/global_military_spending_dataset = Table global_military_spending_dataset = Dataset garden/war/2023-09-21/prio_v31 = Table prio_v31_country = Table prio_v31 ~ Column number_deaths_ongoing_conflicts_battle_high_per_capita (changed metadata, changed data) - - attribution: Population based on various sources (2023) ? ^ + + attribution: Population based on various sources (2024) ? ^ - - date_accessed: '2023-03-31' ? ^ ^ ^ + + date_accessed: '2024-07-11' ? ^ ^ ^ - - date_published: '2023-03-31' ? ^ ^ - + + date_published: '2024-07-15' ? ^ ^ + + + url: https://creativecommons.org/licenses/by/4.0/ - - - name: CC BY 3.0 - - url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt - - - name: CC BY 3.0 IGO - - url: http://creativecommons.org/licenses/by/3.0/igo/ ~ Changed values: 1345 / 2268 (59.30%) year region conflict_type number_deaths_ongoing_conflicts_battle_high_per_capita - number_deaths_ongoing_conflicts_battle_high_per_capita + 1966 Americas (PRIO) intrastate 0.104670 0.103403 1970 World extrasystemic 0.318808 0.318850 2003 Europe (PRIO) all 0.336163 0.334853 2004 Africa (PRIO) intrastate (internationalized) 0.060902 0.060024 2007 Middle East (PRIO) intrastate (non-internationalized) 0.373903 0.371507 ~ Column number_deaths_ongoing_conflicts_battle_low_per_capita (changed metadata, changed data) - - attribution: Population based on various sources (2023) ? ^ + + attribution: Population based on various sources (2024) ? ^ - - date_accessed: '2023-03-31' ? ^ ^ ^ + + date_accessed: '2024-07-11' ? ^ ^ ^ - - date_published: '2023-03-31' ? ^ ^ - + + date_published: '2024-07-15' ? ^ ^ + + + url: https://creativecommons.org/licenses/by/4.0/ - - - name: CC BY 3.0 - - url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt - - - name: CC BY 3.0 IGO - - url: http://creativecommons.org/licenses/by/3.0/igo/ ~ Changed values: 1342 / 2268 (59.17%) year region conflict_type number_deaths_ongoing_conflicts_battle_low_per_capita - number_deaths_ongoing_conflicts_battle_low_per_capita + 1961 Americas (PRIO) intrastate (internationalized) 0.066430 0.065826 1971 Middle East (PRIO) all 0.017774 0.017863 1972 World intrastate (non-internationalized) 0.155191 0.155186 1988 Asia and Oceania (PRIO) interstate 0.003055 0.003058 2008 Middle East (PRIO) intrastate (internationalized) 0.575151 0.572485 ~ Column number_deaths_ongoing_conflicts_battle_per_capita (changed metadata, changed data) - - attribution: Population based on various sources (2023) ? ^ + + attribution: Population based on various sources (2024) ? ^ - - date_accessed: '2023-03-31' ? ^ ^ ^ + + date_accessed: '2024-07-11' ? ^ ^ ^ - - date_published: '2023-03-31' ? ^ ^ - + + date_published: '2024-07-15' ? ^ ^ + + + url: https://creativecommons.org/licenses/by/4.0/ - - - name: CC BY 3.0 - - url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt - - - name: CC BY 3.0 IGO - - url: http://creativecommons.org/licenses/by/3.0/igo/ ~ Changed values: 1345 / 2268 (59.30%) year region conflict_type number_deaths_ongoing_conflicts_battle_per_capita - number_deaths_ongoing_conflicts_battle_per_capita + 1966 Americas (PRIO) intrastate 0.085619 0.084583 1970 World extrasystemic 0.217261 0.217289 2003 Europe (PRIO) all 0.268930 0.267883 2004 Africa (PRIO) intrastate (internationalized) 0.060539 0.059666 2007 Middle East (PRIO) intrastate (non-internationalized) 0.344317 0.342111 = Dataset garden/war/2024-08-26/ucdp_prio = Table ucdp_prio Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-11-18 11:44:04 UTC Execution time: 15.17 seconds