owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
58 stars 18 forks source link

🐛 news: get correct numerator #2909

Closed lucasrodes closed 2 days ago

lucasrodes commented 2 days ago
owidbot commented 2 days ago
Quick links (staging server): Site Admin Wizard

Login: ssh owid@staging-site-fix-numerator-news

chart-diff: ✅
  • 1/1 reviewed charts
    • Modified: 1/1
    • New: 0/0
data-diff: ❌ Found differences ```diff = Dataset garden/news/2024-05-08/guardian_mentions = Table guardian_mentions ~ Dim country + + New values: 11 / 2732 (0.40%) year country 2015 Total 2017 Total 2019 Total 2022 Total 2023 Total ~ Dim year + + New values: 11 / 2732 (0.40%) country year Total 2015 Total 2017 Total 2019 Total 2022 Total 2023 ~ Column num_pages_mentions (new data, changed data) + + New values: 11 / 2732 (0.40%) country year num_pages_mentions Total 2015 118494 Total 2017 85365 Total 2019 78760 Total 2022 78377 Total 2023 76686 ~ Changed values: 10 / 2732 (0.37%) country year num_pages_mentions - num_pages_mentions + Jordan 2015 2193 2121 Jordan 2016 2070 1969 Jordan 2018 1698 1652 Jordan 2022 1594 1531 Jordan 2023 2022 1927 ~ Column num_pages_mentions_per_million (new data, changed data) + + New values: 11 / 2732 (0.40%) country year num_pages_mentions_per_million Total 2015 NaN Total 2017 NaN Total 2019 NaN Total 2022 NaN Total 2023 NaN ~ Changed values: 10 / 2732 (0.37%) country year num_pages_mentions_per_million - num_pages_mentions_per_million + Jordan 2015 230.981903 223.398376 Jordan 2016 207.734146 197.598328 Jordan 2018 162.334808 157.937042 Jordan 2022 141.238495 135.656296 Jordan 2023 178.353149 169.973557 ~ Column num_pages_tags (new data) + + New values: 11 / 2732 (0.40%) country year num_pages_tags Total 2015 118494 Total 2017 85365 Total 2019 78760 Total 2022 78377 Total 2023 76686 ~ Column num_pages_tags_per_million (new data) + + New values: 11 / 2732 (0.40%) country year num_pages_tags_per_million Total 2015 NaN Total 2017 NaN Total 2019 NaN Total 2022 NaN Total 2023 NaN ~ Column relative_pages_mentions (new data, changed data) + + New values: 11 / 2732 (0.40%) country year relative_pages_mentions Total 2015 100000.0 Total 2017 100000.0 Total 2019 100000.0 Total 2022 100000.0 Total 2023 100000.0 ~ Changed values: 2633 / 2732 (96.38%) country year relative_pages_mentions - relative_pages_mentions + Argentina 2017 490.782593 989.867065 Central African Republic 2023 44.023190 108.233574 Cote d'Ivoire 2022 83.727722 209.245056 Iran 2022 745.891479 1864.067261 Luxembourg 2023 103.427971 254.283707 ~ Column relative_pages_mentions_excluded (new data, changed data) + + New values: 11 / 2732 (0.40%) country year relative_pages_mentions_excluded Total 2015 61.606495 Total 2017 50.371933 Total 2019 58.405281 Total 2022 77.828957 Total 2023 48.248703 ~ Changed values: 2682 / 2732 (98.17%) country year relative_pages_mentions_excluded - relative_pages_mentions_excluded + Botswana 2023 44.825314 0.000000 Brazil 2022 1289.775757 25.517691 Cambodia 2013 200.531372 139.402237 East Timor 2017 44.200485 179.230362 Spain 2014 2553.612305 688.859619 ~ Column relative_pages_tags (new data, changed data) + + New values: 11 / 2732 (0.40%) country year relative_pages_tags Total 2015 100000.0 Total 2017 100000.0 Total 2019 100000.0 Total 2022 100000.0 Total 2023 100000.0 ~ Changed values: 2340 / 2732 (85.65%) country year relative_pages_tags - relative_pages_tags + Afghanistan 2022 210.957870 405.731262 Belize 2021 5.685897 10.439503 Kenya 2021 58.280441 107.004906 Spain 2015 534.854675 405.083801 Tanzania 2018 20.031359 36.189384 ~ Column relative_pages_tags_excluded (new data, changed data) + + New values: 11 / 2732 (0.40%) country year relative_pages_tags_excluded Total 2015 16.034567 Total 2017 7.028642 Total 2019 15.236160 Total 2022 12.758845 Total 2023 26.080379 ~ Changed values: 2613 / 2732 (95.64%) country year relative_pages_tags_excluded - relative_pages_tags_excluded + Mali 2016 152.863953 24.456743 Peru 2020 310.522614 81.089645 Sweden 2016 858.735718 86.957306 Turkey 2021 1095.083862 3.914814 Uganda 2016 368.671875 145.834656 = Table avg_10y ~ Dim country + + New values: 1 / 280 (0.36%) year country 2023 Total ~ Dim year + + New values: 1 / 280 (0.36%) country year Total 2023 ~ Column num_pages_mentions_10y_avg (new data, changed data) + + New values: 1 / 280 (0.36%) country year num_pages_mentions_10y_avg Total 2023 90687.398438 ~ Changed values: 1 / 280 (0.36%) country year num_pages_mentions_10y_avg - num_pages_mentions_10y_avg + Jordan 2023 1804.300049 1735.599976 ~ Column num_pages_mentions_per_million_10y_avg (new data, changed data) + + New values: 1 / 280 (0.36%) country year num_pages_mentions_per_million_10y_avg Total 2023 NaN ~ Changed values: 1 / 280 (0.36%) country year num_pages_mentions_per_million_10y_avg - num_pages_mentions_per_million_10y_avg + Jordan 2023 175.189896 168.593033 ~ Column num_pages_tags_10y_avg (new data) + + New values: 1 / 280 (0.36%) country year num_pages_tags_10y_avg Total 2023 90687.398438 ~ Column num_pages_tags_per_million_10y_avg (new data) + + New values: 1 / 280 (0.36%) country year num_pages_tags_per_million_10y_avg Total 2023 NaN ~ Column relative_pages_mentions_10y_avg (new data, changed data) + + New values: 1 / 280 (0.36%) country year relative_pages_mentions_10y_avg Total 2023 100000.0 ~ Changed values: 244 / 280 (87.14%) country year relative_pages_mentions_10y_avg - relative_pages_mentions_10y_avg + Cyprus 2023 155.758942 335.630798 Ecuador 2023 114.730446 245.568268 Egypt 2023 459.129272 991.508606 Jordan 2023 940.177124 1950.487793 Turks and Caicos Islands 2023 4.893372 10.652713 ~ Column relative_pages_mentions_excluded_10y_avg (new data, changed data) + + New values: 1 / 280 (0.36%) country year relative_pages_mentions_excluded_10y_avg Total 2023 53.269863 ~ Changed values: 245 / 280 (87.50%) country year relative_pages_mentions_excluded_10y_avg - relative_pages_mentions_excluded_10y_avg + Cyprus 2023 265.744873 436.913666 Fiji 2023 237.454636 587.533752 Guernsey 2023 68.938583 265.695648 Reunion 2023 406.204285 481.989899 Venezuela 2023 291.139130 15.590997 ~ Column relative_pages_tags_10y_avg (new data, changed data) + + New values: 1 / 280 (0.36%) country year relative_pages_tags_10y_avg Total 2023 100000.0 ~ Changed values: 230 / 280 (82.14%) country year relative_pages_tags_10y_avg - relative_pages_tags_10y_avg + Lithuania 2023 18.501423 24.771965 Mongolia 2023 6.039805 8.166470 Montserrat 2023 0.715394 1.186496 Sierra Leone 2023 46.323597 41.497570 Syria 2023 534.982056 605.720276 ~ Column relative_pages_tags_excluded_10y_avg (new data, changed data) + + New values: 1 / 280 (0.36%) country year relative_pages_tags_excluded_10y_avg Total 2023 13.759124 ~ Changed values: 243 / 280 (86.79%) country year relative_pages_tags_excluded_10y_avg - relative_pages_tags_excluded_10y_avg + Canada 2023 1980.535522 1.883975 France 2023 5824.281738 0.084392 Italy 2023 2948.470459 55.049408 Jamaica 2023 231.956467 410.853790 Myanmar 2023 458.711456 11.526277 Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-06-28 12:55:08 UTC Execution time: 4.59 seconds