owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
85 stars 23 forks source link

:lipstick: ophi: Add FAQs and refine metadata for MPI dataset #3560

Closed paarriagadap closed 3 days ago

paarriagadap commented 3 days ago

Main issue https://github.com/owid/owid-issues/issues/1605#issuecomment-2478833397

owidbot commented 3 days ago
Quick links (staging server): Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-mpi-metadata-and-faqs

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences ```diff = Dataset garden/health/latest/global_health_mpox = Table global_health_mpox = Dataset garden/ophi/2024-10-28/multidimensional_poverty_index = Table multidimensional_poverty_index ~ Column censored_headcount_ratio (changed metadata) + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources ~ Column headcount_ratio (changed metadata) - - Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. [This article](https://ourworldindata.org/multidimensional-poverty-index) explains the specific thresholds. + + Each household is assessed against specific thresholds for these indicators. For example, a household is considered deprived in the _electricity_ indicator if it does not have access to it. [This article](https://ourworldindata.org/multidimensional-poverty-index) discusses specific thresholds in more detail. - - The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. + + Each indicator contributes to one of the three dimensions of well-being. Health and education indicators are weighted more (1/6 each) than living standards indicators (1/18 each) so that all three dimensions contribute equally to the overall measure. + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources ~ Column intensity (changed metadata) - - Multidimensional poverty is defined as being deprived in a range of health, education and living standards indicators. The intensity is the share of indicators in which the multidimensionally poor are deprived on average.<% if area == "Urban" %> ? ^^^ ^ ^^^^^^^^^^^^^^^^^^^^ + + Multidimensional poverty is defined as being deprived in a range of health, education and living standards indicators. The intensity is the share of indicators in which people in multidimensional poverty are deprived on average.<% if area == "Urban" %> ? ^^^^^^^^^ ^^^^^^^ ^^^^^^^^^^^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. [This article](https://ourworldindata.org/multidimensional-poverty-index) explains the specific thresholds. + + Each household is assessed against specific thresholds for these indicators. For example, a household is considered deprived in the _electricity_ indicator if it does not have access to it. [This article](https://ourworldindata.org/multidimensional-poverty-index) discusses specific thresholds in more detail. - - The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. + + Each indicator contributes to one of the three dimensions of well-being. Health and education indicators are weighted more (1/6 each) than living standards indicators (1/18 each) so that all three dimensions contribute equally to the overall measure. + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources ~ Column mpi (changed metadata) - - Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. [This article](https://ourworldindata.org/multidimensional-poverty-index) explains the specific thresholds. + + Each household is assessed against specific thresholds for these indicators. For example, a household is considered deprived in the _electricity_ indicator if it does not have access to it. [This article](https://ourworldindata.org/multidimensional-poverty-index) discusses specific thresholds in more detail. - - The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. + + Each indicator contributes to one of the three dimensions of well-being. Health and education indicators are weighted more (1/6 each) than living standards indicators (1/18 each) so that all three dimensions contribute equally to the overall measure. + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources ~ Column severe (changed metadata) - - Being _severely_ multidimensionally poor means that a person lives in a household deprived in 50% or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + + Being in severe multidimensional poverty means that a person lives in a household deprived in 50% or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. [This article](https://ourworldindata.org/multidimensional-poverty-index) explains the specific thresholds. + + Each household is assessed against specific thresholds for these indicators. For example, a household is considered deprived in the _electricity_ indicator if it does not have access to it. [This article](https://ourworldindata.org/multidimensional-poverty-index) discusses specific thresholds in more detail. - - The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. + + Each indicator contributes to one of the three dimensions of well-being. Health and education indicators are weighted more (1/6 each) than living standards indicators (1/18 each) so that all three dimensions contribute equally to the overall measure. + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources ~ Column uncensored_headcount_ratio (changed metadata) + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources ~ Column vulnerable (changed metadata) - - Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. [This article](https://ourworldindata.org/multidimensional-poverty-index) explains the specific thresholds. + + Each household is assessed against specific thresholds for these indicators. For example, a household is considered deprived in the _electricity_ indicator if it does not have access to it. [This article](https://ourworldindata.org/multidimensional-poverty-index) discusses specific thresholds in more detail. - - The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. + + Each indicator contributes to one of the three dimensions of well-being. Health and education indicators are weighted more (1/6 each) than living standards indicators (1/18 each) so that all three dimensions contribute equally to the overall measure. + + faqs: + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-definition + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-sources + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-indicators-unavailable + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-comparability + + - gdoc_id: 1gGburArxglFdHXeTLotFW4TOOLoeRq5XW6UfAdKtaAw + + fragment_id: mpi-other-sources = Dataset garden/who/2024-09-09/flu_test = Table flu_test ~ Dim country - - Removed values: 15 / 72173 (0.02%) date country 2024-11-04 Bangladesh 2024-10-21 Kuwait 2024-11-04 Kuwait 2024-10-28 Saudi Arabia 2024-10-21 Zambia ~ Dim date - - Removed values: 15 / 72173 (0.02%) country date Bangladesh 2024-11-04 Kuwait 2024-10-21 Kuwait 2024-11-04 Saudi Arabia 2024-10-28 Zambia 2024-10-21 ~ Column denomcombined (changed data) - - Removed values: 15 / 72173 (0.02%) country date denomcombined Bangladesh 2024-11-04 221 Kuwait 2024-10-21 8 Kuwait 2024-11-04 116 Saudi Arabia 2024-10-28 370 Zambia 2024-10-21 78 ~ Changed values: 25 / 72173 (0.03%) country date denomcombined - denomcombined + Australia 2024-11-04 3316 3310 Burkina Faso 2024-10-14 68 65 Saudi Arabia 2023-07-17 199 200 Saudi Arabia 2024-10-14 296 228 Somalia 2024-08-12 26 24 ~ Column pcnt_poscombined (changed data) - - Removed values: 15 / 72173 (0.02%) country date pcnt_poscombined Bangladesh 2024-11-04 4.524887 Kuwait 2024-10-21 12.500000 Kuwait 2024-11-04 33.620689 Saudi Arabia 2024-10-28 31.081081 Zambia 2024-10-21 2.564103 ~ Changed values: 29 / 72173 (0.04%) country date pcnt_poscombined - pcnt_poscombined + Australia 2024-11-04 1.779252 1.782477 Saudi Arabia 2023-07-17 23.618090 24.000000 Saudi Arabia 2023-10-02 32.009628 31.861576 Saudi Arabia 2024-10-21 31.295843 24.852072 Togo 2024-10-21 12.903226 8.064516 = Dataset garden/who/latest/monkeypox = Table monkeypox Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-11-19 12:20:15 UTC Execution time: 3.96 seconds