owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
86 stars 23 forks source link

:lipstick: ophi: Improve metadata in MPI dataset #3544

Closed paarriagadap closed 1 week ago

paarriagadap commented 1 week ago

Issue: https://github.com/owid/owid-issues/issues/1605

owidbot commented 1 week ago
Quick links (staging server): Site Admin Wizard Docs

Login: ssh owid@staging-site-improve-mpi-metadata

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences ```diff = Dataset garden/ophi/2024-10-28/multidimensional_poverty_index = Table multidimensional_poverty_index ~ Column censored_headcount_ratio (changed metadata) - - Being _MPI poor_ means that a person is deprived in a third or more of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^ + + Being _MPI poor_ means that a person lives in a household deprived in a third or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^ ~ Column headcount_ratio (changed metadata) - - Being _MPI poor_ means that a person is deprived in a third or more of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^ + + Being _MPI poor_ means that a person lives in a household deprived in a third or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a certain threshold for that indicator. For instance, a household is deprived in the _Years of schooling_ indicator if no household member has completed six years of schooling. A person is considered deprived in the _Cooking fuel_ indicator if they cook using solid fuel, such as dung, agricultural crops, wood, charcoal, or coal. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. - - The individual indicators are not _weighted_ equally: When adding up the number of indicators in which a person is deprived, some count for more than others. Health and education indicators are given a weight of 1/6, while the indicators within the living standards dimension are given a weight of 1/18. This means that the three dimensions – health, education and living standards – have an equal weight in the total of one-third each. - - - |- - - If the household survey data being used is missing any of the 10 indicators, that indicator is dropped from the calculation. The weights are then adjusted so that each dimension continues to be given a weight of one-third. MPI poverty estimates are only calculated if at least one indicator in health and education dimensions is available, and if up to four indicators in the living standards dimension are available. ~ Column intensity (changed metadata) - - Being _MPI poor_ means that a person is deprived in a third or more of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^ + + Being _MPI poor_ means that a person lives in a household deprived in a third or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a certain threshold for that indicator. For instance, a household is deprived in the _Years of schooling_ indicator if no household member has completed six years of schooling. A person is considered deprived in the _Cooking fuel_ indicator if they cook using solid fuel, such as dung, agricultural crops, wood, charcoal, or coal. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. - - The individual indicators are not _weighted_ equally: When adding up the number of indicators in which a person is deprived, some count for more than others. Health and education indicators are given a weight of 1/6, while the indicators within the living standards dimension are given a weight of 1/18. This means that the three dimensions – health, education and living standards – have an equal weight in the total of one-third each. - - - |- - - If the household survey data being used is missing any of the 10 indicators, that indicator is dropped from the calculation. The weights are then adjusted so that each dimension continues to be given a weight of one-third. MPI poverty estimates are only calculated if at least one indicator in health and education dimensions is available, and if up to four indicators in the living standards dimension are available. - - - |- - - An example given by the researchers who calculate the MPI data serves to illustrate this well: "Imagine two countries: in both, 30% of people are poor (incidence). Judged by this piece of information, these two countries are equally poor. However, imagine that in one of the two countries poor people are deprived —on average— in one-third of the dimensions, whereas in the other country, the poor are deprived —on average— in two-thirds. By combining the two pieces of information -the intensity of deprivations and the proportion of poor people- we know that these two countries are not equally poor, but rather that the second is poorer than the first because the intensity of poverty is higher." ~ Column mpi (changed metadata) - - Multidimensional poverty is defined as being deprived in a range of health, education and living standards indicators. The MPI is a measure that reflects both the prevalence and the intensity of multidimensional poverty.<% if area == "Urban" %> ? ^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^ + + Multidimensional poverty is defined as being deprived in a range of health, education and living standards indicators. The MPI is a measure that combines the prevalence and the intensity of multidimensional poverty.<% if area == "Urban" %> ? ^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^ - - The Multidimensional Poverty Index is obtained by multiplying two values: the share of people who are multidimensionally (MPI) poor and the intensity of multidimensional poverty among the MPI poor. A larger figure represents a higher level of poverty. + + The Multidimensional Poverty Index (MPI) is calculated by multiplying two values: the share of people who are multidimensionally poor and the intensity of their poverty. Values range between 0 and 1, where a larger figure represents a higher level of poverty. - - Being _MPI poor_ means that a person is deprived in a third or more of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^ + + Being _MPI poor_ means that a person lives in a household deprived in a third or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a certain threshold for that indicator. For instance, a household is deprived in the _Years of schooling_ indicator if no household member has completed six years of schooling. A person is considered deprived in the _Cooking fuel_ indicator if they cook using solid fuel, such as dung, agricultural crops, wood, charcoal, or coal. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. - - The individual indicators are not _weighted_ equally: When adding up the number of indicators in which a person is deprived, some count for more than others. Health and education indicators are given a weight of 1/6, while the indicators within the living standards dimension are given a weight of 1/18. This means that the three dimensions – health, education and living standards – have an equal weight in the total of one-third each. - - - |- - - If the household survey data being used is missing any of the 10 indicators, that indicator is dropped from the calculation. The weights are then adjusted so that each dimension continues to be given a weight of one-third. MPI poverty estimates are only calculated if at least one indicator in health and education dimensions is available, and if up to four indicators in the living standards dimension are available. - - - |- - - An example given by the researchers who calculate the MPI data serves to illustrate this well: "Imagine two countries: in both, 30% of people are poor (incidence). Judged by this piece of information, these two countries are equally poor. However, imagine that in one of the two countries poor people are deprived —on average— in one-third of the dimensions, whereas in the other country, the poor are deprived —on average— in two-thirds. By combining the two pieces of information -the intensity of deprivations and the proportion of poor people- we know that these two countries are not equally poor, but rather that the second is poorer than the first because the intensity of poverty is higher." - - - |- - - The Multidimensional Poverty Index, being the product of the incidence and intensity of multidimensional poverty, reflects both. ~ Column severe (changed metadata) - - Being _severely_ multidimensionally poor means that a person is deprived in 50% or more of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^ + + Being _severely_ multidimensionally poor means that a person lives in a household deprived in 50% or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a certain threshold for that indicator. For instance, a household is deprived in the _Years of schooling_ indicator if no household member has completed six years of schooling. A person is considered deprived in the _Cooking fuel_ indicator if they cook using solid fuel, such as dung, agricultural crops, wood, charcoal, or coal. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. - - The individual indicators are not _weighted_ equally: When adding up the number of indicators in which a person is deprived, some count for more than others. Health and education indicators are given a weight of 1/6, while the indicators within the living standards dimension are given a weight of 1/18. This means that the three dimensions – health, education and living standards – have an equal weight in the total of one-third each. - - - |- - - If the household survey data being used is missing any of the 10 indicators, that indicator is dropped from the calculation. The weights are then adjusted so that each dimension continues to be given a weight of one-third. MPI poverty estimates are only calculated if at least one indicator in health and education dimensions is available, and if up to four indicators in the living standards dimension are available. ~ Column uncensored_headcount_ratio (changed metadata) - - Being _MPI poor_ means that a person is deprived in a third or more of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^ + + Being _MPI poor_ means that a person lives in a household deprived in a third or more of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^ ~ Column vulnerable (changed metadata) - - Being _vulnerable_ to multidimensional poverty means that a person is deprived in 20-33.33% of ten indicators, grouped into three dimensions: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance) and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^ ^^^^^^^^^^^^^^^^^^^^^^^^^ + + Being _vulnerable_ to multidimensional poverty means that a person lives in a household deprived in 20-33.33% of ten indicators, grouped into three dimensions of well-being: **health** (using two indicators: nutrition, child mortality), **education** (using two indicators: years of schooling, school attendance), and **living standards** (using five indicators: cooking fuel, sanitation, drinking water, electricity, housing, assets). ? ^^^^^^^^^^^^^^^^^^^^ ++++++++++++++ ^^^^^^^^^^^^^^^^^^^^^^^^^^ - - Households are assessed as being deprived in a given indicator if they do not meet a certain threshold for that indicator. For instance, a household is deprived in the _Years of schooling_ indicator if no household member has completed six years of schooling. A person is considered deprived in the _Cooking fuel_ indicator if they cook using solid fuel, such as dung, agricultural crops, wood, charcoal, or coal. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + Households are assessed as being deprived in a given indicator if they do not meet a specific threshold for that indicator. The thresholds for each indicator are published by OPHI in their (https://ophi.org.uk/sites/default/files/2024-10/OPHI%20MPI%20Methodological%20Note%2058_2.pdf). + + The indicators vary in weight: health and education indicators weigh 1/6, while living standards indicators weigh 1/18, making each dimension contribute equally to one-third of the total. - - The individual indicators are not _weighted_ equally: When adding up the number of indicators in which a person is deprived, some count for more than others. Health and education indicators are given a weight of 1/6, while the indicators within the living standards dimension are given a weight of 1/18. This means that the three dimensions – health, education and living standards – have an equal weight in the total of one-third each. - - - |- - - If the household survey data being used is missing any of the 10 indicators, that indicator is dropped from the calculation. The weights are then adjusted so that each dimension continues to be given a weight of one-third. MPI poverty estimates are only calculated if at least one indicator in health and education dimensions is available, and if up to four indicators in the living standards dimension are available. Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-11-15 11:29:34 UTC Execution time: 15.11 seconds