owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
58 stars 18 forks source link

:lipstick: Adjust metadata in LGBT+ datasets #2863

Closed paarriagadap closed 1 week ago

paarriagadap commented 1 week ago

Following https://github.com/owid/owid-issues/issues/1556#issuecomment-2180771672

owidbot commented 1 week ago
Quick links (staging server): Site Admin Wizard

Login: ssh owid@staging-site-update-metadata-lgbt-datasets

chart-diff: ✅
  • 2/2 reviewed charts
    • Modified: 2/2
    • New: 0/0
data-diff: ❌ Found differences ```diff = Dataset garden/artificial_intelligence/2024-06-19/epoch_compute_intensive_domain = Table epoch_compute_intensive_domain ~ Column cumulative_count (changed metadata) + + Recommendation systems offer suggestions based on user preferences, prominently seen in online shopping and media streaming. For instance, Netflix's movie suggestions or Amazon's product recommendations are powered by algorithms that analyze users' preferences and past behaviors. + + - |- + + 3D Modeling systems specialize in creating and manipulating 3D representations of objects, used in fields like architecture, engineering, and entertainment. + + - |- + + Audio systems process and generate sound, with applications in music composition, signal processing, and sound recognition. + + - |- + + Driving systems focus on autonomous vehicle technology, enabling cars to navigate and operate without human intervention. + + - |- + + Earth science systems utilize AI to study and model natural phenomena, assisting in weather forecasting and climate change studies. + + - |- + + - |- + + Materials science systems apply AI to discover and design new materials with specific properties, speeding up material discovery. + + - |- + + Mathematics systems solve complex mathematical problems and perform symbolic calculations, aiding in theorem proving and optimization. + + - Medicine systems enhance healthcare by improving diagnostics and treatment planning. + + - Robotics systems combine AI with mechanical engineering to create autonomous robots for various industries. + + - Search systems enhance search accuracy and relevance on the internet or within databases. + + - Video systems analyze and generate video content, aiding in editing, surveillance, and content creation. ~ Column yearly_count (changed metadata) + + Recommendation systems offer suggestions based on user preferences, prominently seen in online shopping and media streaming. For instance, Netflix's movie suggestions or Amazon's product recommendations are powered by algorithms that analyze users' preferences and past behaviors. + + - |- + + 3D Modeling systems specialize in creating and manipulating 3D representations of objects, used in fields like architecture, engineering, and entertainment. + + - |- + + Audio systems process and generate sound, with applications in music composition, signal processing, and sound recognition. + + - |- + + Driving systems focus on autonomous vehicle technology, enabling cars to navigate and operate without human intervention. + + - |- + + Earth science systems utilize AI to study and model natural phenomena, assisting in weather forecasting and climate change studies. + + - |- + + - |- + + Materials science systems apply AI to discover and design new materials with specific properties, speeding up material discovery. + + - |- + + Mathematics systems solve complex mathematical problems and perform symbolic calculations, aiding in theorem proving and optimization. + + - Medicine systems enhance healthcare by improving diagnostics and treatment planning. + + - Robotics systems combine AI with mechanical engineering to create autonomous robots for various industries. + + - Search systems enhance search accuracy and relevance on the internet or within databases. + + - Video systems analyze and generate video content, aiding in editing, surveillance, and content creation. = Dataset garden/climate/2023-12-20/surface_temperature = Table surface_temperature = Dataset garden/lgbt_rights/2023-04-27/lgbti_policy_index = Table lgbti_policy_index ~ Column age_of_consent (changed metadata) + + description_key: + + - |- + + The indicator is coded as follows: **_Equal_** (age of consent is equal and implemented), **_Partial implementation_** (age of consent is equal or unequal, but not completely implemented), **_No legal provisions**_ (there are no laws regulating the age of consent between same-sex and different-sex partners) and **_Unequal_** (age of consent is different and implemented). ~ Column age_of_consent_equal_count (changed metadata) + + description_short: |- - - description_short: This is the number of countries that have equal age of consent for same-sex and different-sex partners. ? ^^^^^^^^^^^^^^^^^^ + + This is the number of countries that have equal age of consent for same-sex and different-sex partners and this law is implemented. ? ^ ++++++++++++++++++++++++++++ + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Equal" means that the age of consent is equal and implemented. ~ Column age_of_consent_equal_pop (changed metadata) + + description_short: |- - - description_short: This is the total population of countries that have equal age of consent between same-sex and different-sex ? ^^^^^^^^^^^^^^^^^^ ^^^^^^^ + + This is the total population of countries that have equal age of consent for same-sex and different-sex partners and this law is implemented. ? ^ ^^^ ++++++++++++++++++++++++++++++++++++++ - - partners. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Equal" means that the age of consent is equal and implemented. ~ Column age_of_consent_missing_count (changed metadata) - - description_short: This is the number of countries that have missing data on the age of consent. + + description_short: |- + + This is the number of countries that do not have data on laws regulating the age of consent between same-sex and different-sex partners. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Missing" means that there are no data on the age of consent between same-sex and different-sex partners. ~ Column age_of_consent_missing_pop (changed metadata) - - description_short: This is the total population of countries that have missing data on the age of consent. + + description_short: |- + + This is the total population of countries that do not have data on laws regulating the age of consent between same-sex and different-sex partners. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Missing" means that there are no data on the age of consent between same-sex and different-sex partners. ~ Column age_of_consent_no_legal_provisions_count (changed metadata) - - description_short: This is the number of countries that do not have legal provisions for the age of consent. + + description_short: |- + + This is the number of countries that do not have legal provisions regulating the age of consent between same-sex and different-sex partners. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "No legal provisions" means that there are no laws regulating the age of consent between same-sex and different-sex partners. ~ Column age_of_consent_no_legal_provisions_pop (changed metadata) - - description_short: This is the total population of countries that do not have legal provisions for the age of consent. + + description_short: |- + + This is the total population of countries that do not have legal provisions regulating the age of consent between same-sex and different-sex partners. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "No legal provisions" means that there are no laws regulating the age of consent between same-sex and different-sex partners. ~ Column age_of_consent_partial_implementation_count (changed metadata) - - description_short: This is the number of countries that have partial implementation of the age of consent legislation. + + description_short: |- + + This is the number of countries where the age of consent between same-sex and different-sex partners is equal or unequal, but it is partially implemented. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Partial implementation" means that the age of consent is equal or unequal, but not completely implemented. ~ Column age_of_consent_partial_implementation_pop (changed metadata) - - description_short: This is the total population of countries that have partial implementation of the age of consent legislation. + + description_short: |- + + This is the total population of countries where the age of consent between same-sex and different-sex partners is equal or unequal, but it is partially implemented. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Partial implementation" means that the age of consent is equal or unequal, but not completely implemented. ~ Column age_of_consent_unequal_count (changed metadata) + + description_short: |- - - description_short: This is the number of countries that have unequal age of consent for same-sex and different-sex partners. ? ^^^^^^^^^^^^^^^^^^ + + This is the number of countries that have unequal age of consent for same-sex and different-sex partners, with full implementation of the law. ? ^ +++++++++++++++++++++++++++++++++++++ + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Unequal" means that the age of consent is different and implemented. ~ Column age_of_consent_unequal_pop (changed metadata) - - description_short: This is the total population of countries that have unequal age of consent between same-sex and different-sex - - partners. + + description_short: |- + + This is the total population of countries that have unequal age of consent for same-sex and different-sex partners, with full implementation of the law. + + + + From the original dataset, we combined data from two different indicators: age of consent equal and age of consent unequal, to consolidate in one indicator laws that define or outlaw age of consent equality between same-sex and different-sex partners.. "Unequal" means that the age of consent is different and implemented. ~ Column lgb_military_join (changed metadata) + + description_key: + + - |- + + The indicator is coded as follows: **_Allowed_** (LGB people are allowed to serve in the military), **_No policy_** (there is no policy allowing nor banning LGB military service) and **_Banned_** (LGB people are banned to serve in the military). ~ Column lgb_military_join_allowed_count (changed metadata) - - description_short: This is the number of countries that allow LGB military service. + + description_short: This is the number of countries where LGB people are allowed to serve in the military. + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "Allowed" means that LGB people are allowed to serve in the military. ~ Column lgb_military_join_allowed_pop (changed metadata) - - description_short: This is the total population of countries that allow LGB military service. ? ^ ^ ^^^^ -------- + + description_short: This is the total population of countries where LGB people are allowed to serve in the military. ? ^ +++++++++++++++ ^^ ^^^^^^^^^^^^^^^^^^ + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "Allowed" means that LGB people are allowed to serve in the military. ~ Column lgb_military_join_banned_count (changed metadata) - - description_short: This is the number of countries that ban LGB military service. + + description_short: This is the number of countries where LGB people are banned to serve in the military. + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "Banned" means that LGB people are banned to serve in the military. ~ Column lgb_military_join_banned_pop (changed metadata) - - description_short: This is the total population of countries that ban LGB military service. ? ^ ^ ^^^^ -------- + + description_short: This is the total population of countries where LGB people are banned to serve in the military. ? ^ +++++++++++++++ ^^ ^^^^^^^^^^^^^^^^^^^ + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "Banned" means that LGB people are banned to serve in the military. ~ Column lgb_military_join_missing_count (changed metadata) - - description_short: This is the number of countries that have missing data on LGB military service. ? -------- + + description_short: This is the number of countries that do not have data on laws regulating LGB military service. ? +++++++ ++++++++++++++++ + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "Missing" means that there are no data on laws regulating LGB military service. ~ Column lgb_military_join_missing_pop (changed metadata) - - description_short: This is the total population of countries that have missing data on LGB military service. ? ^^^^^ ----- ^ + + description_short: This is the total population of countries where there are no data on laws regulating LGB military service. ? ++++++ ++++ ^ ^ ++++++++++++++++ + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "Missing" means that there are no data on laws regulating LGB military service. ~ Column lgb_military_join_no_policy_count (changed metadata) - - description_short: This is the number of countries that do not have a policy on LGB military service. ? ^^^^^ -------- + + description_short: This is the number of countries where there is no policy allowing nor banning LGB military service. ? ++++++ ^^^^^^ +++ ++ +++++++++++++ + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "No policy" means that there is no policy allowing nor banning LGB military service. ~ Column lgb_military_join_no_policy_pop (changed metadata) - - description_short: This is the total population of countries that do not have a policy on LGB military service. ? ^^^^^ -------- + + description_short: This is the total population of countries where there is no policy allowing nor banning LGB military service. ? ++++++ ^^^^^^ +++ ++ +++++++++++++ + + + + From the original dataset, we combined data from two different indicators: LGB allowed in military and LGB military ban.. "No policy" means that there is no policy allowing nor banning LGB military service. ~ Column marriage (changed metadata, changed data) + + description_key: + + - |- + + The indicator is coded as follows: **_Legal_** (equal marriage is legal and fully implemented. There might be civil unions or not), **_Partially legal_** (equal marriage is legal, but not fully implemented. There might be civil unions or not), **_No legal provisions**_ (there are no laws regulating marriage equality nor civil unions), **_Ban and marriage both partial_** (equal marriage is partially implemented or equal marriage is banned but not fully implemented. Civil unions are partially implemented as well), **_Partially banned_** (equal marriage is banned but not fully implemented or it is banned but there is partial implementation of civil unions or equal marriage) and **_Banned_** (equal marriage is banned and fully implemented. There are no civil unions). - - - Partial + + - Partially legal ? ++++++++ - - - Marriage and ban both partial + + - Ban and marriage both partial - - - Partial ban + + - Partially banned ? ++ +++ ~ Changed values: 318 / 5800 (5.48%) country year marriage - marriage + Australia 2010 Partial Partially legal Croatia 2014 Partial ban Partially banned Mexico 2012 Partial Partially legal Slovenia 2008 Partial Partially legal Slovenia 2014 Partial Partially legal + + Column marriage_ban_and_marriage_both_partial_count + + Column marriage_ban_and_marriage_both_partial_pop ~ Column marriage_banned_count (changed metadata) - - description_short: This is the number of countries that have banned marriage equality. + + description_short: This is the number of countries where equal marriage is banned and fully implemented. There are no civil + + unions. + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "Banned" means that equal marriage is banned and fully implemented. There are no civil unions. ~ Column marriage_banned_pop (changed metadata) - - description_short: This is the total population of countries that have banned marriage equality. + + description_short: |- + + This is the total population of countries where equal marriage is banned and fully implemented. There are no civil unions. + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "Banned" means that equal marriage is banned and fully implemented. There are no civil unions. ~ Column marriage_legal_count (changed metadata) - - description_short: This is the number of countries that have legal marriage equality. + + description_short: This is the number of countries where equal marriage is legal and fully implemented. There might be civil + + unions or not. + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "Legal" means that equal marriage is legal and fully implemented. There might be civil unions or not. ~ Column marriage_legal_pop (changed metadata) - - description_short: This is the total population of countries that have legal marriage equality. + + description_short: |- + + This is the total population of countries where equal marriage is legal and fully implemented. There might be civil unions or not. + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "Legal" means that equal marriage is legal and fully implemented. There might be civil unions or not. - - Column marriage_marriage_and_ban_both_partial_count - - Column marriage_marriage_and_ban_both_partial_pop ~ Column marriage_missing_count (changed metadata) - - description_short: This is the number of countries that have missing data on marriage equality. ? -------- + + description_short: This is the number of countries that do not have data on laws regulating marriage equality. ? +++++++ ++++++++++++++++ + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "Missing" means that there are no data on laws regulating marriage equality. ~ Column marriage_missing_pop (changed metadata) - - description_short: This is the total population of countries that have missing data on marriage equality. ? ^^^^^ ----- ^ + + description_short: This is the total population of countries where there are no data on laws regulating marriage equality. ? ++++++ ++++ ^ ^ ++++++++++++++++ + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "Missing" means that there are no data on laws regulating marriage equality. ~ Column marriage_no_legal_provisions_count (changed metadata) - - description_short: This is the number of countries that do not have legal provisions for marriage equality. + + description_short: This is the number of countries where there are no laws regulating marriage equality nor civil unions. + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "No legal provisions" means that there are no laws regulating marriage equality nor civil unions. ~ Column marriage_no_legal_provisions_pop (changed metadata) - - description_short: This is the total population of countries that do not have legal provisions for marriage equality. + + description_short: This is the total population of countries where there are no laws regulating marriage equality nor civil + + unions. + + + + From the original dataset, we combined data from three different indicators: marriage equality, ban on marriage equality and civil unions.. "No legal provisions" means that there are no laws regulating marriage equality nor civil unions. - - Column marriage_partial_ban_count - - Column marriage_partial_ban_pop - - Column marriage_partial_count - - Column marriage_partial_pop + + Column marriage_partially_banned_count + + Column marriage_partially_banned_pop + + Column marriage_partially_legal_count + + Column marriage_partially_legal_pop = Dataset garden/lgbt_rights/2024-06-03/equaldex = Table equaldex ~ Column age_of_consent (changed metadata, changed data) - - - Female equal, male N/A ? ^^^ + + - Female equal, male illegal ? ^^^^^^^ ~ Changed values: 470 / 15075 (3.12%) country year age_of_consent - age_of_consent + Chile 1971 Female equal, male N/A Female equal, male illegal Papua New Guinea 2021 Female equal, male N/A Female equal, male illegal Saint Lucia 1954 Female equal, male N/A Female equal, male illegal Turkmenistan 2016 Female equal, male N/A Female equal, male illegal Zimbabwe 1967 Female equal, male N/A Female equal, male illegal ~ Column age_of_consent_current (changed metadata, changed data) - - - Female equal, male N/A ? ^^^ + + - Female equal, male illegal ? ^^^^^^^ ~ Changed values: 7 / 15075 (0.05%) country year age_of_consent_current - age_of_consent_current + Eswatini 2024 Female equal, male N/A Female equal, male illegal Namibia 2024 Female equal, male N/A Female equal, male illegal Papua New Guinea 2024 Female equal, male N/A Female equal, male illegal Saint Lucia 2024 Female equal, male N/A Female equal, male illegal Zimbabwe 2024 Female equal, male N/A Female equal, male illegal + + Column age_of_consent_female_equal__male_illegal_count + + Column age_of_consent_female_equal__male_illegal_pop - - Column age_of_consent_female_equal__male_n_a_count - - Column age_of_consent_female_equal__male_n_a_pop ~ Column changing_gender (changed data) ~ Changed values: 26 / 15075 (0.17%) country year changing_gender - changing_gender + France 1994 Legal, no restrictions Legal, surgery required France 1997 Legal, no restrictions Legal, surgery required France 2006 Legal, no restrictions Legal, surgery required France 2009 Legal, no restrictions Legal, surgery required France 2012 Legal, no restrictions Legal, surgery required ~ Column changing_gender_legal__no_restrictions_count (changed data) ~ Changed values: 52 / 15075 (0.34%) country year changing_gender_legal__no_restrictions_count - changing_gender_legal__no_restrictions_count + Europe 1994 2 1 Europe 2003 1 0 World 1994 2 1 World 2000 1 0 World 2003 1 0 ~ Column changing_gender_legal__no_restrictions_pop (changed data) ~ Changed values: 52 / 15075 (0.34%) country year changing_gender_legal__no_restrictions_pop - changing_gender_legal__no_restrictions_pop + Europe 1994 58705794 1475730 Europe 2003 59728260 0 World 1994 58705794 1475730 World 2000 58665456 0 World 2003 59728260 0 ~ Column changing_gender_legal__surgery_required_count (changed data) ~ Changed values: 52 / 15075 (0.34%) country year changing_gender_legal__surgery_required_count - changing_gender_legal__surgery_required_count + Europe 1994 17 18 Europe 2003 18 19 World 1994 36 37 World 2000 36 37 World 2003 38 39 ~ Column changing_gender_legal__surgery_required_pop (changed data) ~ Changed values: 52 / 15075 (0.34%) country year changing_gender_legal__surgery_required_pop - changing_gender_legal__surgery_required_pop + Europe 1994 464733323 521963387 Europe 2003 446493270 506221530 World 1994 2242895001 2300125065 World 2000 2309018740 2367684196 World 2003 2535405504 2595133764 Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-06-21 08:40:11 UTC Execution time: 4.06 seconds