owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
58 stars 18 forks source link

move unused AI epoch datasets to archive #2855

Closed veronikasamborska1994 closed 1 week ago

owidbot commented 1 week ago
Quick links (staging server): Site Admin Wizard

Login: ssh owid@staging-site-archive-epoch-ai

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences ```diff = Dataset garden/artificial_intelligence/2024-06-19/epoch_compute_intensive_domain = Table epoch_compute_intensive_domain ~ Column cumulative_count (changed metadata) - - Describes the specific area, application, or field in which a large-scale AI model is designed to operate. An AI system can operate in more than one domain, thus contributing to the count for multiple domains. The 2024 data is incomplete and was last updated 19 June 2024. ? ^^ + + Describes the specific area, application, or field in which a large-scale AI model is designed to operate. An AI system can operate in more than one domain, thus contributing to the count for multiple domains. The 2024 data is incomplete and was last updated 20 June 2024. ? ^^ - - Recommendation systems offer suggestions based on user preferences, prominently seen in online shopping and media streaming. For instance, Netflix's movie suggestions or Amazon's product recommendations are powered by algorithms that analyze users' preferences and past behaviors. - - - |- - - 3D Modeling systems specialize in creating and manipulating 3D representations of objects, used in fields like architecture, engineering, and entertainment. - - - |- - - Audio systems process and generate sound, with applications in music composition, signal processing, and sound recognition. - - - |- - - Driving systems focus on autonomous vehicle technology, enabling cars to navigate and operate without human intervention. - - - |- - - Earth science systems utilize AI to study and model natural phenomena, assisting in weather forecasting and climate change studies. - - - |- - - - |- - - Materials science systems apply AI to discover and design new materials with specific properties, speeding up material discovery. - - - |- - - Mathematics systems solve complex mathematical problems and perform symbolic calculations, aiding in theorem proving and optimization. - - - Medicine systems enhance healthcare by improving diagnostics and treatment planning. - - - Robotics systems combine AI with mechanical engineering to create autonomous robots for various industries. - - - Search systems enhance search accuracy and relevance on the internet or within databases. - - - Video systems analyze and generate video content, aiding in editing, surveillance, and content creation. ~ Column yearly_count (changed metadata) - - Describes the specific area, application, or field in which a large-scale AI model is designed to operate. An AI system can operate in more than one domain, thus contributing to the count for multiple domains. The 2024 data is incomplete and was last updated 19 June 2024. ? ^^ + + Describes the specific area, application, or field in which a large-scale AI model is designed to operate. An AI system can operate in more than one domain, thus contributing to the count for multiple domains. The 2024 data is incomplete and was last updated 20 June 2024. ? ^^ - - Recommendation systems offer suggestions based on user preferences, prominently seen in online shopping and media streaming. For instance, Netflix's movie suggestions or Amazon's product recommendations are powered by algorithms that analyze users' preferences and past behaviors. - - - |- - - 3D Modeling systems specialize in creating and manipulating 3D representations of objects, used in fields like architecture, engineering, and entertainment. - - - |- - - Audio systems process and generate sound, with applications in music composition, signal processing, and sound recognition. - - - |- - - Driving systems focus on autonomous vehicle technology, enabling cars to navigate and operate without human intervention. - - - |- - - Earth science systems utilize AI to study and model natural phenomena, assisting in weather forecasting and climate change studies. - - - |- - - - |- - - Materials science systems apply AI to discover and design new materials with specific properties, speeding up material discovery. - - - |- - - Mathematics systems solve complex mathematical problems and perform symbolic calculations, aiding in theorem proving and optimization. - - - Medicine systems enhance healthcare by improving diagnostics and treatment planning. - - - Robotics systems combine AI with mechanical engineering to create autonomous robots for various industries. - - - Search systems enhance search accuracy and relevance on the internet or within databases. - - - Video systems analyze and generate video content, aiding in editing, surveillance, and content creation. ~ Dataset garden/happiness/2024-06-09/happiness (new version) + + The World Happiness Report is a partnership of Gallup, the Oxford Wellbeing Research Centre, the UN Sustainable Development Solutions Network, and the WHR’s Editorial Board. + + It reviews the state of happiness in the world today and shows how the science of happiness explains personal and national variations in happiness. - - Life evaluations from the Gallup World Poll provide the basis for the annual happiness rankings. They are based on answers to the main life evaluation question asked in the poll. - - - - This is called the Cantril ladder: it asks respondents to think of a ladder, with the best possible life for them being a 10 and the worst possible life being a 0. They are then asked to rate their own current lives on that 0 to 10 scale. - - - - The rankings are calculated by the source based on nationally representative samples for the three years prior to the year of the report, so that data for the 2023 report will draw from survey data from 2020-2022. We show the data for final year of the three-year survey period, i.e. we show the 2020-2022 survey data as 2022. - - - - The only exception is the data for the 2012 report, which uses survey data from 2005-2011, we show this data as the final year of the survey data - 2011. - - - - The number of people and countries surveyed varies year to year, but typically more than 100,000 people in 130 countries participate in the Gallup World Poll each year. - - - - The rankings are based entirely on the survey scores, using the Gallup weights to make the estimates representative. - - - - Cantril ladder data from for current and previous reports can be found at: - - - - 2023: https://happiness-report.s3.amazonaws.com/2023/DataForFigure2.1WHR2023.xls - - - - 2022: https://happiness-report.s3.amazonaws.com/2022/Appendix_2_Data_for_Figure_2.1.xls - - - - 2021: https://happiness-report.s3.amazonaws.com/2021/DataForFigure2.1WHR2021C2.xls - - - - 2020: https://happiness-report.s3.amazonaws.com/2020/WHR20_DataForFigure2.1.xls - - - - 2019: https://s3.amazonaws.com/happiness-report/2019/Chapter2OnlineData.xls - - - - 2018: https://s3.amazonaws.com/happiness-report/2018/WHR2018Chapter2OnlineData.xls - - - - 2017: https://s3.amazonaws.com/happiness-report/2017/online-data-chapter-2-whr-2017.xlsx - - - - 2016: https://s3.amazonaws.com/happiness-report/2016/Online-data-for-chapter-2-whr-2016.xlsx - - - - 2015: https://s3.amazonaws.com/happiness-report/2015/Chapter2OnlineData_Expanded-with-Trust-and-Governance.xlsx - - - - 2012: https://happiness-report.s3.amazonaws.com/2012/2012.xlsx - - sources: - - - name: World Happiness Report (2023) - - url: https://worldhappiness.report - - date_accessed: '2023-03-20' - - published_by: |- - - Helliwell, J. F., Layard, R., Sachs, J. D., De Neve, J.-E., Aknin, L. B., & Wang, S. (Eds.). (2023). World Happiness Report 2023. New York: Sustainable Development Solutions Network. - - version: '2023-03-20' ? ^ ^ - + + version: '2024-06-09' ? ^ ^ + + + update_period_days: 365 ~ Table happiness (changed metadata) - - title: World Happiness Report (2023) + + description: |- + + The World Happiness Report is a partnership of Gallup, the Oxford Wellbeing Research Centre, the UN Sustainable Development Solutions Network, and the WHR’s Editorial Board. + + It reviews the state of happiness in the world today and shows how the science of happiness explains personal and national variations in happiness. + + primary_key: + + - country + + - year ~ Column cantril_ladder_score (changed metadata, new data, changed data) + + description_short: |- + + Average of survey responses to the 'Cantril Ladder' question in the Gallup World Poll. The survey question asks respondents to think of a ladder, with the best possible life for them being a 10, and the worst possible life being a 0. + + description_key: + + - |- + + The Cantril ladder asks respondents to think of a ladder, with the best possible life for them being a 10 and the worst possible life being a 0. They are then asked to rate their own current lives on that 0 to 10 scale. + + - |- + + The rankings are calculated by the source based on nationally representative samples for the three years prior to the year of the report, so that data for the 2024 report will draw from survey data from 2021-2023. We show the data for final year of the three-year survey period, i.e. we show the 2021-2023 survey data as 2023. + + - |- + + The only exception is the data for the 2012 report, which uses survey data from 2005-2011, we show this data as the final year of the survey data - 2011. + + - |- + + The number of people and countries surveyed varies year to year, but typically more than 100,000 people in 130 countries participate in the Gallup World Poll each year. + + - The rankings are based entirely on the survey scores, using the Gallup weights to make the estimates representative. + + - |- + + The data is the compilation of all previous World Happiness Reports, which can be found at https://worldhappiness.report/archive/. + + origins: + + - producer: Wellbeing Research Centre + + title: World Happiness Report + + description: |- + + The World Happiness Report is a partnership of Gallup, the Oxford Wellbeing Research Centre, the UN Sustainable Development Solutions Network, and the WHR’s Editorial Board. + + It reviews the state of happiness in the world today and shows how the science of happiness explains personal and national variations in happiness. + + citation_full: |- + + Helliwell, J. F., Layard, R., Sachs, J. D., De Neve, J.-E., Aknin, L. B., & Wang, S. (Eds.). (2024). World Happiness Report 2024. University of Oxford: Wellbeing Research Centre. + + version_producer: 2024 + + url_main: https://worldhappiness.report/ed/2024/ + + url_download: https://happiness-report.s3.amazonaws.com/2024/DataForFigure2.1+with+sub+bars+2024.xls + + date_accessed: '2024-06-09' + + date_published: '2024-03-08' + + license: + + name: '' + + url: https://worldhappiness.report/ed/2024/ + + - producer: Various sources + + title: Population + + description: |- + + Our World in Data builds and maintains a long-run dataset on population by country, region, and for the world, based on various sources. + + + + You can find more information on these sources and how our time series is constructed on this page: https://ourworldindata.org/population-sources + + citation_full: |- + + The long-run data on population is based on various sources, described on this page: https://ourworldindata.org/population-sources + + attribution: Population based on various sources (2023) + + attribution_short: Population + + url_main: https://ourworldindata.org/population-sources + + date_accessed: '2023-03-31' + + date_published: '2023-03-31' + + license: + + name: CC BY 4.0 + + licenses: + + - name: Creative Commons BY 4.0 + + url: https://docs.google.com/document/d/1-RmthhS2EPMK_HIpnPctcXpB0n7ADSWnXa5Hb3PxNq4/edit?usp=sharing + + - name: CC BY 3.0 + + url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt + + - name: CC BY 3.0 IGO + + url: http://creativecommons.org/licenses/by/3.0/igo/ + + processing_level: major + + presentation: + + title_public: Self-reported life satisfaction + + attribution_short: WHR + + attribution: World Happiness Report (2012-2024) + + topic_tags: + + - Happiness & Life Satisfaction + + description_processing: Average of regions is calculated by taking a population-weighted average over all countries within + + that region. + + New values: 264 / 1787 (14.77%) cantril_ladder_score 7.5715 4.9753 6.6480 6.3788 4.1969 ~ Changed values: 1522 / 1787 (85.17%) cantril_ladder_score - cantril_ladder_score + 7.1229 1.859000 7.0636 4.471300 6.4940 6.171800 4.2920 5.477073 6.8670 7.235363 ~ Column country (changed metadata, new data, changed data) - - {} + + origins: + + - producer: Wellbeing Research Centre + + title: World Happiness Report + + description: |- + + The World Happiness Report is a partnership of Gallup, the Oxford Wellbeing Research Centre, the UN Sustainable Development Solutions Network, and the WHR’s Editorial Board. + + It reviews the state of happiness in the world today and shows how the science of happiness explains personal and national variations in happiness. + + citation_full: |- + + Helliwell, J. F., Layard, R., Sachs, J. D., De Neve, J.-E., Aknin, L. B., & Wang, S. (Eds.). (2024). World Happiness Report 2024. University of Oxford: Wellbeing Research Centre. + + version_producer: 2024 + + url_main: https://worldhappiness.report/ed/2024/ + + url_download: https://happiness-report.s3.amazonaws.com/2024/DataForFigure2.1+with+sub+bars+2024.xls + + date_accessed: '2024-06-09' + + date_published: '2024-03-08' + + license: + + name: '' + + url: https://worldhappiness.report/ed/2024/ + + New values: 264 / 1787 (14.77%) country Switzerland Turkey United Arab Emirates Uruguay Yemen ~ Changed values: 1505 / 1787 (84.22%) country - country + New Zealand Afghanistan Tanzania Liberia Azerbaijan Malaysia Iraq Niger Nepal Spain ~ Column level_0 (new data) + + New values: 264 / 1787 (14.77%) level_0 1531 1624 1659 1704 1763 ~ Column population (changed metadata, new data, changed data) - - {} + + title: Population + + description: Population by country and year. + + description_short: Population by country, available from 10,000 BCE to 2100, based on data and estimates from different sources. + + origins: + + - producer: Various sources + + title: Population + + description: |- + + Our World in Data builds and maintains a long-run dataset on population by country, region, and for the world, based on various sources. + + + + You can find more information on these sources and how our time series is constructed on this page: https://ourworldindata.org/population-sources + + citation_full: |- + + The long-run data on population is based on various sources, described on this page: https://ourworldindata.org/population-sources + + attribution: Population based on various sources (2023) + + attribution_short: Population + + url_main: https://ourworldindata.org/population-sources + + date_accessed: '2023-03-31' + + date_published: '2023-03-31' + + license: + + name: CC BY 4.0 + + licenses: + + - name: Creative Commons BY 4.0 + + url: https://docs.google.com/document/d/1-RmthhS2EPMK_HIpnPctcXpB0n7ADSWnXa5Hb3PxNq4/edit?usp=sharing + + - name: CC BY 3.0 + + url: https://dataportaal.pbl.nl/downloads/HYDE/HYDE3.2/readme_release_HYDE3.2.1.txt + + - name: CC BY 3.0 IGO + + url: http://creativecommons.org/licenses/by/3.0/igo/ + + unit: persons + + short_unit: '' + + display: + + numDecimalPlaces: 0 + + processing_level: major + + presentation: + + topic_tags: + + - Happiness & Life Satisfaction + + New values: 264 / 1787 (14.77%) population 8638609 85816192 8994266 3422205 32981644 ~ Changed values: 1512 / 1787 (84.61%) population - population + NaN 41128772 NaN 205188208 NaN 10999668 NaN 1383112064 NaN 32749838 ~ Column year (new data, changed data) + + New values: 264 / 1787 (14.77%) year 2020 2023 2016 2017 2021 ~ Changed values: 1386 / 1787 (77.56%) year - year + 2020.0 2014 2018.0 2022 2015.0 2021 2014.0 2017 2011.0 2014 Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-06-20 15:58:23 UTC Execution time: 16.97 seconds