akarlinsky / world_mortality

World Mortality Dataset: international data on all-cause mortality.
MIT License
282 stars 56 forks source link

Data Sources for Ireland (revised) #35

Open R-Witzbold opened 2 weeks ago

R-Witzbold commented 2 weeks ago

Am unsure if my comment to a closed issue will be seen, so am opening a new issue here. Please remove as necessary.

_Originally posted by @R-Witzbold in https://github.com/akarlinsky/world_mortality/issues/30#issuecomment-2185271752_

Hi Ariel und Dimitry,

Please be advised, the death counts (2015-2021) in VSD39 from CSO from which you are calculating weekly totals for Ireland are INCOMPLETE. These totals exclude "late registered deaths", i.e. deaths registered after the CSO publishes its Vital Statistics Annual Report. For example: 2019 - over 900 deaths have since been added to total number of deaths occurring in VSD39 (which you are using), i.e. a difference ~3%

2007-2020 REVISED TOTALS are now readily available by MONTH from CSO https://data.cso.ie/table/VSM01 VSM01: Revised Deaths Occurring (Number): by Age Group, Sex, Month Notes: "This table was created to take account of late registered deaths and update figures published at the time of Annual Reports. These figures will be revised over time to take account of further late registrations...."

For 2021 onward, the Eurostat weekly data scraped from RIP.ie are also an undercount - i.e. it is not a question of the figures "might" change, but rather they "will increase" once registrations become more complete. CSO has estimated the scraped totals from RIP.ie are ultimately as much as 3~5% below actual. For example: 2020 - current shortfall between scraped weekly totals and revised figure is ~4%. 2022 - current shortfall is only ~1% (but will increase as more late registrations added)

Therefore, I suggest you comment the more recent (2021-2024) Irish data as "incomplete" instead of "preliminary".

Kind regards, Rainer

_Originally posted by @R-Witzbold in https://github.com/akarlinsky/world_mortality/issues/30#issuecomment-2185271752_