TheEconomist / covid-19-the-economist-global-excess-deaths-model

The Economist's model to estimate excess deaths to the covid-19 pandemic
https://www.economist.com/graphic-detail/coronavirus-excess-deaths-estimates
MIT License
459 stars 83 forks source link

Question on baseline of expected deaths #22

Closed dFila closed 1 year ago

dFila commented 1 year ago

Hi there,

I was trying to find the baseline of global expected mortality for the entire year (Jan 1 - Dec 31) in 2020 and in 2021. I was able to find the global excess mortality estimates and the expected mortality by country, but I could not find the number of global expected deaths used to calculate the "central excess death estimate" figures published by Our World in Data (16.99M from Jan 1, 2020 to Dec 20, 2021).

https://ourworldindata.org/excess-mortality-covid#estimated-excess-mortality-from-the-economist

Specifically, I am looking for the “central” estimate for the following: global ACM in 2020 (Jan 1 - Dec 31) global ACM in 2021 (Jan 1 - Dec 31) global expected mortality in 2020 (Jan 1 - Dec 31) global expected mortality in 2021 (Jan 1 - Dec 31)

Also, what is meant by “central” excess death estimate? Is it the median or the mean of the models used?

Thanks

sondreus commented 1 year ago

Thank you for your message.

We do not have this data, because where ACM is missing, we estimate excess deaths directly. This is deliberate: we estimate what we want to estimate directly, rather than intermediate quantities (such as ACM and expected ACM). I can go into more detail on this if needed.

The central estimate is the mean of 10 models all fit on the full sample of data with different starting seeds. It is not the median or mean of all the models used to compute the confidence intervals (which are built using data from a stratified random sample).

Hope this helps!

dFila commented 1 year ago

It does. Could you please elaborate on how you estimate excess mortality directly without ACM and expected ACM? I thought that was the definition of excess mortality, the difference between the two.

sondreus commented 1 year ago

Sure, full details are here: https://www.economist.com/graphic-detail/2021/05/13/how-we-estimated-the-true-death-toll-of-the-pandemic

Essentially, one does not need to know the subcomponent of something to estimate it (much like how one can estimate GDP without breaking it into its constituent parts). We have ACM and expected ACM for some countries, with the details here: https://www.economist.com/graphic-detail/coronavirus-excess-deaths-tracker. We use this to come up with excess deaths figures for the these countries. We then use these excess deaths figures as our training data, and estimate it directly.

Hope this helps!

dFila commented 1 year ago

Also, the quotes below led me to believe that The Economist did estimate expected deaths. From the article:

https://www.economist.com/graphic-detail/coronavirus-excess-deaths-tracker

“We have used statistical models to create our baselines, by predicting the number of deaths each region would normally have recorded in 2020 and 2021”

“Update (October 14th 2020): A previous version of this page used a five-year average of deaths in a given region to calculate a baseline for excess deaths. The page now uses a statistical model for each region, which predicts the number of deaths we might normally have expected in 2020”

dFila commented 1 year ago

My apologies, I did not see your previous reply.

sondreus commented 1 year ago

No problem. Did my reply clarify sufficiently?

dFila commented 1 year ago

Yes, thank you. I do have one more question. For the countries with available data, what data was used to extrapolate the baseline figures? To clarify my question, the article we both shared mentions an update where a five-year average was initially used to calculate the baseline, and this average was replaced with a statistical model. Was the statistical model that was used to predict the counterfactual based on data from the same five year period, presumably 2015 to 2019?

dFila commented 1 year ago

^ https://www.economist.com/graphic-detail/coronavirus-excess-deaths-tracker

sondreus commented 1 year ago

Yes, 2015-2019, with a week, month or quarter fixed effects and a year trend. You can find the details and code here: https://github.com/TheEconomist/covid-19-excess-deaths-tracker

dFila commented 1 year ago

Thank you for taking the time to answer my questions.

sondreus commented 1 year ago

My pleasure. Glad I could help.

On Wed, 26 Oct 2022 at 15:36, dFila @.***> wrote:

Thank you for taking the time to answer my questions.

— Reply to this email directly, view it on GitHub https://github.com/TheEconomist/covid-19-the-economist-global-excess-deaths-model/issues/22#issuecomment-1292150999, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEBNHBYELMGSVIY7LWMIJS3WFE6W3ANCNFSM6AAAAAAROY74PE . You are receiving this because you commented.Message ID: <TheEconomist/covid-19-the-economist-global-excess-deaths-model/issues/22/1292150999 @github.com>

--

-- Sondre Ulvund Solstad, PhD

Senior Data Journalist

1-11 John Adam Street, London WC2N 6HT, United Kingdom

www.economist.com | @sondreus https://twitter.com/Sondreus

-- This e-mail may contain confidential material. If you are not an intended recipient, please notify the sender and delete all copies. It may also contain personal views which are not the views of The Economist Group. We may monitor e-mail to and from our network. Sent by a member of The Economist Group. The Group's parent company is The Economist Newspaper Limited, registered in England with company number 236383 and registered office at The Adelphi, 1-11 John Adam Street, London, WC2N 6HT. For Group company registration details go to http://legal.economistgroup.com http://legal.economistgroup.com