timriffe / covid_age

COVerAGE-DB: COVID-19 cases, deaths, and tests by age and sex
Other
56 stars 30 forks source link

Datasource for Israel C19 info #85

Open mpascariu opened 3 years ago

mpascariu commented 3 years ago

Hi @timriffe, Currently for Israel little or no info is collected in the database except for number of new cases. I would like to suggest a data source that might or might not be known to you: https://data.gov.il/dataset/covid-19

The website is in Hebrew, however I was able to navigate it in Chrome with auto translation.

One can find there details about weekly death and tests and more. One drawback is that for records higher than 0 and lower than 15, "<15" is displayed instead of a numerical value. I suspect that this is done in order to anonymized the data.

I think Israel deserves increased attention from us because is the leading country that is offering information about the vaccine effectiveness, so I guess everyone's eyes are on it.

mpascariu commented 3 years ago

For convenience I am attaching here last available data as of today.

ISR_corona_age_and_gender_ver_0073_2021-02-16.zip

timriffe commented 3 years ago

@eshom punting to you on this one

eshom commented 3 years ago

Thank you Marius for bringing this to our attention.

This is in fact the source we have been using all along. Both cases and tests are regularly updated. Death counts are unfortunately not reported cumulatively, and as you have noticed records below 15 are not provided with exact figures.

We have managed to manually collect complete death counts by age and sex using the following dashboard (in Hebrew only): https://datadashboard.health.gov.il/COVID-19/general We have complete deaths counts every couple of weeks or so from December to mid-February, which we'll update very soon.

Ideally we would automatically scrape the required information, but it's not obvious how to do this with the interactive dashboard components (ideas are welcome).

We are also presently working on adding vaccination counts (by age only) to the database.

mpascariu commented 3 years ago

Hi @eshom.

The dashboard is great! I am very happy to hear the good news from you. And yes, I've noticed the limitations of the data.

Thanks for your work ✌

eshom commented 3 years ago

@timriffe I've just uploaded Israel's daily vaccincation data to the database. The cleaning tracker complains the measures "Vaccination1" and "Vaccincation2" aren't valid, but otherwise it doesn't seem like there are any other issues.

Could we get these measures added?

timriffe commented 3 years ago

Thanks @eshom we aim to roll vaccination data out in a new output file, ideally by the end of this week. Will ping back here when it goes live.

Best, TIm

On Mon, Feb 22, 2021 at 2:32 PM Erez Shomron notifications@github.com wrote:

@timriffe https://github.com/timriffe I've just uploaded Israel's daily vaccincation data to the database. The cleaning tracker complains the measures "Vaccination1" and "Vaccincation2" aren't valid, but otherwise it doesn't seem like there are any other issues.

Could we get these measures added?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/timriffe/covid_age/issues/85#issuecomment-783375866, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAG43G7J2N7PQKWOKL2YCULTAJMGFANCNFSM4XY3OPXQ .

eshom commented 3 years ago

I'm glad to see vaccination data is now available for the public to download! We have on its way more complete case and death count data downloaded from the dashboard once we automate the wrangling process.

timriffe commented 3 years ago

Hi @eshom For now, the vaccination data is just coming through into the inputDB, but we never did figure out how best to age harmonize it, given the time-varying age bands (and exceptions to age restrictions). We hope the age structured vaccination data is still useful in its unharmonized age groups. Any suggestions on how to deal with this most welcome. Tagging @jessicadonzowa

On Tue, Mar 30, 2021 at 10:45 AM Erez Shomron @.***> wrote:

I'm glad to see vaccination data is now available for the public to download! We have on its way more complete case and death count data downloaded from the dashboard once we automate the wrangling process.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/timriffe/covid_age/issues/85#issuecomment-810037674, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAG43G43T26UOXYRXIQVIGDTGGFT7ANCNFSM4XY3OPXQ .