search

dancarmoz / israel_moh_covid_dashboard_data

Data pulled from the Israeli Minsitry of Health's COVID-19 dashboard's API.
17 stars 12 forks source link

update isolated_staff.csv #3

Closed yuval-harpaz closed 3 years ago

yuval-harpaz commented 3 years ago

I cannot get the keys : ['Verified_Doctors', 'Verified_Nurses', 'isolated_Doctors', 'isolated_Nurses', 'isolated_Other_Sector'] when pulling the data with the python code. I suppose this is not available outside MOH, or am I not using the correct query? In case it is not accessible, please update the table isolated_staff.csv daily, especially these days where we want to see vaccine effect on staff. Thank you

dancarmoz commented 3 years ago

Hi Yuval, The code was out of date (I often make changes to the code locally without updating the repository, sorry). On December 6th or 7th there was a change in how the dashboard accessed these data, they are now accessed through separate queries (and have fields with Hebrew names inside them). I've updated the code on the repository now, you can see how to retrieve this data in the "update_isolated_csv" function.

Regarding the file isolated_staff.csv, it is being kept up to date. It may sometimes look as though it's a day behind, and perhaps sometimes there appear to be gaps on weekends, because it is only updated when the actual numbers are changed, which usually happens only in the evening update every day. So even if it appears to be behind, the numbers in the last entry should always be up to date with the latest update.

There is a field missing from isolated_staff.csv, of "Verified other staff" (in addition to isolated). This is because in the past this field didn't exist. I will add it to the csv in the future (the data is still tracked and saved inside the huge json, so it will appear retroactively).

yuval-harpaz commented 3 years ago

Thank you, now I can access the data. Can you please clarify why the dashboard data is different than the report issued by Timna? image

yuval-harpaz commented 3 years ago

I talked to TIMNA team, they said they only publish confirmed staff at hospitals, while here community staff is included. Mind that after the update, 12-Feb to 19-Feb were truncated from the tests table. It is an excellent resource, thanks.

dancarmoz commented 3 years ago

My pleasure :) By the way, I now updated the isolated_staff.csv, now it includes number of "verified other sectors", starting from Nov. 2nd (before that point, the data wasn't available from the API, which is also why it wasn't in the csv before). I also changed the order of the columns to be more consistent/logical.