VACCINATIONS: how to add new countries or entries to our data

edomt commented 3 years ago

This is a centralized issue to let our users suggest sources to add new countries, or new entries for existing countries, to our data on COVID-19 vaccinations.

We only take into account numbers that are announced by official sources (head of government, ministry of health, public health agencies, public officials in charge of the vaccination campaign, etc.).
We only count administered doses, not distributed doses.
We will not include participants in the vaccine arm of clinical trials, as this data is not available for many of the hundreds of trials currently taking place.
Our current sources are visible in vaccinations/locations.csv.

For countries that are already included in our data, most of our imports are automated and will collect the latest number when we update our dataset. If you don't see the latest number appear in our data, please wait at least 24 hours before suggesting it here.

Note that contributions via pull requests are not possible due to the way our data pipeline is set up.

Emoji system

@lucasrodes and @edomt use emojis to track comments in this issue.

👍 means that the comment has been read and looked into, and the data will be added during our next update (our vaccination dataset is updated each morning, London time)
👀 means that the comment has been read and looked into, but that the data (or some of the data) will not be added. This can be for a number of reasons: because we already have this data, because there is something wrong with the source, because the numbers contradict what other sources are showing, etc. If you have questions in this regard, you can read our contribute guideline or open a new issue referencing the comment.

Remarks

Please read our "how to contribute" section for more details.
This thread is meant to be used only to report new data points, for specific questions/suggestions please consider opening a new issue. If your comment is not a data report, a new thread may be opened to follow the discussion (see example).

EladHeller commented 3 years ago

Minister of Health of Israel: On December 27, approximately 98,900 people were vaccinated in Israel. In total, about 379,000 people were vaccinated in Israel. https://twitter.com/YuliEdelstein/status/1343423578205794305

artdgn commented 3 years ago

In case some additional sources can be found from https://www.bloomberg.com/graphics/covid-vaccine-tracker-global-distribution/ - it seems to have very similar data, except Russia is assigned an order of magnitude more vaccinations (440K) compared to your data (55K).

edomt commented 3 years ago

@artdgn Thanks! We know about that 440k estimate from Bloomberg for Russia, but we can't identify a source that would confirm this. In fact, we realized a few days ago that the total number of doses administered so far in Russia was much lower than previously thought: https://twitter.com/redouad/status/1343544952052133888

philiprusinov commented 3 years ago

Status update for Bulgaria, 30-12-2020 3844 already vaccinated. Information were presented by ministry of health at today's government meeting. https://www.gov.bg/bg/prestsentar/novini/pravitelstvoto-otpusna-oshte-125-miliona-leva-za-vaksini-sreshtu-COVID%E2%80%9319

philiprusinov commented 3 years ago

Hello, Official statistic for vaccination in Bulgaria is available now. Please check the table on the right, on the government COVID portal. It seem this could be automated. For now there are 4608 vaccinated. Best regards,

https://coronavirus.bg/bg/statistika

edomt commented 3 years ago

Thank you @philiprusinov, that's very useful! We'll be able to automate the collection with this.

Daavide commented 3 years ago

Italy: https://app.powerbi.com/view?r=eyJrIjoiMzg4YmI5NDQtZDM5ZC00ZTIyLTgxN2MtOTBkMWM4MTUyYTg0IiwidCI6ImFmZDBhNzVjLTg2NzEtNGNjZS05MDYxLTJjYTBkOTJlNDIyZiIsImMiOjh9

Trying to find in a better format.

RozaGkliva commented 3 years ago

Hello, Thank you for this massive effort. Regarding sourcing data for Greece, the source you used for vaccinations is a regional newspaper. A more official source would be the periodic announcements from the National Public Health Organization. In particular for Dec 30 they gave the specific numbers in an answer to a journalist's question. The announcement's transcript can be found here: https://eody.gov.gr/enimerosi-20201230/

edomt commented 3 years ago

Thank you @RozaGkliva!

tsdgeos commented 3 years ago

How would you feel about adding stats for Catalonia?

You have England/Scotland/Wales/NorthernIreland in addition to UK so i think that maybe adding Catalonia is OK?

Total number is available as text at https://dadescovid.cat/ (the Vacunats field), as a daily number in https://dadescovid.cat/diari (the vacunats column) and as a csv at https://dadescovid.cat/static/csv/catalunya_diari_total_pob.zip

Maybe adding Catalonia we can convince Spain/the rest of regions to start giving vaccination numbers?

edomt commented 3 years ago

How would you feel about adding stats for Catalonia?

@tsdgeos We've considered the opportunity to add partial data for Spain, but it would likely lead to requests to add many more subnational regions, which we simply don't have the resources to handle right now. My hope is that the Spanish government will soon publish aggregated data for the whole country. If that's still not the case by January 10, we'll probably have to use some manually-aggregated numbers.

tsdgeos commented 3 years ago

Can you please explain what's your rationale to include Wales but not Catalonia?

I mean don't get me wrong, this is your dataset and you do whatever you want with it, but i sincerely would like to understand why a subnational region gets included and another one doesn't.

edomt commented 3 years ago

Can you please explain what's your rationale to include Wales but not Catalonia?

@tsdgeos Of course! That's a completely legitimate question. There are 3 main reasons:

Timing: we added UK subnational data very early, when everyone was very eager to see vaccination data and the UK was the only country in the world administering the vaccine.
Automation: maintaining this data is basically painless as the collection is fully automated via the official API. In many countries, gathering subnational data involves manually collecting data from dashboards on a daily basis. (Catalonia is of course a counter-example since the collection could be automated, but I'm guessing that it's sadly not the case for some of the other 16 autonomous regions.)
Size: while there are only 4 nations in the UK, adding subnational data for Spain would mean collecting data for 17 locations, the United States would add 50 locations, etc. This is simply something we can't see ourselves doing with our current resources.

That's not to say that we'll never do this—but national data itself is taking the bulk of our time right now.

michael404 commented 3 years ago

Norway: The director of the Norwegian Institute of Public Health announced "over 2200" persons vaccinated in a press conference on Jan 3rd, as reported here: https://www.tv2.no/nyheter/11869599/

edomt commented 3 years ago

Thanks @michael404 !

kevloral commented 3 years ago

Regarding the information about vaccination in Spain, an update:

Initially you used a tweet sent by a Spanish newspaper: https://twitter.com/eldiarioes/status/1346150722178576389
Then you were told an actual official document existed in PDF format: https://www.mscbs.gob.es/profesionales/saludPublica/ccayes/alertasActual/nCov/documentos/Informe_GIV_comunicacion.pdf
I have seen that in your spain.py automation script, you are scraping the vaccinations figure from this URL: https://www.mscbs.gob.es/profesionales/saludPublica/ccayes/alertasActual/nCov/vacunaCovid19.htm

However, I have just seen that they have added a new file in ODS format with the same information as in the PDF, but in a more easily parseable format. It is available here:

https://www.mscbs.gob.es/profesionales/saludPublica/ccayes/alertasActual/nCov/documentos/Informe_Comunicacion.ods

edomt commented 3 years ago

Thanks @kevloral—you're right that the ODS file will likely become much more usable in the future, but I'm tempted to wait for its next update to see whether the format changes (for example the name of the sheet Hoja3 sounds very temporary).

michael404 commented 3 years ago

Update on Norway:

Per-day numbers are now available on page 46 here: https://www.fhi.no/contentassets/8a971e7b0a3c4a06bdbf381ab52e6157/vedlegg/andre-halvar-2020/2021.01.06-ukerapport-uke-53-covid-19.pdf

This report will be updated on Wednsdays and linked to from here: https://www.fhi.no/publ/2020/koronavirus-ukerapporter/

edomt commented 3 years ago

Thanks @michael404! This format is… disconcerting. I hope they come up with a simpler system soon.

edomt commented 3 years ago

Looks like Norway data is also here in a better format: https://www.fhi.no/sv/vaksine/koronavaksinasjonsprogrammet/koronavaksinasjonsstatistikk/

nibble0101 commented 3 years ago

@edomt How frequently do you update the vaccine data? 1, 12, 24 hourly?

edomt commented 3 years ago

@nibble0101 We update the data at least once a day (some time in the afternoon, Europe time) but often more times after this.

pehovorka commented 3 years ago

Hello, thank you for your effort! There is now the official vaccination number in the Czech Republic. It is in the yellow box here: https://onemocneni-aktualne.mzcr.cz/covid-19

Unfortunately, it seems to be pretty rushed considering the duplicate HTML IDs. It will probably be changed in the next few days. Let's hope there is an official dataset soon.

edomt commented 3 years ago

Hi @pehovorka! I just happen to have automated the collection for Czechia based on this a minute ago :) And yes I agree that it does seem like a very temporary thing, I expect they'll add it to the actual API soon. Thank you!

pehovorka commented 3 years ago

Great, thank you @edomt! :)

Daavide commented 3 years ago

Hi, finally opendata for Italy! Should be better than the PowerBI dashboard...

https://github.com/italia/covid19-opendata-vaccini/blob/master/dati/vaccini-summary-latest.csv

Hope this helps, and thanks for your work!

ghost commented 3 years ago

No open data, but a little bit of data from The Netherlands: https://www.msn.com/nl-nl/nieuws/Binnenland/acute-zorg-verwacht-inenten-maandag-af-te-ronden/ar-BB1cy5JQ?li=BBoPOOe (The National Acute Care Network (LNAZ) says on the first day of vaccination jan 6th, 6.000 people were vaccinated)

edomt commented 3 years ago

Thank you @wh82!

Aymerik commented 3 years ago

No open data yet in France (Coming soon...) but the approximate number of vaccinated for the day has been published by the Minister of Health : https://twitter.com/olivierveran/status/1347275767839944712

Since the beginning, 45,000 French people have been vaccinated (first dose). (source: Prime Minister at a press conference - https://twitter.com/gouvernementFR/status/1347226837311635457 at 29'50)

edomt commented 3 years ago

Merci Aymerik :)

limolitz commented 3 years ago

The Swedish Medical Products Agency has published some numbers here (in Swedish). They say that in the beginning of week 1 (so either January 4th or January 5th, as January 6th was a public holiday here), about 40 000 people were vaccinated in total. Let's hope they get a bit more open soon.

edomt commented 3 years ago

Thank you @wasmitnetzen

ghost commented 3 years ago

New data from the Netherlands

https://www.lnaz.nl/nieuws/26000-medewerkers-in-de-acute-zorg-gevaccineerd

garas commented 3 years ago

New dashboard of vaccination in Lithuania, updated daily. Data can be retrieved from ArcGIS REST.

edomt commented 3 years ago

Wonderful, thank you @garas

valerianb commented 3 years ago

Total of 8000 people vaccinated on the 7th in Belgium (French speaking newspaper https://www.lalibre.be/belgique/societe/vaccins-en-belgique-5ff9a1dc9978e227df5eb4ec "Au jour du 7 janvier, 8.000 personnes avaient déjà pu recevoir la première dose du vaccin Pfizer.")

edomt commented 3 years ago

Merci @valerianb :)

lucasrodes commented 3 years ago

New entry for Austria:

15.905 people vaccinated as of 7th January 2021.

Reference from https://www.sozialministerium.at/Corona-Schutzimpfung/Corona-Schutzimpfung.html (accessed 2021-01-10 11:15 UTC). Alternatively, a snapshot from web.archive: https://web.archive.org/web/20210108104810/https://www.sozialministerium.at/Corona-Schutzimpfung/Corona-Schutzimpfung.html

edomt commented 3 years ago

@lucasrodes We've interpreted that number as describing doses delivered (see https://github.com/owid/covid-19-data/issues/252), but an actual number has been reported today: https://twitter.com/redouad/status/1348256152786710530

valerianb commented 3 years ago

Belgium - https://www.lalibre.be/belgique/societe/pres-de-14-000-personnes-ont-recu-une-1ere-dose-du-vaccin-en-wallonie-35-000-prevues-la-semaine-prochaine-5ffaf56a9978e227df6917ac "13.727 personnes ont déjà reçu une première dose en Wallonie, selon la ministre". However this number is for the southern part of the country only. Still higher than the national number reported on the 7th. On a side note, a vaccination dashboard is underway for Belgium (https://www.standaard.be/cnt/dmf20210109_95417444 in dutch)

edomt commented 3 years ago

Good news about the dashboard! Feel free to let me know as soon as it's available 👍 (Unfortunately we can't use the article from La Libre if it's only for Wallonie.)

Aric5301 commented 3 years ago

Hi! Just wanted to let you know that the Israeli gov't is now reporting daily vaccination data on the national Covid-19 Control Panel. It's in Hebrew so I translated the relevant titles to English so that you could understand what is what:

In addition, I believe that this data can be fetched automatically through an API of Data Gov which hosts this data. This table contains all the vaccinations administered per city per day. Summing everything should give a total number of how many were vaccinated. There is an "API" button on the top left that contains information on how to use it.

Unfortunately I don't understand a lot in data structures so all I can help with is translate Hebrew to English. I can't try anything by myself and report to you my findings. I hope that I was still useful :)

Also, a small addition: Israel now also vaccinates using the Moderna vaccine so it can be added to the vaccines type column of Israel. First batch of Moderna vaccines arrives in Israel, THE TIMES OF ISRAEL.

Good luck and keep up the great work!

edomt commented 3 years ago

Thank you @Aric5301, very useful!

vikdork commented 3 years ago

The Swedish Medical Products Agency has published some numbers here (in Swedish). They say that in the beginning of week 1 (so either January 4th or January 5th, as January 6th was a public holiday here), about 40 000 people were vaccinated in total. Let's hope they get a bit more open soon.

@edomt Better Swedish data from Folkhälsomyndigheten. https://www.folkhalsomyndigheten.se/smittskydd-beredskap/utbrott/aktuella-utbrott/covid-19/vaccination-mot-covid-19/leveranser-av-vaccin/

edomt commented 3 years ago

@vikdork As far as I understand these are vaccine deliveries, not doses administered.

edomt commented 3 years ago

@Aric5301 Unfortunately the local vaccination data for Israel seems to be incomplete: I only get a total "cumulative vaccinated" of 1,340,589 right now which is far less than the official total. Do you see another dataset in https://data.gov.il/dataset/covid-19 that might simply have the national count that's shown on the dashboard? (currently 1 806 578)

limolitz commented 3 years ago

I agree, the data from @vikdork are delivered doses. FOHM will eventually publish more up to date data for administered doses (see the announcement here (Swedish)), but they are still waiting for the data from the 21 regions, which are responsible for healthcare.

vikdork commented 3 years ago

I agree, the data from @vikdork are delivered doses. FOHM will eventually publish more up to date data for administered doses (see the announcement here (Swedish)), but they are still waiting for the data from the 21 regions, which are responsible for healthcare. @edomt Yeah of course you are correct. How could I miss that one? 🤐

Aric5301 commented 3 years ago

@Aric5301 Unfortunately the local vaccination data for Israel seems to be incomplete: I only get a total "cumulative vaccinated" of 1,340,589 right now which is far less than the official total. Do you see another dataset in https://data.gov.il/dataset/covid-19 that might simply have the national count that's shown on the dashboard? (currently 1 806 578)

Hi! I wrote an email to the authorities about that issue. I will update as soon as I have more information.

joehoyle commented 3 years ago

Question on United Kingdom data: will you accept manual updates for the UK? The automation for the UK pulls from api.coronavirus.data.gov.uk, which only updates every 8-9 days. Daily figures are only released in press updates like https://www.bbc.com/news/uk-55621228 typically by Boris Johnson in video updates. Currently 2.4 million vaccinations have been administered, but OWID still has 1.3 million.

owid / covid-19-data

VACCINATIONS: how to add new countries or entries to our data #230

Emoji system

Remarks