datameet / covid19

Novel Corona Virus - COVID-19 India Datasets by DataMeet. Sunsetted on 2022-10-21. Will not update anymore.
https://projects.datameet.org/covid19/
Other
121 stars 110 forks source link

State Wise Vaccination Coverage #31

Open thejeshgn opened 3 years ago

thejeshgn commented 3 years ago

I can see that mohfw is adding State Wise Vaccination Coverage.

https://www.mohfw.gov.in/pdf/CumulativeCOVIDVaccinationCoverage7thMarch2021.pdf

Its backed up daily inside covid19/downloads/mohfw-backup/cumulative_vaccination_coverage

I will look for old ones.

thejeshgn commented 3 years ago

File name is misleading. It sas 7th March 2021. Inside it says As on 08 Mar’21 at 7:00 AM. We are going to name the files as per this datetime. Like 2021-03-08-at-07-00-AM.pdf `

naveenpf commented 3 years ago

Vaccination coverage by statewise https://dashboard.cowin.gov.in/

Didn't see stats API https://apisetu.gov.in/public/marketplace/api/cowin

thejeshgn commented 3 years ago

@naveenpf it looks like a standard dashboard to give overall stats. I couldn't get the previous data or data on a specific date outside last 30 days. "All" has weekly data.

sajinh commented 3 years ago

If it helps, state wise vaccination data can also be found as JSON document from mygov. Here is how I get them

curl https://www.mygov.in/sites/default/files/covid/vaccine/covid_vaccine_timeline.json?#{itim} -o ./vdata.#{stim}`

time = Time.now itim = time.to_i stim = time.strftime("%m-%d-%Y")

thejeshgn commented 3 years ago

does it match with the PDF on MOHFW, which they publish everyday.

https://www.mohfw.gov.in/pdf/CumulativeCOVIDVaccinationCoverageReport06052021.pdf

Thej

Thejesh GN ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0

On Fri, 7 May 2021 at 15:39, Saji Hameed @.***> wrote:

If it helps, state wise vaccination data can also be found as JSON document from mygov. Here is how I get them

curl https://www.mygov.in/sites/default/files/covid/vaccine/covid_vaccine_timeline.json?#{itim} -o ./vdata.#{stim}`

time = Time.now itim = time.to_i stim = time.strftime("%m-%d-%Y")

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/datameet/covid19/issues/31#issuecomment-834236594, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAASSUQUDBGEOGCEIFUGCLLTMO36LANCNFSM4YYUKLLQ .

sajinh commented 3 years ago

Yes, it matches except for rows 8--9 ("Dadra & Nagar Haveli" and "Daman Diu"). In the JSON file these are lumped together into one.

The data that I have collected and processed (sorted into states) for my own analysis can be found here: https://framagit.org/saji_nh/india_2020

bkamapantula commented 3 years ago

hi @thejeshgn, I'm curious if anyone has made progress on this.. a friend is looking for vaccine doses by gender. I thought I'll check here and see if anyone has already scraped it.

thejeshgn commented 3 years ago

@bkamapantula I have not seen any dataset with gender wise details. Have you?

thejeshgn commented 3 years ago

@sajinh thank you. I will add it to the auto scraper.

bkamapantula commented 3 years ago

@thejeshgn not quite the API but here's the request for Arunachal Pradesh, Changlang district (picked from the Network tab on Cowin dashboard site). has to be scraped out

https://api.cowin.gov.in/api/v1/reports/v2/getPublicReports?state_id=3&district_id=20&date=2021-05-16

at gender level this is: vaccination numbers by male/female/other at state, district granularity

bkamapantula commented 3 years ago

I scraped it, will share it in a few days.

thejeshgn commented 3 years ago

@bkamapantula that will be great.

bkamapantula commented 3 years ago

hi @thejeshgn, here it is: cowin-vaccination-doses

I update it once in two days.

thejeshgn commented 3 years ago

@bkamapantula So shall I script to download once every other day?

I would like to add it to the repo.

bkamapantula commented 3 years ago

Yes, that works @thejeshgn

Let me know if you need a specific sheet URL, I can update that sheet with new data.

Currently, I create a new sheet with date as name.

shuklaayush commented 3 years ago

@thejeshgn Looks like the 15th March bulletin was revised and the repository still has the old one.

I also found a few more files that maybe you could add. The filenames are a mess https://www.mohfw.gov.in/pdf/CumulativeCovidVaccinationCoverageReportDay40ason25Febat7AM.pdf https://www.mohfw.gov.in/pdf/CumulativeCovidVaccinationCoverageReportDay41ason26thFebat7am.pdf https://www.mohfw.gov.in/pdf/CumulativeCovidVaccinationCoverageReportDay42ason27thFebat7am.pdf https://www.mohfw.gov.in/pdf/CumulativeCovidVaccinationCoverageReportDay43ason28thFebat7am.pdf https://www.mohfw.gov.in/pdf/CumulativeCoverageReport2ndMarch2021.pdf (1st March) https://www.mohfw.gov.in/pdf/CumulativeCOVIDVaccinationCoverageReport2March2021.pdf https://www.mohfw.gov.in/pdf/CumulativeCoverageReport3rdMarch2021.pdf https://www.mohfw.gov.in/pdf/CumulativeCoverageReport4thMarch2021.pdf https://www.mohfw.gov.in/pdf/CumulativeCOVIDVaccinationCoverageReport5thMarch2021.pdf https://www.mohfw.gov.in/pdf/CumulativeCOVIDVaccinationReport6thMarch2021.pdf

thejeshgn commented 3 years ago

@shuklaayush thank you. Will look and update tonight.

thejeshgn commented 3 years ago

@shuklaayush I usually use the datetime inside the PDF (As on 16 Mar’21 at 7:00 AM) as the file name to keep it consistent.

thejeshgn commented 3 years ago

@shuklaayush added to the repo.

thejeshgn commented 3 years ago

@bkamapantula is there is a possibility of committing the code ? That will help the reproducibility. Basically I want to dump the JSON data as it is into raw data folder. Then may be a script to convert into usable format.

bkamapantula commented 3 years ago

sure, here it is: https://gitlab.com/bhanu.k/cowin-vaccination-doses

The script isn't auto-setup deliberately to monitor for failed requests.

thejeshgn commented 3 years ago

@bkamapantula thank you. I will have a look.

bkamapantula commented 3 years ago

@thejeshgn I cleaned up the instructions and updated code with better control for arguments.

Data files are available via Git LFS.

thejeshgn commented 3 years ago

@bkamapantula I have not gotten around to work on it. But its on my list. I will get to it this weekend. Thank you so much.