dsfsi / covid19za

Coronavirus COVID-19 (2019-nCoV) Data Repository and Dashboard for South Africa
https://dsfsi.github.io/covid19za-dash/
MIT License
255 stars 200 forks source link

[DATA] Help needed for Hospital Data #115

Open HerkulaasCombrink opened 4 years ago

HerkulaasCombrink commented 4 years ago

Which Dataset

health_system_za_public_hospitals.csv

Error Description

District and subdistrict data needed Estimated population size needed for each district

Suggested fixes

  1. Populating the data for the proposed file.
  2. Creating an accurate dataset that is already in a computer-readable format, and not in a PDF etc.
    1. Finding an updated Private and public Hospital repo for each South African province.

Volunteer to fix the data

Choose the data you want to fix/add and volunteer to the data you want to commit to https://docs.google.com/spreadsheets/d/1ujiuSd656BfIO3AT86GTr17oveaev-qBuYbu_v45RC4/edit?usp=sharing

elolelo commented 4 years ago

@vukosim I agree :)

This link is to the map we talked about earlier. You may add the link to it any where you see appropriate. He gave this credit and this credit @MikeMcMalace this map has some of Ampath testing centers - maybe we should combine with your findings?

anelda commented 4 years ago

@vukosim what is the relationship between this dataset and the data used in the command centre by the CSIR? Are these parallel efforts or do the data in this repository feed into that system?

vukosim commented 4 years ago

@anelda CSIR data in the short team won't be public. So here the goal is to make the data available in a public manner. Similar work is being worldwide to have an alternative public repo to what authorities have.

@elolelo please make amendments to main README to and also maybe some text to put on the dashboard.

anelda commented 4 years ago

@anelda CSIR data in the short team won't be public. So here the goal is to make the data available in a public manner. Similar work is being worldwide to have an alternative public repo to what authorities have.

Thanks @vukosim, so is the data in this repo not feeding into the CSIR data?

vukosim commented 4 years ago

In terms of official, I cannot publicly confirm what goes into the CSIR @anelda.

anelda commented 4 years ago

@elolelo thanks so much for developing the hospital data readme file. I think it really adds a lot of value to the data. I've contributed a tiny PR #167 to add the hospital-data readme to the data folder's readme so that it's more accessible to visitors of the repo.

Yeshara commented 4 years ago

Hello I have managed to collect data on available testing centres, it can be found in a csv here: https://github.com/Yeshara/Data-Science-for-COVID19/tree/master/TestingCentresData This data mainly covers testing centres outside of hosptials and could be combined with the hospital data for a full data set. The data is also plotted on a map of SA for visualisation. GeolocationOfTestingCentres4 testingCentres_latlong.txt

anelda commented 4 years ago

I have managed to collect data on available testing centres, it can be found in a csv here: https://github.com/Yeshara/Data-Science-for-COVID19/tree/master/TestingCentresData

Hi @Yeshara, just a heads-up. You switched the URL and link around in the post above which means the link doesn't take one to your repo -URL.

May I suggest that you also add information about your data sources for the testing centres like @elolelo did for the hospital data in the hospital data readme file. This will help tremendously for updating purposes, context, validation, etc.

Yeshara commented 4 years ago

Thanks for the heads-up!

I will update the readme!

IneffableKoD commented 4 years ago

Hello I have managed to collect data on available testing centres, it can be found in a csv here: https://github.com/Yeshara/Data-Science-for-COVID19/tree/master/TestingCentresData This data mainly covers testing centres outside of hosptials and could be combined with the hospital data for a full data set. The data is also plotted on a map of SA for visualisation. GeolocationOfTestingCentres4 testingCentres_latlong.txt

Dear @Yeshara, I cordially invite you to add your testing locations to our map. We already have a number of SA testing facilities and thanks to @elolelo even a Zulu translation of the map. If you could do this with a pull request and enter your data into the GeoJSON file, that would be fantastic. Don't hesitate to get in touch with me in case you have any questions!

The map: https://www.ineff.ch/cov19testmap/ My repo: https://github.com/IneffableKoD/cov19testmap

Yeshara commented 4 years ago

Hello! Will do this soon.

IneffableKoD commented 4 years ago

Hello! Will do this soon.

Great! Let me know in case you need help.

IneffableKoD commented 4 years ago

Has anyone checked/transcribed the data from this video? https://sacoronavirus.co.za/2020/04/03/johannesburg-covid-19-testing-centres/

elolelo commented 4 years ago

Has anyone checked/transcribed the data from this video? https://sacoronavirus.co.za/2020/04/03/johannesburg-covid-19-testing-centres/

I have checked it out but haven't transcribed the data ,as yet. To avoid duplicating efforts - should I leave you to it ?

IneffableKoD commented 4 years ago

I am very busy the next few days. Would be happy if someone could help.

‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Thursday, April 16, 2020 1:55 PM, Nompumelelo notifications@github.com wrote:

Has anyone checked/transcribed the data from this video? https://sacoronavirus.co.za/2020/04/03/johannesburg-covid-19-testing-centres/

I have checked it out but haven't transcribed the data ,as yet. To avoid duplicating efforts - should I leave you to it ?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

Yeshara commented 4 years ago

I would be able to help @elolelo, if you are busy.

elolelo commented 4 years ago

I would be able to help @elolelo, if you are busy.

Thanks @Yeshara ,I am busy with these testing centers right now. There is about 21 or just less clinics showning in this video. You could help by confirming that I got all the details corrently or as shown in the video. The reason for the confirmation is because the video quality from my side is not optimal, some numbers I might not get right. So, once I am done ; I will upload to the repo and then you may start double checking.

IneffableKoD commented 4 years ago

Thank you both @Yeshara and @elolelo!

anelda commented 4 years ago

Thanks @Yeshara ,I am busy with these testing centers right now. There is about 21 or just less clinics showning in this video. You could help by confirming that I got all the details corrently or as shown in the video. The reason for the confirmation is because the video quality from my side is not optimal, some numbers I might not get right. So, once I am done ; I will upload to the repo and then you may start double checking.

@elolelo @Yeshara you can use https://www.kapwing.com/tools/caption-video to automatically get access to a transcription and extract the info from there. It's free and you don't have to sign up for an account to get the transcript. There are other tools too but I found this one to probably be okay for what you need?

anelda commented 4 years ago

I've been doing more work on understanding the process of merging facility lists and working with Andy South who is the project lead from afrimapr to see how we can help to automate some of those tasks. I updated the data readme with the new link. Here it is too - http://afrimapr.org/blog/2020/merging-health-facility-lists-part1/. We don't have a solution yet and I can't offer you a more complete, cleaner data set yet, but we are working on it and will share here once there is progress.

elolelo commented 4 years ago

Here are the testing sites, @Yeshara if you still can please confirm the accuracy. The source for the geocoordinates and some addresses is the National Department of Health's Data Dictionary. I will mention this on the README.

@anelda The tool is useful it's only that the audio from the video does not mention all the necessary details that I want to hear therefore the transcript does not give perfect information as seen on the screen. One last drawback is that the tool gets some words spelled wrong (mostly African Names and other words that are just based on the presenter's pronunciation). But it has helped greatly with the numbers . Thank you

anelda commented 4 years ago

The tool is useful it's only that the audio from the video does not mention all the necessary details that I want to hear therefore the transcript does not give perfect information as seen on the screen. One last drawback is that the tool gets some words spelled wrong (mostly African Names and other words that are just based on the presenter's pronunciation). But it has helped greatly with the numbers . Thank you

@elolelo yes, African language speech to text is a field under development. If you have more needs like this, we should reach out to https://sadilar.org. Their people might know of a tool that is better with South African names and pronunciation. Not too convinced that we'll find something that will work 100%, but it's worth a try if it will save you time.

Yeshara commented 4 years ago

@elolelo I have looked at your data and the video and it seems to be accurate! Just saw that entry 9 doesn't have coordinates?

elolelo commented 4 years ago

@Yeshara That clinic on entry 9 has an address (one shown on the video ) that does not correspond with the geo-coordinates and the address shown in the Data Dictionary (source for geo-coordinates). So, l will check on google maps a bit later what geo codes to use. Thanks.

vaibhavijames commented 4 years ago

Hello! I saw that help is wanted for this project, and I was wondering if there's anything I can help out with? I have experience with data analysis and some intermediate programming as well. Let me know what I can do!

elolelo commented 4 years ago

Hello @vaibhavijames

Thanks for offering to help. I suggest that you start by getting a sense of where we are going with this issue from this blog post.

Right now the main thing that we are still working on is data collection, so we can complete atleast this main dataset. I think your analysis and development skills will still be needed just not immediately.

Putting in webpages of hospitals in this file is one thing that I think you can do. Another thing could be filling in details about field hospitals in this file.

@anelda , @MikeMcMalace , @vukosim could suggest other tasks

vaibhavijames commented 4 years ago

Sounds good! I can work on that. Glad I can help!

ghost commented 4 years ago

Hello everyone, I am Nelisiwe currently working on ‘updating the population of districts per province’, Nompumelelo referred me to the necessary csv files. I am also supporting HSRC with data collection on a broader context.

vukosim commented 4 years ago

Welcome @DevNelz.

ghost commented 4 years ago

@vukosim thank you.

vukosim commented 4 years ago

@DevNelz @elolelo Do we have specific tasks you will be focusing on or sources we have not thought about?

elolelo commented 4 years ago

I don't think we have specific tasks. Since @DevNelz offered to help, I though it would be a good start to help by filling up that first dataset by populating population estimates of district based on this source from statssa. I thought it could be meaningful on the PWA to have a population estimate accompanying the number of hospitals on each district.

So, No - we don't have new sources or tasks, yet.

Welcome, @DevNelz

Sarapsis commented 4 years ago

Hi,

If you would like a central place to edit and add more hospitals to a dataset and visualize it on a map. I have used the data you created and added it to HERE Studio. https://studio.here.com/viewer/?project_id=181b1c1e-649f-4b56-a229-5d00024532e8

If it is something you are keen on using let me know and we can develop it further.

Thanks, Clint

elolelo commented 4 years ago

Hi Clint,

Thanks for show casing what you did with the hospitals data.

I took a quick look at your map but was unable to edit . Do you maybe have a readme writing somewhere showing how one can make edits to the data on the map?

Also, is it ok that the map gets added to the projects showcased at the end of this page?

Sarapsis commented 4 years ago

Hi @elolelo,

I can create another account and add the data to it, everyone can access that account and make edits as needed.

I will have a look for a little readme/instructions on how to edit/add data, it is a relatively easy interface to use.

Feel free to add the map, wherever you need to. Also the DB and visualisations can be added to a potential app via the API's using a token.

Thanks Clint

elolelo commented 4 years ago

@Sarapsis OK, so for the account whose details you'll allow access - please use this data as there are many maps that have already been built using the data that you have used on your first map.

To add your first map on the list - the following details are needed from you

Project Name | Project Description | Project Demo | Project owner | Country

HerkulaasCombrink commented 2 years ago

We are about to close this issue