CSSEGISandData / COVID-19

Novel Coronavirus (COVID-19) Cases, provided by JHU CSSE
https://systems.jhu.edu/research/public-health/ncov/
29.12k stars 18.42k forks source link

Your actions have consequences. #1615

Open yetzt opened 4 years ago

yetzt commented 4 years ago

Changing field names and formats and renaming files without warning might not sound like a big deal to you. But your inconsiderate actions have consequences. This ist what i woke up to:

Screenshot: Missing data

My plea and warning went unheard. #1326

I'm sick and tired of having to fix the stuff you break every day and having to worry if your data will be breaking every minute. You are ignorant about what happens downstream and unprofessional.

vklicnik commented 4 years ago

Just a descending voice ... I am also being impacted by the changes, and am re-writing scripts more often than I would like to. In reality, the effort to tweak scripts/ etc is NOTHING when compared to the effort to actually gather the data. So just a shout-out to the John Hopkins team and all who are involved.

Please continue your work ... we can all adapt to changes that make sense and make the data cleaner over time ... please do not stop ... you are the clear voice in this confusing world.

yetzt commented 4 years ago

I have less trouble fixing my individual scrapers for the different websites, excel documents, pdfs, images and interactive maps of our 16 different regional health autorities than hotfixing code for this repo, wich ought to contain reliable machine-readable data in a stable format.

I've migrated my code away from using this repository. When this crisis is over there will be an interesting post mortem about this.

wmrasmussen commented 4 years ago

If a someone wants to provide a reliable service, then they should focus on reliability. Otherwise, please declare that it will be unreliable.